ewmscp issueshttps://gitlab.desy.de/ewmscp/ewmscp/-/issues2021-11-26T12:04:53+01:00https://gitlab.desy.de/ewmscp/ewmscp/-/issues/13Time stamp issue on riscv64 and ppc642021-11-26T12:04:53+01:00Juergen HannappelTime stamp issue on riscv64 and ppc64riscv64
Starting timeInfo.bash ...failed
for 2021/02/17 18:16:0: dateTest 1613582167, date 1613585767, 3600 difference
Command exited with non-zero status 1
0:00.05 0 8 2972
keeping /tmp/tes...riscv64
Starting timeInfo.bash ...failed
for 2021/02/17 18:16:0: dateTest 1613582167, date 1613585767, 3600 difference
Command exited with non-zero status 1
0:00.05 0 8 2972
keeping /tmp/testsrc.cSDVwp and /tmp/testdst.QSfcO8
ppc64
Starting timeInfo.bash ...failed
for now: dateTest 1637918349, date 1637918348, -1 difference
0:00.02 16 128 4608
keeping /tmp/testsrc.CbfHYv and /tmp/testdst.7BFR0fhttps://gitlab.desy.de/ewmscp/ewmscp/-/issues/12format problem on ARM2021-05-18T10:34:17+02:00Juergen Hannappelformat problem on ARM```
/data/gitlab-runner/builds/kRjviDpU/0/ewmscp/ewmscp/src/genericStat.cpp: In static member function ‘static void genericStat::chronoToString(std::__cxx11::string&, const time_point&)’:
/data/gitlab-runner/builds/kRjviDpU/0/ewmscp/ewms...```
/data/gitlab-runner/builds/kRjviDpU/0/ewmscp/ewmscp/src/genericStat.cpp: In static member function ‘static void genericStat::chronoToString(std::__cxx11::string&, const time_point&)’:
/data/gitlab-runner/builds/kRjviDpU/0/ewmscp/ewmscp/src/genericStat.cpp:52:23: warning: format ‘%ld’ expects argument of type ‘long int’, but argument 3 has type ‘std::chrono::duration<long long int, std::ratio<1, 1000000> >::rep’ {aka ‘long long int’} [-Wformat=]
std::sprintf(buffer, "%06ld", std::chrono::duration_cast<std::chrono::microseconds>(Chrono.time_since_epoch()).count() % 1000000);
```Juergen HannappelJuergen Hannappelhttps://gitlab.desy.de/ewmscp/ewmscp/-/issues/11checksumming fails if a link pointing to a directory is encountered2021-01-26T14:49:23+01:00Juergen Hannappelchecksumming fails if a link pointing to a directory is encounteredRIT: : ewmscp ended badly: read failed on /gpfs/exfel/d_new/cal_tst/caldb_store: Is a directory, pid: 8166
CRIT: ended badly: read failed on /gpfs/exfel/d_new/cal_tst/caldb_store: Is a directory
FRIT: : ewmscp ended badly: read failed on /gpfs/exfel/d_new/cal_tst/caldb_store: Is a directory, pid: 8166
CRIT: ended badly: read failed on /gpfs/exfel/d_new/cal_tst/caldb_store: Is a directory
Fhttps://gitlab.desy.de/ewmscp/ewmscp/-/issues/10json-follower does not see symlink creation and delete events2021-01-23T10:49:42+01:00Juergen Hannappeljson-follower does not see symlink creation and delete eventsDelete events are not handled in followJsonRequestProvider.
symlink creation also not.
It can be detected (for watchfolder..) by lookin at IN_CREATE events where the "permissions" tag indicates a symlink.Delete events are not handled in followJsonRequestProvider.
symlink creation also not.
It can be detected (for watchfolder..) by lookin at IN_CREATE events where the "permissions" tag indicates a symlink.https://gitlab.desy.de/ewmscp/ewmscp/-/issues/9Sometimes in build jobs the submodules are not properly updated2020-11-25T08:15:59+01:00Juergen HannappelSometimes in build jobs the submodules are not properly updatedJob [#5760](https://gitlab.desy.de/ewmscp/ewmscp/-/jobs/5760) failed for 7ce854d4f8ea96f22862f41ab26eeb787da15e2a:Job [#5760](https://gitlab.desy.de/ewmscp/ewmscp/-/jobs/5760) failed for 7ce854d4f8ea96f22862f41ab26eeb787da15e2a:https://gitlab.desy.de/ewmscp/ewmscp/-/issues/8sporadic crashes in makeSymLink2020-11-12T16:57:44+01:00Juergen Hannappelsporadic crashes in makeSymLink```
#0 0x000000000048c08a in copyRequest::base::makeSymLink(inputHandler::base*, outputHandler::base*) () at /opt/rh/devtoolset-9/root/usr/include/c++/9/bits/basic_string.h:3901
3901 size() const _GLIBCXX_NOEXCEPT
Missing separate...```
#0 0x000000000048c08a in copyRequest::base::makeSymLink(inputHandler::base*, outputHandler::base*) () at /opt/rh/devtoolset-9/root/usr/include/c++/9/bits/basic_string.h:3901
3901 size() const _GLIBCXX_NOEXCEPT
Missing separate debuginfos, use: debuginfo-install file-libs-5.11-36.el7.x86_64 glibc-2.17-307.el7.1.x86_64 krb5-libs-1.15.1-46.el7.x86_64 libcom_err-1.42.9-17.el7.x86_64 libgcc-4.8.5-39.el7.x86_64 libstdc++-4.8.5-39.el7.x86_64 libuuid-2.23.2-63.el7.x86_64 libxml2-2.9.1-6.el7.4.x86_64 nss-softokn-freebl-3.44.0-8.el7_7.x86_64
(gdb) where
#0 0x000000000048c08a in copyRequest::base::makeSymLink(inputHandler::base*, outputHandler::base*) () at /opt/rh/devtoolset-9/root/usr/include/c++/9/bits/basic_string.h:3901
#1 0x0000000000492666 in copyRequest::base::process(copyRequest::perThreadData&) () at /afs/desy.de/user/h/hannappj/src/ewmscp/src/copyRequest.cpp:1131
#2 0x000000000048c687 in copyRequest::base::processQueue(waitQueues::simple<copyRequest::base>&, waitQueues::simple<copyRequest::base>&, waitQueues::timed<copyRequest::base, std::chrono::_V2::steady_clock>&) () at /afs/desy.de/user/h/hannappj/src/ewmscp/src/copyRequest.cpp:1878
#3 0x000000000052a550 in execute_native_thread_routine ()
#4 0x00007f733c796ea5 in start_thread (arg=0x7f7317fff700) at pthread_create.c:307
#5 0x00007f733a5e88dd in clone () from /lib64/libc.so.6
```https://gitlab.desy.de/ewmscp/ewmscp/-/issues/7sftp output handler causes crash instead of ordered failure probably when no...2020-11-09T12:27:17+01:00Juergen Hannappelsftp output handler causes crash instead of ordered failure probably when not started from home dirJob [#3530](https://gitlab.desy.de/ewmscp/ewmscp/-/jobs/3530) failed for 0e036aafa75baff6bb95357f5f65b31ba132ab93:
#5 0x00007f45e5281993 in __cxxabiv1::__cxa_throw (
obj=obj@entry=0x7f45a0001fd0,
tinfo=0x55d830 <_ZTISt13runtime...Job [#3530](https://gitlab.desy.de/ewmscp/ewmscp/-/jobs/3530) failed for 0e036aafa75baff6bb95357f5f65b31ba132ab93:
#5 0x00007f45e5281993 in __cxxabiv1::__cxa_throw (
obj=obj@entry=0x7f45a0001fd0,
tinfo=0x55d830 <_ZTISt13runtime_error@@GLIBCXX_3.4>,
dest=0x453320 <_ZNSt13runtime_errorD1Ev@plt>)
at ../../../../libstdc++-v3/libsupc++/eh_throw.cc:87
#6 0x00000000004600f6 in goodval<int, int, char [18], options::single<std::basic_string<char, std::char_traits<char>, std::allocator<char> > > > (
handler=..., goodvalue=0, call=<optimized out>)
at /opt/rh/devtoolset-9/root/usr/include/c++/9/ext/new_allocator.h:89
#7 libsshCommon::openSessions (this=0x7f45a0000b48)
at /home/gitlab-runner/builds/fnsAm8xV/1/ewmscp/ewmscp/src/libsshCommon.cpp:56
#8 0x00000000004da195 in libsshCommon::reconnectSessions() ()
at /home/gitlab-runner/builds/fnsAm8xV/1/ewmscp/ewmscp/src/libsshCommon.cpp:107
#9 0x00000000004d95b8 in goodval<int, int, char [18], options::single<std::basic_string<char, std::char_traits<char>, std::allocator<char> > > > (
handler=..., goodvalue=0, call=<optimized out>)
at /opt/rh/devtoolset-9/root/usr/include/c++/9/bits/basic_string.h:6416
#10 libsshCommon::openSessions() ()
at /home/gitlab-runner/builds/fnsAm8xV/1/ewmscp/ewmscp/src/libsshCommon.cpp:56
#11 0x00000000004e0a6e in libssh (this=0x7f45a0000b40,
__in_chrg=<optimized out>, __vtt_parm=<optimized out>)
at /home/gitlab-runner/builds/fnsAm8xV/1/ewmscp/ewmscp/src/pathHandler.h:6
#12 outputHandler::base::factoryTemplate<outputHandler::libssh>::create (
this=<optimized out>)
at /home/gitlab-runner/builds/fnsAm8xV/1/ewmscp/ewmscp/src/outputHandlerLibssh.cpp:20
#13 0x00000000004878b1 in newHandler (name=...)
at /home/gitlab-runner/builds/fnsAm8xV/1/ewmscp/ewmscp/src/outputHandler.h:83
#14 copyRequest::perThreadData::perThreadData() ()
at /home/gitlab-runner/builds/fnsAm8xV/1/ewmscp/ewmscp/src/copyRequest.cpp:172
#15 0x0000000000489eca in copyRequest::base::processQueue(waitQueues::simple<copyRequest::base>&, waitQueues::simple<copyRequest::base>&, waitQueues::timed<copyRequest::base, std::chrono::_V2::steady_clock>&) ()
at /home/gitlab-runner/builds/fnsAm8xV/1/ewmscp/ewmscp/src/copyRequest.cpp:1831https://gitlab.desy.de/ewmscp/ewmscp/-/issues/6crashes if very many files in watched dir are removed in very short time2020-11-09T12:27:18+01:00Juergen Hannappelcrashes if very many files in watched dir are removed in very short timeSee e.g. https://rt-system.desy.de/Ticket/Display.html?id=1006023See e.g. https://rt-system.desy.de/Ticket/Display.html?id=1006023https://gitlab.desy.de/ewmscp/ewmscp/-/issues/5gpfs attr copy now tries to copy acls twice2020-11-12T16:56:55+01:00Juergen Hannappelgpfs attr copy now tries to copy acls twiceJob [#2967](https://gitlab.desy.de/ewmscp/ewmscp/-/jobs/2967) failed for 09c3098da5ab288639e3969e90666256a20a34ae:
/gpfs/test1/gitlab/testdst.3yIug5/test.file set attr at close can't set xattr 'system.gpfs_nfs4_acl' to 'k' on /gpfs/test...Job [#2967](https://gitlab.desy.de/ewmscp/ewmscp/-/jobs/2967) failed for 09c3098da5ab288639e3969e90666256a20a34ae:
/gpfs/test1/gitlab/testdst.3yIug5/test.file set attr at close can't set xattr 'system.gpfs_nfs4_acl' to 'k' on /gpfs/test1/gitlab/testdst.3yIug5/test.file: Invalid argumenhttps://gitlab.desy.de/ewmscp/ewmscp/-/issues/3dCap output handler crashes with invalid free()2020-11-12T16:56:55+01:00Juergen HannappeldCap output handler crashes with invalid free()Job [#2794](https://gitlab.desy.de/ewmscp/ewmscp/-/jobs/2794) failed for 28f1ec88b6397428218342ef3400382c2cad6c35:
```
+ ewmscp --printErrorLocation --outputHandler dcap -v --backupMode during --backupSuffix .back /tmp/testsrc.eYYbov/a d...Job [#2794](https://gitlab.desy.de/ewmscp/ewmscp/-/jobs/2794) failed for 28f1ec88b6397428218342ef3400382c2cad6c35:
```
+ ewmscp --printErrorLocation --outputHandler dcap -v --backupMode during --backupSuffix .back /tmp/testsrc.eYYbov/a dcap://dcache-dot3.desy.de/pnfs/desy.de/dot/data_volatile/ewmsc-gitlab/testdst.Z126p0
/home/gitlab-runner/builds/fnsAm8xV/7/ewmscp/ewmscp/src/outputHandlerDcap.cpp:29: in dcap(): -- dcap output handler setting setAttributesAfterClose automatically
*** Error in `ewmscp': free(): invalid pointer: 0x0000000000f75808 ***
======= Backtrace: =========
/lib64/libc.so.6(+0x81299)[0x7fcc7d114299]
/lib64/libdcap.so.1(node_destroy+0x6d)[0x7fcc7ea5737d]
/lib64/libdcap.so.1(dc_rename+0x85)[0x7fcc7ea543c5]
ewmscp(_ZN13outputHandler4dcap12renameSimpleERKSsS2_+0x6e)[0x4eb4ae]
ewmscp(_ZN11copyRequest4base7processERNS_13perThreadDataE+0x931)[0x48ef61]
ewmscp(main+0x1777)[0x46e4a7]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7fcc7d0b5555]
ewmscp[0x475485]
```https://gitlab.desy.de/ewmscp/ewmscp/-/issues/2dCap output handler fails with permission denied when updating mode atribues2020-11-12T16:56:55+01:00Juergen HannappeldCap output handler fails with permission denied when updating mode atribuesJob [#2794](https://gitlab.desy.de/ewmscp/ewmscp/-/jobs/2794) failed for 28f1ec88b6397428218342ef3400382c2cad6c35:Job [#2794](https://gitlab.desy.de/ewmscp/ewmscp/-/jobs/2794) failed for 28f1ec88b6397428218342ef3400382c2cad6c35:https://gitlab.desy.de/ewmscp/ewmscp/-/issues/1Job Failed #24112020-11-12T16:56:55+01:00Juergen HannappelJob Failed #2411Job [#2411](https://gitlab.desy.de/ewmscp/ewmscp/-/jobs/2411) failed for c50e678c0811333991c2f7290644169b867eb459:
link rewriter fails when file system types of source and destination differJob [#2411](https://gitlab.desy.de/ewmscp/ewmscp/-/jobs/2411) failed for c50e678c0811333991c2f7290644169b867eb459:
link rewriter fails when file system types of source and destination differ