README.md 2.26 KB
Newer Older
Juergen Hannappel's avatar
Juergen Hannappel committed
1
# ewmscp ![ewms](/projects/LSDMA/repos/ewmscp/browse/src/ewms.svg)
2

3
4
5
6
A collection of tools for event triggered copying and related tasks.
For the individual commands a detailed description is found in the Modules section of the doxygen documentation.

## ewmscp
7
8
9
10
11
12
13
14
This is a tool that has some of the functionality of cp and adds some extra features
that normally require extra tools like chown, md5sum or setting extended atributes:
hence the name e(ierlegende)w(oll)m(ilch)s(sau)cp
ewmscp can run serveral copy processes at once and also run read,write and md5sum in
parallel, but that only helps on really fast filesystems like gpfs, on a standard pc
the IO is the limiting factor to such an extent that the scheduling cost for the multiple
threads outweighs any gains.

15
## inotify_watch
16
17
18
19

This is a tool that watches a set of directories for files closed after write,
moves or removals and produces output that can be piped to ewmscp, so that
an almost live copy can be made.
20
21


22
## truncate_file
Juergen Hannappel's avatar
Juergen Hannappel committed
23

Juergen Hannappel's avatar
typo    
Juergen Hannappel committed
24
This is a tool similar to the standard truncate(1), but without creating
Juergen Hannappel's avatar
Juergen Hannappel committed
25
26
a file closed after write inotify event. Also an extended attribute can
be set on the truncated files. It is meant to be used with the
Juergen Hannappel's avatar
typo    
Juergen Hannappel committed
27
inotify_watch/ewmscp combo so that on the source dir space may be freed without
Juergen Hannappel's avatar
Juergen Hannappel committed
28
29
erasing the files on the target side

30

31
## fileOpsTests
Juergen Hannappel's avatar
Juergen Hannappel committed
32

33
34
This is a simple tool to test basic file operations.
It can so various actions, see fileOpsTests --help.
Juergen Hannappel's avatar
Juergen Hannappel committed
35

36
## sparseMap
Juergen Hannappel's avatar
Juergen Hannappel committed
37

38
This is a tool to map data and hole regions in sparse files.
Juergen Hannappel's avatar
Juergen Hannappel committed
39

40
## adler32
Juergen Hannappel's avatar
Juergen Hannappel committed
41
42
43
44

This tool behaves similar to the usual md5sum, shaXXXsum tools and calculates or checks
checksums. It's implemented as a shebang-wrapper around ewmscp.

Juergen Hannappel's avatar
Juergen Hannappel committed
45

46
47
48
49
50
51
## fixGpfsAcls

This tool (obviously only available with gpfs support) sets the ACLs of the files and directories
 given on it's command line to the ACL they would have inherited from their parent.
It works recursively on directories.

Juergen Hannappel's avatar
Juergen Hannappel committed
52

53
## Site specific config
Juergen Hannappel's avatar
Juergen Hannappel committed
54
55
56
57
The main CMakeLists.txt looks for a sub-directory "site" and includes that if present.
This feature is meant to hav site specific scripts and config files.
Also some of the test scripts in the tests directory include site specific config from the site
directory, if present.
58

Juergen Hannappel's avatar
Juergen Hannappel committed
59

60
The most comprehensive documentation can be found on https://ewmscp.pages.desy.de/ewmscp/