ASAP::O - High performance distributed streaming platform

The client packages are located here. Use the following token to get them: f3Q1jP6z8wZy85TUsD8R.

Example:

pip install asapo-consumer --index-url https://\_\_token\_\_:f3Q1jP6z8wZy85TUsD8R@gitlab.desy.de/api/v4/projects/2236/packages/pypi/simple

Folder structure

Microservices

• authorizer - authorization (Go)
• broker - server for consumer clients (Go)
• discovery - discovery service (Go)
• file_transfer - file transfer service to deliver files to clients that have no access to storage (Go)
• receiver - server for producer clients to send data to, also contains data server that is contacted by consumer clients to get data from cache (C++)

Client libraries

• producer - producer libraries (C++, C, Python)
• consumer - consumer libraries (C++, C, Python)

Docs & Tests

• docs - doxygen,sphinx and site documentation
• tests - automatic integration/e2e tests
• docs/site/examples - examples used for site
• examples - some outdated examples, also used for automated tests, (todo: move it somewhere)

Auxiliary folders

• common - stuff to be shared between microservices
• CMakeIncludes, CMakeModules, install - CMake stuff
• config - to store various config files, also nomad jobs for tests
• deploy - Docker files for various images, Helm files, Nomad&Consul files

Building

Prepare dependencies

depending on configuration, you might need need curllib, mongoc, google tests

• cd 3d_party/mongo-c-driver

• ./install.sh $(pwd)

• sudo make -C mongo-c-driver-1.17.2 install

• back in the asapo-dir:

• mkdir build

• (cd build; cmake ..)

With documentation

Need Doxygen >= 1.8.10 and sphinx

• mkdir build
• cd build
• cmake -DBUILD_CPP_DOCS=ON _DBUILD_PYTHON_DOCS ..

With tests

Need googletest >= 1.8.0

• mkdir build
• cd build
• cmake -DBUILD_TESTS=ON ..

The software is MIT licensed (see LICENSE.txt) and uses third party libraries that are distributed under their own terms (see LICENSE-3RD-PARTY.txt)

with non-standard 3rd party libraries paths

• cmake -Dlibmongoc-static-1.0_DIR=... -Dlibbson-static-1.0_DIR=... -DLIBCURL_DIR=... ...

compile

• make -j 4

or compile specific target only, e.g.

• make -j 4 receiver