- Aug 15, 2024
-
-
Marc-Olivier Andrez authored
The Docker image `gitlab.desy.de:5555/asapo/asapo/asapo-packages-manylinux-build-env` is based on the Docker container `quay.io/pypa/manylinux2014_x86_64` but it was not possible to know which exact version it was relying on (`asapo-packages-manylinux-build-env` was using the latest version of `quay.io/pypa/manylinux2014_x86_64` at the time of the build). This commit specifies the version of `quay.io/pypa/manylinux2014_x86_64` to use when building `asapo-packages-manylinux-build-env`. In addition, running the CI pipeline with this commit will regenerate the Docker image of `asapo-packages-manylinux-build-env` that will be based on a newer version of `quay.io/pypa/manylinux2014_x86_64`. The old version contained links to obsolete `yum` repositories and executing `yum update -y` was failing: ``` $ yum update -y Loaded plugins: fastestmirror, ovl Determining fastest mirrors Could not retrieve mirrorlist http://mirrorlist.centos.org/?release=7&arch=x86_64&repo=os&infra=container error was 14: curl#6 - "Could not resolve host: mirrorlist.centos.org; Unknown error" Could not retrieve mirrorlist http://mirrorlist.centos.org?arch=x86_64&release=7&repo=sclo-rh error was 14: curl#6 - "Could not resolve host: mirrorlist.centos.org; Unknown error" epel/x86_64/metalink | 5.1 kB 00:00:00 Could not retrieve mirrorlist http://mirrorlist.centos.org/?release=7&arch=x86_64&repo=extras&infra=container error was 14: curl#6 - "Could not resolve host: mirrorlist.centos.org; Unknown error" Could not retrieve mirrorlist http://mirrorlist.centos.org/?release=7&arch=x86_64&repo=updates&infra=container error was 14: curl#6 - "Could not resolve host: mirrorlist.centos.org; Unknown error" * base: mirror.speedkom.de * centos-sclo-rh: mirror.rackspeed.de * epel: ftp-stud.hs-esslingen.de * extras: mirror.rackspeed.de * updates: mirror.init7.net http://artfiles.org/centos.org/7.9.2009/os/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found Trying other mirror. To address this issue please refer to the below wiki article https://wiki.centos.org/yum-errors If above article doesn't help to resolve this issue please use https://bugs.centos.org/. base | 3.6 kB 00:00:00 centos-sclo-rh | 3.0 kB 00:00:00 epel | 4.3 kB 00:00:00 extras | 2.9 kB 00:00:00 http://centos.mirror.transip.nl/7.9.2009/updates/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found Trying other mirror. http://mirror.init7.net/centos/7.9.2009/updates/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found Trying other mirror. http://centosmirror.netcup.net/centos/7.9.2009/updates/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found Trying other mirror. http://mirror.vimexx.nl/centos/7.9.2009/updates/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found Trying other mirror. http://ftp.rz.uni-frankfurt.de/pub/mirrors/centos/7.9.2009/updates/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found Trying other mirror. http://centos.anexia.at/centos/7.9.2009/updates/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found Trying other mirror. http://mirrors.centos.behostings.net/centos/7.9.2009/updates/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found Trying other mirror. http://mirror.previder.nl/centos/7.9.2009/updates/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found Trying other mirror. http://ftp.rezopole.net/centos/7.9.2009/updates/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found Trying other mirror. (1/2): epel/x86_64/updateinfo | 1.0 MB 00:00:00 (2/2): epel/x86_64/primary_db | 8.7 MB 00:00:03 Resolving Dependencies --> Running transaction check ---> Package bind-license.noarch 32:9.11.4-26.P2.el7_9.15 will be updated ---> Package bind-license.noarch 32:9.11.4-26.P2.el7_9.16 will be an update --> Finished Dependency Resolution Dependencies Resolved ========================================================================================================================================================================================================================= Package Arch Version Repository Size ========================================================================================================================================================================================================================= Updating: bind-license noarch 32:9.11.4-26.P2.el7_9.16 updates 92 k Transaction Summary ========================================================================================================================================================================================================================= Upgrade 1 Package Total download size: 92 k Downloading packages: Delta RPMs disabled because /usr/bin/applydeltarpm not installed. bind-license-9.11.4-26.P2.el7_ FAILED http://centos.mirror.transip.nl/7.9.2009/updates/x86_64/Packages/bind-license-9.11.4-26.P2.el7_9.16.noarch.rpm: [Errno 14] HTTP Error 404 - Not Found ] 0.0 B/s | 0 B --:--:-- ETA Trying other mirror. bind-license-9.11.4-26.P2.el7_ FAILED http://mirror.init7.net/centos/7.9.2009/updates/x86_64/Packages/bind-license-9.11.4-26.P2.el7_9.16.noarch.rpm: [Errno 14] HTTP Error 404 - Not Found ] 0.0 B/s | 0 B --:--:-- ETA Trying other mirror. bind-license-9.11.4-26.P2.el7_ FAILED http://centosmirror.netcup.net/centos/7.9.2009/updates/x86_64/Packages/bind-license-9.11.4-26.P2.el7_9.16.noarch.rpm: [Errno 14] HTTP Error 404 - Not Found ] 0.0 B/s | 0 B --:--:-- ETA Trying other mirror. bind-license-9.11.4-26.P2.el7_ FAILED http://mirror.vimexx.nl/centos/7.9.2009/updates/x86_64/Packages/bind-license-9.11.4-26.P2.el7_9.16.noarch.rpm: [Errno 14] HTTP Error 404 - Not Found ] 0.0 B/s | 0 B --:--:-- ETA Trying other mirror. bind-license-9.11.4-26.P2.el7_ FAILED http://ftp.rz.uni-frankfurt.de/pub/mirrors/centos/7.9.2009/updates/x86_64/Packages/bind-license-9.11.4-26.P2.el7_9.16.noarch.rpm: [Errno 14] HTTP Error 404 - Not Found ] 0.0 B/s | 0 B --:--:-- ETA Trying other mirror. bind-license-9.11.4-26.P2.el7_ FAILED http://centos.anexia.at/centos/7.9.2009/updates/x86_64/Packages/bind-license-9.11.4-26.P2.el7_9.16.noarch.rpm: [Errno 14] HTTP Error 404 - Not Found ] 0.0 B/s | 0 B --:--:-- ETA Trying other mirror. bind-license-9.11.4-26.P2.el7_ FAILED http://mirrors.centos.behostings.net/centos/7.9.2009/updates/x86_64/Packages/bind-license-9.11.4-26.P2.el7_9.16.noarch.rpm: [Errno 14] HTTP Error 404 - Not Found ] 0.0 B/s | 0 B --:--:-- ETA Trying other mirror. bind-license-9.11.4-26.P2.el7_ FAILED http://mirror.previder.nl/centos/7.9.2009/updates/x86_64/Packages/bind-license-9.11.4-26.P2.el7_9.16.noarch.rpm: [Errno 14] HTTP Error 404 - Not Found ] 0.0 B/s | 0 B --:--:-- ETA Trying other mirror. bind-license-9.11.4-26.P2.el7_ FAILED http://ftp.rezopole.net/centos/7.9.2009/updates/x86_64/Packages/bind-license-9.11.4-26.P2.el7_9.16.noarch.rpm: [Errno 14] HTTP Error 404 - Not Found ] 0.0 B/s | 0 B --:--:-- ETA Trying other mirror. Error downloading packages: 32:bind-license-9.11.4-26.P2.el7_9.16.noarch: [Errno 256] No more mirrors to try. ``` Fixing the links to the obsolete `yum` repositories was a pain (from `mirror` to `vault`), and it was much easier to use a base Docker image where these problems are already fixed.
-
- Aug 14, 2024
-
-
Mikhail Karnevskiy authored
Fix wrong input See merge request !267
-
Mikhail Karnevskiy authored
-
- Aug 13, 2024
-
-
Mikhail Karnevskiy authored
Fix callback See merge request !265
-
Mikhail Karnevskiy authored
-
- Aug 08, 2024
-
-
Mikhail Karnevskiy authored
Add implementation of processing duplicated ID and duplicated file cases. See merge request !257
-
Mikhail Karnevskiy authored
-
- Aug 01, 2024
-
-
Mikhail Karnevskiy authored
Fallback receiver requests See merge request asapo/asapo!258
-
Mikhail Karnevskiy authored
-
- Jul 17, 2024
-
-
Mikhail Karnevskiy authored
Remove database from receiver See merge request !255
-
Mikhail Karnevskiy authored
-
- Jul 16, 2024
-
-
Mikhail Karnevskiy authored
Add substream to broker requests See merge request !254
-
Mikhail Karnevskiy authored
-
- Jul 05, 2024
-
-
Mikhail Karnevskiy authored
make extra params interface instead of stream See merge request !251
-
Mikhail Karnevskiy authored
-
- Jul 04, 2024
-
-
Marc-Olivier Andrez authored
ci: generate single code coverage report for C++ code See merge request !242
-
Marc-Olivier Andrez authored
As mentioned on https://gcc.gnu.org/onlinedocs/gcc-4.9.4/gcc/Debugging-Options.html#Debugging-Options, the option `--coverage` "is a synonym for -fprofile-arcs -ftest-coverage (when compiling) and -lgcov (when linking)".
-
Marc-Olivier Andrez authored
This commit replaces all the `coverage*` CTest C++ tests with a single CMake target that generates a single report for all the C++ tests instead of one report for each `coverage*` CTest C++ test. In addition, the CMake target uses [fastcov](https://github.com/RPGillespie6/fastcov) instead of [lcov](https://github.com/linux-test-project/lcov) because `fastcov` is at least an order of magnitude faster than `lcov` at the moment. Note that `fastcov` and `lcov-to-cobertura-xml` were downloaded using the following commands: ```sh $ bash 3d_party/fastcov/download.sh Installing from commit https://github.com/RPGillespie6/fastcov/commit/40dffe81d62c0d897afe4108f3b5489487ff3bce into 3d_party/fastcov - https://raw.githubusercontent.com/RPGillespie6/fastcov/40dffe81d62c0d897afe4108f3b5489487ff3bce/fastcov.py --> fastcov.py - https://raw.githubusercontent.com/RPGillespie6/fastcov/40dffe81d62c0d897afe4108f3b5489487ff3bce/LICENSE --> LICENSE - https://raw.githubusercontent.com/RPGillespie6/fastcov/40dffe81d62c0d897afe4108f3b5489487ff3bce/README.md --> README.md $ bash 3d_party/lcov-to-cobertura-xml/download.sh Installing from commit https://github.com/eriwen/lcov-to-cobertura-xml/commit/18489f195e5389fca3fec53608a5503af759ee44 into 3d_party/lcov-to-cobertura-xml - https://raw.githubusercontent.com/eriwen/lcov-to-cobertura-xml/18489f195e5389fca3fec53608a5503af759ee44/LICENSE --> LICENSE - https://raw.githubusercontent.com/eriwen/lcov-to-cobertura-xml/18489f195e5389fca3fec53608a5503af759ee44/README.md --> README.md - https://raw.githubusercontent.com/eriwen/lcov-to-cobertura-xml/18489f195e5389fca3fec53608a5503af759ee44/lcov_cobertura/lcov_cobertura.py --> lcov_cobertura/lcov_cobertura.py ```
-
Marc-Olivier Andrez authored
ci: extract CI job template to build docker images See merge request !243
-
Marc-Olivier Andrez authored
The following CI jobs are now using the CI job template `.docker-create-build-env` and were moved into `.gitlab-ci.yml`: - deploy/build_env/centos/gitlab-ci-build-docker.yml - docker-create-asapo-packages-centos7-build-env - docker-create-asapo-packages-centos8-build-env - deploy/build_env/debians/gitlab-ci-build-docker.yml - docker-create-asapo-packages-debian9-build-env - docker-create-asapo-packages-debian10-build-env - docker-create-asapo-packages-debian11-build-env - docker-create-asapo-packages-debian12-build-env - gitlab-ci-build-docker.yml - docker-create-asapo-packages-manylinux-build-env - deploy/build_env/services-linux/gitlab-ci-build-docker.yml - docker-create-asapo-services-linux-build-env - deploy/build_env/services-windows/gitlab-ci-build-docker.yml - docker-create-asapo-services-windows-build-env - deploy/build_env/site/gitlab-ci-build-docker.yml - docker-create-asapo-site-build-env - deploy/build_env/ubuntu/gitlab-ci-build-docker.yml - docker-create-asapo-packages-ubuntu1804-build-env - docker-create-asapo-packages-ubuntu2004-build-env - deploy/secondary_services/fluentd_elastic/gitlab-ci-build-docker.yml - docker-create-asapo-secondary-fluentd-elasticsearch **Note**: in the process, the rules of the CI jobs `docker-create-asapo-packages-ubuntu1804-build-env` and `docker-create-asapo-packages-ubuntu2004-build-env` have been modified. These rules were probably incorrect because they were triggering a build of the Docker container when pushing the first version of a branch.
-
- Jul 01, 2024
-
-
Marc-Olivier Andrez authored
Style: remove trailing whitespaces See merge request !246
-
Marc-Olivier Andrez authored
... when running `git blame`
-
Marc-Olivier Andrez authored
- Add the pre-commit hook `trailing-whitespace` to `.pre-commit-config.yaml` - Apply the hook to all files with the command `pre-commit run -a`
-
Mikhail Karnevskiy authored
Add all streams in one collection See merge request !245
-
Mikhail Karnevskiy authored
-
Marc-Olivier Andrez authored
docs: use architectural decision records to justify design decisions See merge request !247
-
- Jun 25, 2024
-
-
Marc-Olivier Andrez authored
See https://adr.github.io/. I used [`adr-tools`](https://github.com/npryce/adr-tools) to create the initial Architecture Decision Record (ADR): ```sh adr init docs/contributing/architecture/decisions ```
-
Marc-Olivier Andrez authored
build: enable building from a directory which is not a subdirectory of the source directory See merge request !248
-
Marc-Olivier Andrez authored
Rationale: building `ASAP::O` from a Docker image on macOS inside a subdirectory of the source directory can be slow because the files inside the subdirectory are visible from macOS and macOS does not seem to handle well when many files changed within a virtual machine. It is therefore faster to compile from a directory that is not mounted on the Docker image, which cannot be a subdirectory of the source directory.
-
- Jun 21, 2024
-
-
Mikhail Karnevskiy authored
Move DB requests to broker See merge request !240
-
Mikhail Karnevskiy authored
-
Mikhail Karnevskiy authored
-
Mikhail Karnevskiy authored
-
- Jun 20, 2024
-
-
Mikhail Karnevskiy authored
-
Mikhail Karnevskiy authored
-
Mikhail Karnevskiy authored
Comment-out seconds attempt to ingest dataset in the first attempt failed because if the duplicate error.
-
Mikhail Karnevskiy authored
-
- Jun 19, 2024
-
-
Mikhail Karnevskiy authored
-
- Jun 18, 2024
-
-
Mikhail Karnevskiy authored
-
Mikhail Karnevskiy authored
-