AsapoWorker merge requestshttps://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests2022-07-07T09:51:13+02:00https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/44Add retrieve_data method to receiver2022-07-07T09:51:13+02:00Tim SchoofAdd retrieve_data method to receiverhttps://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/43Introduce post_scan method for workers2023-06-02T14:52:02+02:00Tim SchoofIntroduce post_scan method for workersA worker can implement a post_scan method to receive stream info and
stream meta at the end of a stream.
As the end of a stream cannot be determined reliably, the post_scan
method can be called multiple times even before the stream actua...A worker can implement a post_scan method to receive stream info and
stream meta at the end of a stream.
As the end of a stream cannot be determined reliably, the post_scan
method can be called multiple times even before the stream actually
ends. It is also not guaranteed that the post_scan method is called
when the stream info or stream meta changes.https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/42Support ASAPO TV2022-07-04T17:15:24+02:00Tim SchoofSupport ASAPO TVThe first commit only exposes the `pipeline_step` as separate options for the receiver and sender.
This is not very user friendly and future commits should ensure that the receiver and sender use the same pipeline_step.The first commit only exposes the `pipeline_step` as separate options for the receiver and sender.
This is not very user friendly and future commits should ensure that the receiver and sender use the same pipeline_step.https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/41Fix StopIteration error on Python >= 3.72022-04-03T20:10:35+02:00Tim SchoofFix StopIteration error on Python >= 3.7The current behavior errors on Python 3.7+ due to a backwards incompatible change: https://peps.python.org/pep-0479/The current behavior errors on Python 3.7+ due to a backwards incompatible change: https://peps.python.org/pep-0479/https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/40Bump version v0.0.42021-12-10T12:22:30+01:00Tim SchoofBump version v0.0.4We should start doing proper versioning and also add a changelog soon, but for now do a simple version bump for the urgent bug fixes.We should start doing proper versioning and also add a changelog soon, but for now do a simple version bump for the urgent bug fixes.https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/39Allow empty prefix in configuration cli parser2021-12-10T11:56:54+01:00Tim SchoofAllow empty prefix in configuration cli parserThis is something I would have found useful while writing tests.This is something I would have found useful while writing tests.https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/38Do not call converters twice2021-12-10T11:42:30+01:00Tim SchoofDo not call converters twiceIf a config option uses a converter, it should not be called during
command line parsing because it is already called during construction by
attr.If a config option uses a converter, it should not be called during
command line parsing because it is already called during construction by
attr.https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/37Fix configuration with values considered as False2021-12-10T11:41:42+01:00Tim SchoofFix configuration with values considered as FalseFor values like 0 that are considered as `False` in if statements, the default value was used instead of the given option.For values like 0 that are considered as `False` in if statements, the default value was used instead of the given option.https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/36Send stream finish flag only once2021-11-22T13:31:52+01:00Mikhail KarnevskiySend stream finish flag only onceSending stream-finish flag multiple time may be not good.Sending stream-finish flag multiple time may be not good.https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/35'liveimage' (live stream, generated by Lambda) in get_image added2021-08-16T11:57:34+02:00Yury Matveev'liveimage' (live stream, generated by Lambda) in get_image addedAsapoworker is compatible with Lambda livestreamAsapoworker is compatible with Lambda livestreamhttps://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/34Add delay in case if StreamFinish flag is obtained2021-08-04T11:31:11+02:00Mikhail KarnevskiyAdd delay in case if StreamFinish flag is obtained@tim.schoof
Even if StreamFinish flag is obtained stream may contain non-acknowledged messages. In this case it make sense to wait for a few seconds until the next call get_next.@tim.schoof
Even if StreamFinish flag is obtained stream may contain non-acknowledged messages. In this case it make sense to wait for a few seconds until the next call get_next.https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/33Fix and speedup2021-07-12T09:46:33+02:00Mikhail KarnevskiyFix and speedup@tim.schoof
Fix a few small points, which may speedup to run across streams.
* Check number of unacknowledged messages before closing stream only if receiver will retry.
* Starting stream first, because it may take time.
* Try to set s...@tim.schoof
Fix a few small points, which may speedup to run across streams.
* Check number of unacknowledged messages before closing stream only if receiver will retry.
* Starting stream first, because it may take time.
* Try to set starting position only if worker have corresponding method
* Set stream before call set_starting_position (this was a bug)https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/32Fix dependency on hdf5plugin2021-07-08T15:12:31+02:00Tim SchoofFix dependency on hdf5pluginThis commit also removes numcodecs from the CI environment.This commit also removes numcodecs from the CI environment.https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/31Resend unacknowledged messages2021-05-19T16:08:35+02:00Mikhail KarnevskiyResend unacknowledged messages@tim.schoof
* Unacknowledged messages are resent for processing.
* If stream-finish flag is received, worker stops only if no un-acknowledged messages left or if asapo does not deliver anything.@tim.schoof
* Unacknowledged messages are resent for processing.
* If stream-finish flag is received, worker stops only if no un-acknowledged messages left or if asapo does not deliver anything.https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/30Feat/acknowledge slim2021-05-17T14:29:35+02:00Mikhail KarnevskiyFeat/acknowledge slim@tim.schoof
* Implementation of acknowledge functionality
* Removing of Serial Worker
* Processing starts from the beginning of earliest stream, which contains unacnowledge messages.@tim.schoof
* Implementation of acknowledge functionality
* Removing of Serial Worker
* Processing starts from the beginning of earliest stream, which contains unacnowledge messages.https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/29Change timeout from s to ms2021-05-17T14:30:58+02:00Mikhail KarnevskiyChange timeout from s to ms@tim.schoof
Asapo producer requires timeout in ms.@tim.schoof
Asapo producer requires timeout in ms.https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/28Fix streams info2021-04-28T18:20:07+02:00Mikhail KarnevskiyFix streams info@tim.schoof
* Get list of streams with parameter start_from='stream_name' does not return info for `stream_name`
* `StreamFinishedError` should be catched before `TemporaryError` because it is derived from it.@tim.schoof
* Get list of streams with parameter start_from='stream_name' does not return info for `stream_name`
* `StreamFinishedError` should be catched before `TemporaryError` because it is derived from it.https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/27Fix: callback and workers without metadata stream2021-04-16T16:42:24+02:00Mikhail KarnevskiyFix: callback and workers without metadata stream- Do not print data itself
- Fix workers without metadata stream- Do not print data itself
- Fix workers without metadata streamhttps://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/26Remove unnecessary numcodecs import2021-04-16T16:30:52+02:00Tim SchoofRemove unnecessary numcodecs import@mikhail.karnevskiy Please verify that this import is unnecessary.@mikhail.karnevskiy Please verify that this import is unnecessary.https://gitlab.desy.de/fs-sc/asapoworker/-/merge_requests/25Fix workers without metadata stream2021-04-16T16:35:14+02:00Tim SchoofFix workers without metadata streamThis is a temporary hack until the different stream naming schemes
become obsolete due to further improvements like acknowledgements.This is a temporary hack until the different stream naming schemes
become obsolete due to further improvements like acknowledgements.