Add script to test performance
This is an initial draft for a script that can stress test an ASAPO instance with many parallel requests. Currently only works if there are no errors, needs better error handling and reporting.
The script starts many independent processes that execute a configurable number of send
and get_next
requests, respectively. The number of parallel requests is determined by the following settings:
-
--data_sources
: Number ofdata_source
s that are used in parallel to simulate multiple detectors and/or a longer pipeline -
--concurrent_streams
: Number ofstream
s that are used in parallel to simulate simultaneous online and offline analysis -
--consumer_groups
: Number of consumer groups that are used in parallel to simulate forking pipelines -
--producers
: Number of producers perdata_source
and concurrentstream
-
--consumers
: Number of consumers perdata_source
, concurrentstream
, andgroup_id
The number of messages sent and received is determined by the following settings:
-
--streams
: Number ofstream
s that will be created perdata_source
, must be a multiple of--concurrent_streams
-
--messages
: Number of messages perstream
The rest of the option are for configuration of the producers and consumers that will be created in each process.