Skip to content

Add script to test performance

Tim Schoof requested to merge add_stress_test_script into develop

This is an initial draft for a script that can stress test an ASAPO instance with many parallel requests. Currently only works if there are no errors, needs better error handling and reporting.

The script starts many independent processes that execute a configurable number of send and get_next requests, respectively. The number of parallel requests is determined by the following settings:

  • --data_sources: Number of data_sources that are used in parallel to simulate multiple detectors and/or a longer pipeline
  • --concurrent_streams: Number of streams that are used in parallel to simulate simultaneous online and offline analysis
  • --consumer_groups: Number of consumer groups that are used in parallel to simulate forking pipelines
  • --producers: Number of producers per data_source and concurrent stream
  • --consumers: Number of consumers per data_source, concurrent stream, and group_id

The number of messages sent and received is determined by the following settings:

  • --streams: Number of streams that will be created per data_source, must be a multiple of --concurrent_streams
  • --messages: Number of messages per stream

The rest of the option are for configuration of the producers and consumers that will be created in each process.

Merge request reports

Loading