Diagnostic

A development tool designed to

  • Track the performance of each SMARTS version.

  • Test the effects of improvements or optimizations made in SMARTS.

Setup

Dump different number of actors, with different types, on a map without visualization and show the mean & standard deviation of steps per second. Available scenarios:

  • n social agents: 1, 10, 20, 50

  • n data replay actors: 1, 10, 20, 50, 200

  • n sumo traffic actors: 1, 10, 20, 50, 200

  • 10 agents to n data replay actors: 1, 10, 20, 50

  • 10 agent to n roads: 1, 10, 20, 50

Run

Run the diagnostic main() with one or multiple scenarios, from the SMARTS/smarts/diagnostic folder. Reports will be generated in the SMARTS/smarts/diagnostic/reports folder.

$ cd <path/to>/SMARTS
$ python3.8 -m venv ./.venv
$ source ./.venv/bin/activate
$ pip install --upgrade pip
$ pip install -e .[diagnostic]
$ scl diagnostic run <scenarios/path> [scenarios/path]
# e.g., scl diagnostic run n_sumo_actors/1_actors n_agents/1_agents