Diagnostic
A development tool designed to
Track the performance of each SMARTS version.
Test the effects of improvements or optimizations made in SMARTS.
Setup
Dump different number of actors, with different types, on a map without visualization and show the mean & standard deviation of steps per second. Available scenarios:
n social agents: 1, 10, 20, 50
n data replay actors: 1, 10, 20, 50, 200
n sumo traffic actors: 1, 10, 20, 50, 200
10 agents to n data replay actors: 1, 10, 20, 50
10 agent to n roads: 1, 10, 20, 50
Run
Run the diagnostic main()
with one or multiple scenarios, from the SMARTS/smarts/diagnostic
folder.
Reports will be generated in the SMARTS/smarts/diagnostic/reports
folder.
$ cd <path/to>/SMARTS
$ python3.8 -m venv ./.venv
$ source ./.venv/bin/activate
$ pip install --upgrade pip
$ pip install -e .[diagnostic]
$ scl diagnostic run <scenarios/path> [scenarios/path]
# e.g., scl diagnostic run n_sumo_actors/1_actors n_agents/1_agents