de4031c98e
* update cereal * run but not use * log distraction type * regression scaling * clean up naming * add calib buf * add to header * fake model * no calib model * adjust threshs * 018a305f * fix bn * tweak1 * tweak2 * 0ff2/666 * tweak3 * t4 * t5 * fix out of bound * skip when replaying old segments * update ref * fix onnxmodel * get calib * update model replay refs * up ref |
||
|---|---|---|
| .. | ||
| .gitignore | ||
| README.md | ||
| __init__.py | ||
| compare_logs.py | ||
| model_replay.py | ||
| model_replay_ref_commit | ||
| process_replay.py | ||
| ref_commit | ||
| regen.py | ||
| regen_all.py | ||
| test_fuzzy.py | ||
| test_processes.py | ||
| update_refs.py | ||
README.md
process replay
Process replay is a regression test designed to identify any changes in the output of a process. This test replays a segment through individual processes and compares the output to a known good replay. Each make is represented in the test with a segment.
If the test fails, make sure that you didn't unintentionally change anything. If there are intentional changes, the reference logs will be updated.
Use test_processes.py to run the test locally.
Currently the following processes are tested:
- controlsd
- radard
- plannerd
- calibrationd
- ubloxd
Forks
openpilot forks can use this test with their own reference logs
To generate new logs:
./update_refs.py --no-upload
Then, check in the new logs using git-lfs. Make sure to also include the updated ref_commit file.