nopenpilot/selfdrive/loggerd
Willem Melching 77b334a698
swaglog.py: respect LOGPRINT env variable (#22950)
* swaglog.py: respect LOGPRINT env variable

* only change handler that prints

* keep usefull manager prints

* only print running list

* revert process changes

* fix test
2021-11-18 16:05:06 +01:00
..
include logcatd, loggerd, mapd, modeld, proclogd 2020-01-17 11:20:17 -08:00
tests swaglog.py: respect LOGPRINT env variable (#22950) 2021-11-18 16:05:06 +01:00
tools Uploader speedup (#2214) 2020-09-22 11:37:24 +02:00
.gitignore LoggerState: test cases (#21855) 2021-08-30 17:12:09 -07:00
README.md small typo 2021-09-24 10:23:41 +02:00
SConscript replay: improve segment download and merge (#22654) 2021-11-01 11:55:56 +01:00
__init__.py logcatd, loggerd, mapd, modeld, proclogd 2020-01-17 11:20:17 -08:00
bootlog.cc Put journal and nvme stats in bootlog (#22849) 2021-11-10 16:07:22 +01:00
config.py use same env variable for loggerd, deleter, and uploader 2021-08-07 18:58:11 -07:00
deleter.py deleter.py: delete boot and crash folders last (#21028) 2021-06-01 14:08:08 -07:00
encoder.h loggerd: remove the segment variable from encoders (#20034) 2021-02-07 17:48:46 -08:00
logger.cc util: add new function create_directories with unit tests (#21871) 2021-10-29 12:27:35 +02:00
logger.h util: add safe write functions (#22160) 2021-10-29 13:23:31 +02:00
loggerd.cc loggerd: trigger rotate on frame id instead of frame count (#22848) 2021-11-13 15:38:10 -08:00
omx_encoder.cc wshadow: fix comma three build 2021-11-02 17:27:34 +01:00
omx_encoder.h loggerd: always run encoders (#22649) 2021-10-21 16:37:03 -07:00
raw_logger.cc loggerd/RawLogger: fix memory leak in encode_frame (#22826) 2021-11-08 15:27:51 -08:00
raw_logger.h loggerd: always run encoders (#22649) 2021-10-21 16:37:03 -07:00
uploader.py Upload when on ethernet (#22188) 2021-09-10 12:05:12 -07:00
xattr_cache.py Uploader speedup (#2214) 2020-09-22 11:37:24 +02:00

README.md

loggerd

openpilot records routes in one minute chunks called segments. A route starts on the rising edge of ignition and ends on the falling edge.

Check out our python library for reading openpilot logs. Also checkout our tools to replay and view your data. These are the same tools we use to debug and develop openpilot.

log types

For each segment, openpilot records the following log types:

rlog.bz2

rlogs contain all the messages passed amongst openpilot's processes. See cereal/services.py for a list of all the logged services. They're a bzip2 archive of the serialized capnproto messages.

{f,e,d}camera.hevc

Each camera stream is H.265 encoded and written to its respective file.

  • fcamera.hevc is the road camera
  • ecamera.hevc is the wide road camera
  • dcamera.hevc is the driver camera

qlog.bz2 & qcamera.ts

qlogs are a decimated subset of the rlogs. Check out cereal/services.py for the decimation.

qcameras are H.264 encoded, lower res versions of the fcamera.hevc. The video shown in comma connect is from the qcameras.

qlogs and qcameras are designed to be small enough to upload instantly on slow internet and store forever, yet useful enough for most analysis and debugging.