* Added wide cam vipc client and bigmodel transform logic
* Added wide_frame to ModelState, should still work normally
* Refactored image input into addImage method, should still work normally
* Updated thneed/compile.cc
* Bigmodel, untested: 44f83118-b375-4d4c-ae12-2017124f0cf4/200
* Have to initialize extra buffer in SNPEModel
* Default paramater value in the wrong place I think
* Move USE_EXTRA to SConscript
* New model: 6c34d59a-acc3-4877-84bd-904c10745ba6/250
* move use extra check to runtime, not on C2
* this is always true
* more C2 checks
* log if frames are out of sync
* more logging on no frame
* store in pointer
* print sof
* add sync logic
* log based on sof difference as well
* keep both models
* less assumptions
* define above thneed
* typo
* simplify
* no need for second client is main is already wide
* more comments update
* no optional reference
* more logging to debug lags
* add to release files
* both defines
* New model: 6831a77f-2574-4bfb-8077-79b0972a2771/950
* Path offset no longer relevant
* Remove duplicate execute
* Moved bigmodel back to big_supercombo.dlc
* add wide vipc stream
* Tici must be tici
* Needs state too
* add wide cam support to model replay
* handle syncing better
* ugh, c2
* print that
* handle ecam lag
* skip first one
* so close
* update refs
Co-authored-by: mitchellgoffpc <mitchellgoffpc@gmail.com>
Co-authored-by: Harald Schafer <harald.the.engineer@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
* model output struct for metadata
* better max element search
* ModelDataRawDesireProb.to_array()
* eliminate some copies
* not worth messing with softmax now
* remove unused includes
* more cleanup
* no longer pointers
* better variable name
* fix recurrent state
* improve variable name
* fix OUTPUT_SIZE and NET_OUTPUT_SIZE
* lane lines and road edges
* roll back some changes to find what broke things
* rollback more changes to find issue
* fix order of lane line probs
* try outputs on stack again
* initialize output array
* model pose more struct
* constexpr seems useful
* more concise
* fix order
* seems more readable
* plan struct
* attempt to fix compiling on device
* fix constexpr errors on device
* fix rotation rate in log
* maybe this fixes compiling constexpr on device
* exp() cannot be used in constexpr on c2
* only copy what we actually log
* simplify pivot()
* fix setting position std
* see if this works
* try lambda again
* giving up on the lambda to select member
* fix position std
* fix param order
* 6be443f2-ed70-4580-9c31-61b94d068e24/950
* meta changed too
* new ref
* new ref from CI
* unused
* Revert "new ref from CI"
This reverts commit 28b6bdc810.
* new ref from CI again
* completely untested
* it builds now
* bug fixes, save 1ms
* using a kernel to copy works
* more sane API to loadyuv
Co-authored-by: Comma Device <device@comma.ai>
* use the actual file name
* use macro
* fix typo
* continue
* Apply suggestions from code review
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* New model: b822ee32-917c-4639-99f8-25be3e6aabad/900
* Enable keeps
* use new packet
* Send keep pulses once per second
* Updated model_replay_ref_commit
* New model: 0f160bf9-1bce-43e6-9785-564b2453eeac
* Bump model_replay_ref_commit
* Bump submodules
* New model: fd904bf9-5dd8-4619-8997-c5668400e078/550
* New model: fd904bf9-5dd8-4619-8997-c5668400e078/950
* No keeps
* Bumped model replay ref
Co-authored-by: Harald Schafer <harald.the.engineer@gmail.com>
* New model: b822ee32-917c-4639-99f8-25be3e6aabad/900
* Enable keeps
* use new packet
* Send keep pulses once per second
* Updated model_replay_ref_commit
* New model: 0f160bf9-1bce-43e6-9785-564b2453eeac
* Bump model_replay_ref_commit
Co-authored-by: mitchell <mitchellgoffpc@gmail.com>
* use cstring instead of string.h
* use cstdio instead of stdio.h
* remove inttypes.h
* use cstdlib instead of stdlib.h
* use cstdint instead of stdint.h
* #include <cstddef>
* cstdlib
* use cmath
* remove stddef.h
* use cassert
* use csignal
* use ctime
* use cerror
* rebase master
* New model: 51a237cd-9c43-4281-9072-802325e6744d/950
* Added new meta outputs and proper interp for plan_t_arr
* Added meta-based trigger for FCW
* No nans in planner, separate alert for model FCW
* Cleaned up plan_t interp logic
* Added empty cameraError alert to fix unit tests
* Use the normal FCW event
* Updated filter logic
* Updated model replay ref
* Moved disengage predictions into their own cereal struct
* Updated model replay ref for new cereal structs
* Apparently this breaks stuff?
* Bumped cereal commit and model replay ref
* no heading cost
* live mpc weight config
* need to add stds
* make work on empty data
* no divide by 0
* update refs
* update model replay
* update proc replat
* new model replay ref
* start thneed load/save
* compiling
* fix loading
* build thneed model in scons
* don't hardcode /data/openpilot
* release files
* those too
* support for loading/saving binary kernels
* save binaries out of json band
* make binary a command line flag to the compiler
* need include assert
* fix shadowed common in SConscript
* cleanup run.h
* hmm, the recurrent buffer wasn't 0ed
* ugh, unique ptr
* remove power constraint, refactor record
* Revert "remove power constraint, refactor record"
This reverts commit bb6fa52db6df59cd9d6420a6f630430e35af8a5e.
* print on thneed stop
* fingers crossed for this one
* recorded
* just curious
* okay okay, pass tests?
* cleanups
* refactor wait
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* remove publisher
* move to V2
* radard new model
* fix plant
* change packety
* need hack here too
* change to new
* this has been wrong all along
* no more model msg
* subscribe to new model
* not needed anymore
* make work
* need to ignore that too
* should pass tests, needs car test
* fix process replay
* no more poly
* update refs
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* start again
* need that too
* this actually works
* not needed
* do properly
* still works
* still works
* still good
* all G without ll
* still works
* all still good
* cleanup building
* cleanup sconscript
* new lane planner
* how on earth is this silent too....
* update
* add rotation radius
* update
* pathplanner first pass
* misc fixes
* fix
* need deep_interp
* local again
* fix
* fix test
* very old
* new replay
* interp properly
* correct length
* another horrible silent bug
* like master
* fix that
* do doubles
* different delay compensation
* make robust to empty msg
* make pass with hack for now
* add some extra
* update ref for increased leg
* test cpu usage on this pr
* tiny bit faster
* purge numpy
* update ref
* not needed
* ready for merge
* try again after recompile
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* correct, I think
* add model execution time
* remove unused
* token is a file
* this is gonna change
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* correct indexes
* best metrics yet 30231f46-08af-477e-9d30-776593913c24/700
* sometimes x decreases
* update model refs
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* refactor draw model
* rebase master
* correct valid_len
* rename function
* rename variables
* white space
* rebase to master
* e16c13ac-927d-455e-ae0a-81b482a2c787
* start rewriting
* save proress
* compiles!
* oops
* many fixes
* seems to work
* fix desires
* finally cleaned
* wrong std for ll
* dont pulse none
* compiles!
* ready to test
* WIP does not compile
* compiles
* various fixes
* does something!
* full 3d
* not needed
* draw up to 100m
* fix segfault
* wrong sign
* fix flicker
* add road edges
* finish v2 packet
* Added pytorch supercombo
* fix rebase
* no more keras
* Hacky solution to the NCHW/NHWC incompatibility between SNPE and our frame data
* dont break dmonitoringd, final model 229e3ce1-7259-412b-85e6-cc646d70f1d8/430
* fix hack
* Revert "fix hack"
This reverts commit 5550fc01a7881d065a5eddbbb42dac55ef7ec36c.
* Removed axis permutation hack
* Folded padding layers into conv layers
* Removed the last pad layer from the dlc
* Revert "Removed the last pad layer from the dlc"
This reverts commit b85f24b9e1d04abf64e85901a7ff49e00d82020a.
* Revert "Folded padding layers into conv layers"
This reverts commit b8d1773e4e76dea481acebbfad6a6235fbb58463.
* vision model: 5034ac8b-5703-4a49-948b-11c064d10880/780 temporal model: 229e3ce1-7259-412b-85e6-cc646d70f1d8/430 with permute + pool opt
* fix ui drawing with clips
* ./compile_torch.py 5034ac8b-5703-4a49-948b-11c064d10880/780 dfcd2375-81d8-49df-95bf-1d2d6ad86010/450 with variable history length
* std::clamp
* not sure how this compiled before
* 2895ace6-a296-47ac-86e6-17ea800a74e5/550
* db090195-8810-42de-ab38-bb835d775d87/601
* 5m is very little
* onnx runner
* add onnxruntime to pipfile
* run in real time without using the whole CPU
* bump cereal;
* add stds
* set road edge opacity based on stddev
* don't access the model packet in paint
* convert mat.h to a c++ header file (#2499)
* update tests
* safety first
Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: mitchell <mitchell@comma.ai>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: George Hotz <george@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Yassine Yousfi