* Fix bigmodel on tici: cam intrinsics arent static
* Give TICI route own name for import
* Make function useable in offline test
* typo
* change tici ecam focal to trained focal
* No shadow variable
* Fixed ref
* Force update this time
* Update model replay ref commit
* Added wide cam vipc client and bigmodel transform logic
* Added wide_frame to ModelState, should still work normally
* Refactored image input into addImage method, should still work normally
* Updated thneed/compile.cc
* Bigmodel, untested: 44f83118-b375-4d4c-ae12-2017124f0cf4/200
* Have to initialize extra buffer in SNPEModel
* Default paramater value in the wrong place I think
* Move USE_EXTRA to SConscript
* New model: 6c34d59a-acc3-4877-84bd-904c10745ba6/250
* move use extra check to runtime, not on C2
* this is always true
* more C2 checks
* log if frames are out of sync
* more logging on no frame
* store in pointer
* print sof
* add sync logic
* log based on sof difference as well
* keep both models
* less assumptions
* define above thneed
* typo
* simplify
* no need for second client is main is already wide
* more comments update
* no optional reference
* more logging to debug lags
* add to release files
* both defines
* New model: 6831a77f-2574-4bfb-8077-79b0972a2771/950
* Path offset no longer relevant
* Remove duplicate execute
* Moved bigmodel back to big_supercombo.dlc
* add wide vipc stream
* Tici must be tici
* Needs state too
* add wide cam support to model replay
* handle syncing better
* ugh, c2
* print that
* handle ecam lag
* skip first one
* so close
* update refs
Co-authored-by: mitchellgoffpc <mitchellgoffpc@gmail.com>
Co-authored-by: Harald Schafer <harald.the.engineer@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
* model output struct for metadata
* better max element search
* ModelDataRawDesireProb.to_array()
* eliminate some copies
* not worth messing with softmax now
* remove unused includes
* more cleanup
* no longer pointers
* better variable name
* fix recurrent state
* improve variable name
* fix OUTPUT_SIZE and NET_OUTPUT_SIZE
* use cstring instead of string.h
* use cstdio instead of stdio.h
* remove inttypes.h
* use cstdlib instead of stdlib.h
* use cstdint instead of stdint.h
* #include <cstddef>
* cstdlib
* use cmath
* remove stddef.h
* use cassert
* use csignal
* use ctime
* use cerror
* rebase master
* add type to class hadwareXXX
* replace ifdefs with hardware layer
* continue
* continue
* new function get_driver_view_transform
* full path to hw.h
* fix build error setup.cc
* apply review
* fix typo
* fix deprecated error:replace deprecated fromPath with new
* fix build error
* use ecam in ui
* needs reboot
* use in modeld
* typo
* effective FL is longer in center
* normalize zoom by focal dist
* read param before init
* make 2x as wide
* review comments
* more explicit
* fix camera offset
Co-authored-by: ZwX1616 <zwx1616@gmail.com>
* new class FirstOrderFilter
* flick face icon
* revert ui_draw_vision_face
* new function reset()
* reset after update
* use filter to update brightness
* reconnect vipc_client after disconnection
* run models in run_model()
* cleanup
* use std::Mutex
* use std::thread
* const
* comments
* cleanup include
* rename live_thread to calibration_thread
* add comment
* remove publisher
* move to V2
* radard new model
* fix plant
* change packety
* need hack here too
* change to new
* this has been wrong all along
* no more model msg
* subscribe to new model
* not needed anymore
* make work
* need to ignore that too
* should pass tests, needs car test
* fix process replay
* no more poly
* update refs
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* Squashed vipc
* Update release files
* Remove else
* add visionipc to release files
* use poller in vipc receive
* opencl framework instead of lib on macos
* Fix camera webcam
* Fix opencl on mac in ui
* more webcam fixes
* typo in ui sconsfile
* Use cur_yuv_buf
* visionbuf c++ class
* Camera qcom was still using visionbuf_allocate
* Turn loggerd back on
* fix snapshot
* No build needed
* update test camerad
* no more release callback
* make encoder c++
* Revert "no more release callback"
This reverts commit e5707b07002fee665d0483d90713154efc2d70d4.
* fix exit handlers
* No need to check errno
* move release callback call
* s/VIPCBufExtra/VisionIpcBufExtra/g
* use non blocking connect
* ui use non blocking connect
* Lower condition variable wait time
* Snapshot cleanup
* bump cereal
* bump cereal
* common signal handle
* fix typo
* rename to ExitHandler
* remove include signal.h
* remove include csignal
* rename variable exit to v
* rebase master
* Added model_replay and fixed some bugs in camera_replay
* Unpack capnp logs on device
* add sync to device
* GPU now also works on PC
* update model ref
* update refs
* dont change this one
* Use pipeline calib instead of rlog calib
* remove that
* update refs
Co-authored-by: Willem Melching <willem.melching@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* new settings for governors, +30% memory bandwidth
* CPU waste is better
* warm up frame_drop
* optional CORE arg for rtshield
* back off priorities of processes not critical to driving
* if it doesn't drive, it's not realtime
* err, resource. this should have been included
* reverse order to not spike
Co-authored-by: Comma Device <device@comma.ai>
* correct, I think
* add model execution time
* remove unused
* token is a file
* this is gonna change
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* refactor draw model
* rebase master
* correct valid_len
* rename function
* rename variables
* white space
* rebase to master
* e16c13ac-927d-455e-ae0a-81b482a2c787
* start rewriting
* save proress
* compiles!
* oops
* many fixes
* seems to work
* fix desires
* finally cleaned
* wrong std for ll
* dont pulse none
* compiles!
* ready to test
* WIP does not compile
* compiles
* various fixes
* does something!
* full 3d
* not needed
* draw up to 100m
* fix segfault
* wrong sign
* fix flicker
* add road edges
* finish v2 packet
* Added pytorch supercombo
* fix rebase
* no more keras
* Hacky solution to the NCHW/NHWC incompatibility between SNPE and our frame data
* dont break dmonitoringd, final model 229e3ce1-7259-412b-85e6-cc646d70f1d8/430
* fix hack
* Revert "fix hack"
This reverts commit 5550fc01a7881d065a5eddbbb42dac55ef7ec36c.
* Removed axis permutation hack
* Folded padding layers into conv layers
* Removed the last pad layer from the dlc
* Revert "Removed the last pad layer from the dlc"
This reverts commit b85f24b9e1d04abf64e85901a7ff49e00d82020a.
* Revert "Folded padding layers into conv layers"
This reverts commit b8d1773e4e76dea481acebbfad6a6235fbb58463.
* vision model: 5034ac8b-5703-4a49-948b-11c064d10880/780 temporal model: 229e3ce1-7259-412b-85e6-cc646d70f1d8/430 with permute + pool opt
* fix ui drawing with clips
* ./compile_torch.py 5034ac8b-5703-4a49-948b-11c064d10880/780 dfcd2375-81d8-49df-95bf-1d2d6ad86010/450 with variable history length
* std::clamp
* not sure how this compiled before
* 2895ace6-a296-47ac-86e6-17ea800a74e5/550
* db090195-8810-42de-ab38-bb835d775d87/601
* 5m is very little
* onnx runner
* add onnxruntime to pipfile
* run in real time without using the whole CPU
* bump cereal;
* add stds
* set road edge opacity based on stddev
* don't access the model packet in paint
* convert mat.h to a c++ header file (#2499)
* update tests
* safety first
Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: mitchell <mitchell@comma.ai>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: George Hotz <george@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Adeeb Shihadeh