Commit Graph

69 Commits (master)

Author SHA1 Message Date
Adeeb Shihadeh 8344f3c087
update python packages (#23864) 2022-02-25 14:34:46 -08:00
Andrew 6664421710
mac: fix setup and re-enable CI (#23365)
* rework mac_setup.sh
* ignore casadi and onnx runtime in pipfile for Darwin
* remove rust stuff
* build and install casadi

* add wget

* explicit python3. dont do onnx just yet

* resource compiler

* replace acados Darwin lib w universal2 libs

* relock Pipfile using linux machine

* Update update_requirements.sh

brackets

* Update update_requirements.sh

oops

* ci: re-enable mac build

* attempt to fix ci build:
* pip stuff?
* move rcc bin path to env script

* oops

* only mac

* k im lazy. does ci like this??

* huh??

* * use curl
* avoid casadi rebuilds
* add comment to remove protobuf
* host detect typo

* python version

* how did the builds not use swig?
* better reinstall check

* sometimes mac clang complain abt error limit

* ci: build OP in venv

* ci: bump to Big Sur
* retry? idk why it failed @ acados link

* * use macos-latest
* move rcc path to scons
* add extra paths for odd homebrew installs
* acados source change

* update macOS README

* uh, maybe?

* k nvm

* ci: ok this is strange. might be scons bug?

* fix conflicts: bump

* just add cppcheck for pre-commit stuff

* agane

* cleanup

* try that

* fix path

* no pyenv update on mac

* source

* fix rpath prefix?

* no examples

* fix exit

* let's get this cached

* add virtualenvs to cache

* why did we cache that

* let's see what's big

* more

* always ruyn

* cache scons cache

* better cache key

* fix for partial hit

* why so long

Co-authored-by: Andrew Tec <andrest@trabus.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Bruce Wayne <batman@openpilot-mac-mini.local>
2022-01-07 15:15:18 -08:00
Andrew 9f70bea964
docs: setup docs for C code (#23262)
* add breathe and doxygen

* add sphinx-breathe c docs generation
* add c docs to site

* built in docker

* build base image first

* namespace cleanup

* Revert "build base image first"

This reverts commit 4c44c02ffb.

* its in the dockerfile

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2022-01-04 17:26:07 +01:00
Adeeb Shihadeh cd42be7777
CI: run car unit tests in parallel (#23379)
* CI: run car unit tests in parallel

* move that
2022-01-03 16:30:14 -08:00
Andrew c95202bd1c
docs.comma.ai add sitemap and robots.txt (#23259)
* add sitemap generator

* update conf for seo

* remove cmake var

* relock

* fix html_baseurl

* more fixes

* newline

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2021-12-28 18:07:32 +01:00
jimw db9ea45cd5
PC: fix onnxruntime excessive CPU (#23051)
* onnxruntime-gpu two threads

* relock pipfile

Co-authored-by: jwolffe <wolffja@gmail.com>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
2021-12-06 16:51:45 +01:00
jimw a58d272ae4
CARLA: send YUV and RGB over visionipc from bridge.py (#23012)
* CARLA: send YUV and RGB over visionipc

* CARLA: send YUV and RGB over visionipc-fix pipfile

* CARLA: send YUV and RGB over visionipc-Camerad class

* relock pipfile

* small bridge cleanup

* use tici camera resolution

* update vof

* HUD_SETTING has no counter

* no loggerd

Co-authored-by: jwolffe <wolffja@gmail.com>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
2021-11-26 16:58:25 +01:00
Willem Melching f1c77f97b9
cleanup unused pip packages (#22947)
* cleanup unused pip packages

* fix linter
2021-11-17 16:23:03 +01:00
Jason Young 739bd37003
Fix pygame and knack dependencies (#22818)
* fix pygame and knack

* lock again

* latest pygame, headless opencv

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2021-11-08 19:21:24 +01:00
Mayfield 1aebe6ff6e
ui: render markdown in release notes (#22754)
* convert release notes from markdown to html

* fall back to previous behavior if utf8 decoding or markdown parsing throws

* make simple markdown parser to avoid needing a library

* add unit test

* move markdown parser to common. add unit test

use `markdown-it-py` instead of `markdown` dependency for test comparison since it's already in Pipfile.lock

* test (almost) all release notes and add some extra html encoding

* update lock

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2021-11-04 16:12:39 +01:00
Willem Melching 3f8991a261
docker: update pip/pipenv versiosn (#22793) 2021-11-04 15:40:36 +01:00
Willem Melching aa8952d0b1
Add sphinx dependencies to Pipfile (#22720) 2021-10-28 17:32:29 +02:00
Willem Melching cf42e71c16
remove cysignals from pipfile (#22630) 2021-10-20 12:26:12 +02:00
Adeeb Shihadeh ad32a2d27b
update pre-commit version (#22560) 2021-10-14 14:02:48 -07:00
Willem Melching 227e12a477
add jupyterlab to dev packages (#22453)
* add jupyterlab to dev packages

* add prebuilt vim extension
2021-10-06 17:23:29 +02:00
Willem Melching a60f3c6a35
move acados deps out of devpackages (#22376)
* move acados deps out of devpackages

* fix new pylint errors
2021-09-29 23:20:33 +02:00
Adeeb Shihadeh 42f9d1b46f
update pycapnp to v1.1.0 (#21371) 2021-06-22 14:57:13 -07:00
Adeeb Shihadeh 6e4c2aa4d2
acados support (#21319)
* acados support

* add pyextra to python path

* x86 libs
2021-06-17 16:40:00 -07:00
Adeeb Shihadeh 73ea28f7ef
add inputs package to Pipfile (#21122) 2021-06-03 14:57:56 -07:00
Willem Melching 33edb62967
hypothesis fuzz testing (#20818)
* add hypothesis testing

* cleanup

* some cleanup

* check for infinity too

* one-liner

* add more fields that are used

* no print

* add locationd testing

* sensor timestamp is signed

* recursive finite checking

* keep locationd inputs finite for now

* specify proces name on command line

* increase timeout and add raw speed

* abstract runner in function

* add unittest class
2021-05-05 13:25:29 +02:00
Willem Melching 7dcda0e461 remove raven from pip packages 2021-04-22 15:29:43 +02:00
robbederks 6a824d7651
Zookeeper support (#20000)
* zookeeper lib

* add ft4222 to dev pip packages and fix include error

* started on CI

* it's a file

* now it should be happy

* use docker for all on-device tests

* test scripts

* does this work?

* access to devices

* too broad. only usb enough?

* permissions for zookeeper usb

* as env var maybe?

* this?

* try this for now

* all devices

* move to correct location for impoerts

* right paths

* not running in the right agent?

* ofc not

* fix broken merge

* add ft4222 package again

* add timeout

* power monitor

* cleanup

Co-authored-by: Batman <batman@openpilot-ci.internal>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2021-04-13 15:08:00 -07:00
Greg Hogan 3d48bd934d
log to file and send through athena (#20250)
* log to file and send through athena

* rename logging level

* pass thru log formatter

* logMessage is TEXT

* send queue always strings

* switch to xattr and lower priority queue

* enable cloud logging for devices

* time or size based log rotation

* basename -> dirname

* remove HARDWARE.get_cloudlog_enabled

* fix errors

* fix another exception

* xattrs need to be bytes

* sending works

* cleanup files at start

* add id and adjust formatting

* do not send active log file

* better names

* separate log formatters

* fix formatter super init

* fix log file order

* ensure file always has file formatter

* i see why there was no formatter

* apply same formatting to cpp log msgs

* apply same formatting to cpp log msgs

* update queue names in tests

* strip deprecated keys in STATUS_PACKET

* strip DEPRECATED from dict recursively

* athena log queue test

* instanceof instead of type

* isinstance instead of type

* use super

* remove logentries

* last_scan param unused

* comment about special log msg attr names

* add dict_helpers.py to release files

* use monotonic time and counter for log rotation

* update for adjusted log file naming

* use monotonic clock for tracking last log file scan
2021-03-25 13:30:09 -07:00
Adeeb Shihadeh 20e6f6bd79
bump pycapnp version (#20326)
* bump pycapnp version

* bump cereal
2021-03-11 20:18:38 -08:00
Adeeb Shihadeh 3e70395e82
add new sentry client package (#20178) 2021-02-26 22:03:19 -08:00
Greg Hogan 5fbfaaef52 remove some pip packages 2021-02-23 11:38:05 -08:00
Greg Hogan a796294474 eliminate python-logstash-async 2021-02-20 10:16:46 -08:00
Willem Melching 4c04e220a1
Timezoned (#19960)
* untested code

* add to manager

* whitespace

* only save on fix

* cleanup

* fix typo

* add to ignored processes

* import tici

* fix param name

* cleanup

* only run offroad

* use itertools

* wait for thermald

* simpler

* fall back to api call

* add param to override timezone

Co-authored-by: Comma Device <device@comma.ai>
2021-02-06 11:07:37 +01:00
George Hotz bd9388c933 pyopencl pipenv 2021-01-08 10:47:19 -08:00
George Hotz cc4c34cc0b
smp_pipenv (#19687) 2021-01-07 08:52:51 -08:00
George Hotz bbe868d312 Revert "add two dev packages for training"
This reverts commit 3da368247a.
2020-12-09 21:48:38 -08:00
George Hotz 3da368247a add two dev packages for training 2020-12-09 11:07:18 -08:00
George Hotz 2df0f9ffb1 add onnx and bump versions in Pipfile.lock 2020-11-14 17:20:20 -08:00
HaraldSchafer 08846b5c0e
Torch model (#2452)
* refactor draw model

* rebase master

* correct valid_len

* rename function

* rename variables

* white space

* rebase to master

* e16c13ac-927d-455e-ae0a-81b482a2c787

* start rewriting

* save proress

* compiles!

* oops

* many fixes

* seems to work

* fix desires

* finally cleaned

* wrong std for ll

* dont pulse none

* compiles!

* ready to test

* WIP does not compile

* compiles

* various fixes

* does something!

* full 3d

* not needed

* draw up to 100m

* fix segfault

* wrong sign

* fix flicker

* add road edges

* finish v2 packet

* Added pytorch supercombo

* fix rebase

* no more keras

* Hacky solution to the NCHW/NHWC incompatibility between SNPE and our frame data

* dont break dmonitoringd, final model 229e3ce1-7259-412b-85e6-cc646d70f1d8/430

* fix hack

* Revert "fix hack"

This reverts commit 5550fc01a7881d065a5eddbbb42dac55ef7ec36c.

* Removed axis permutation hack

* Folded padding layers into conv layers

* Removed the last pad layer from the dlc

* Revert "Removed the last pad layer from the dlc"

This reverts commit b85f24b9e1d04abf64e85901a7ff49e00d82020a.

* Revert "Folded padding layers into conv layers"

This reverts commit b8d1773e4e76dea481acebbfad6a6235fbb58463.

* vision model: 5034ac8b-5703-4a49-948b-11c064d10880/780  temporal model: 229e3ce1-7259-412b-85e6-cc646d70f1d8/430  with permute + pool opt

* fix ui drawing with clips

* ./compile_torch.py 5034ac8b-5703-4a49-948b-11c064d10880/780 dfcd2375-81d8-49df-95bf-1d2d6ad86010/450 with variable history length

* std::clamp

* not sure how this compiled before

* 2895ace6-a296-47ac-86e6-17ea800a74e5/550

* db090195-8810-42de-ab38-bb835d775d87/601

* 5m is very little

* onnx runner

* add onnxruntime to pipfile

* run in real time without using the whole CPU

* bump cereal;

* add stds

* set road edge opacity based on stddev

* don't access the model packet in paint

* convert mat.h to a c++ header file (#2499)

* update tests

* safety first

Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: mitchell <mitchell@comma.ai>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: George Hotz <george@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-11-11 20:31:46 -08:00
Greg Hogan 789a94932b Revert "pytorch cuda 11.0 (#2496)" (didn't work!)
This reverts commit 14c6de9094.
2020-11-06 19:38:23 -08:00
Greg Hogan 14c6de9094
pytorch cuda 11.0 (#2496) 2020-11-06 19:02:25 -08:00
George Hotz e63f434d5c
pin blosc (#2492) 2020-11-05 21:06:08 -08:00
Greg Hogan 06f63d37fa
add blosc to pipfile (#2464) 2020-10-31 08:19:54 -07:00
Adeeb Shihadeh 719c5e3598
ubuntu 16.04 -> 20.04 (#2378) 2020-10-29 16:51:09 -07:00
Greg Hogan 05c16b1ff9 pytorch pip packages 2020-09-03 17:57:11 -07:00
Harald Schafer 270880c705 tf 2.2. 2020-08-08 11:17:41 -07:00
Harald Schafer b467f5777b not useful 2020-07-29 10:21:44 -07:00
Willem Melching 95b0c69c12
update pipfile.lock (#1896)
* update pipfile

* matrix is deprecated

* Numpy almost equal

* sympy 1.6
2020-07-21 21:15:09 +02:00
Adeeb Shihadeh b44569284a
test each model fingerprints with FW fingerprinting (#1769)
* test each model fingerprints with FW fingerprinting

* lock

* test for all
2020-06-23 15:33:04 -07:00
Willem Melching 6f46eed874 Fixed virtualenv https://github.com/pypa/virtualenv/issues/1857 2020-06-12 12:25:18 -07:00
Willem Melching 0f26c04a7b use older pre-commit version 2020-06-12 12:14:16 -07:00
Willem Melching b19098dbf8 remove pycocotools 2020-06-12 11:48:14 -07:00
Willem Melching 3d08dcc3b2
Run mypy commit hook (#1591)
* run mypy commit hook

* fix mypy errors
2020-05-28 15:05:04 -07:00
Willem Melching bd06434243
pre-commit pylint (#1580)
* "The commit-hook project sounds interesting though. I would definitely merge something that runs flake8 and pylint on the modified files!"
-  pd0wm, https://github.com/commaai/openpilot/pull/1575#issuecomment-634974344

* add pylint to pre-commit and make everything pass

* Remove uncommented stuff

Co-authored-by: J <user@4800.lan>
2020-05-27 20:00:14 -07:00
github-actions[bot] ac8617581e
Update Pipfile.lock (dependencies) (#1563)
* [Bot] Update Pipfile.lock dependencies

* trigger ci

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
2020-05-26 13:43:30 -07:00