Commit Graph

392 Commits (2c94f155840b49639b8bf1ec996d99e268fa9a52)

Author SHA1 Message Date
Adeeb Shihadeh 2c94f15584
linter: don't allow implicitly concatenated strings (#23513)
* linter: don't allow implicitly concatenated strings

* fix hyundai
2022-01-13 14:19:38 -08:00
Adeeb Shihadeh 7d7c0ff35f
tools: add bootlog helpers (#23504)
* tools: add bootlog helpers

* this is nice

* types
2022-01-12 21:37:43 -08:00
Adeeb Shihadeh 7eca4d6207 tools: better joystick instructions 2022-01-10 12:03:27 -08:00
Adeeb Shihadeh fa3055f280
smaller docker image (#23469)
* save 2gb

* not used

* more cleanup

* little more

* wget too big

* follow

* needed for sim
2022-01-10 11:43:18 -08:00
Andrew 6664421710
mac: fix setup and re-enable CI (#23365)
* rework mac_setup.sh
* ignore casadi and onnx runtime in pipfile for Darwin
* remove rust stuff
* build and install casadi

* add wget

* explicit python3. dont do onnx just yet

* resource compiler

* replace acados Darwin lib w universal2 libs

* relock Pipfile using linux machine

* Update update_requirements.sh

brackets

* Update update_requirements.sh

oops

* ci: re-enable mac build

* attempt to fix ci build:
* pip stuff?
* move rcc bin path to env script

* oops

* only mac

* k im lazy. does ci like this??

* huh??

* * use curl
* avoid casadi rebuilds
* add comment to remove protobuf
* host detect typo

* python version

* how did the builds not use swig?
* better reinstall check

* sometimes mac clang complain abt error limit

* ci: build OP in venv

* ci: bump to Big Sur
* retry? idk why it failed @ acados link

* * use macos-latest
* move rcc path to scons
* add extra paths for odd homebrew installs
* acados source change

* update macOS README

* uh, maybe?

* k nvm

* ci: ok this is strange. might be scons bug?

* fix conflicts: bump

* just add cppcheck for pre-commit stuff

* agane

* cleanup

* try that

* fix path

* no pyenv update on mac

* source

* fix rpath prefix?

* no examples

* fix exit

* let's get this cached

* add virtualenvs to cache

* why did we cache that

* let's see what's big

* more

* always ruyn

* cache scons cache

* better cache key

* fix for partial hit

* why so long

Co-authored-by: Andrew Tec <andrest@trabus.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Bruce Wayne <batman@openpilot-mac-mini.local>
2022-01-07 15:15:18 -08:00
rzeydelis 207ce410b4
tools: update README.md (#23447) 2022-01-07 14:03:27 -08:00
Adeeb Shihadeh f30a702414
fix up tools readme 2022-01-04 19:59:49 -08:00
Greg Hogan 71132edf17
plotjuggler: support segment names (#23263)
* plotjuggler: support segment names

* update docs

* generic parser

* convert segment number to int when parsing

* add SegmentName

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2022-01-04 15:55:46 +01:00
Cameron Clough 5a77157ea4
Joystick: learn axis min/max (#23377)
* Joystick: learn axis min/max

* clean up updating max/min

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2022-01-04 14:17:30 +01:00
Greg Hogan 3e5a273022
tools: configure PYTHONPATH in pipenv (#23361)
* automatically set PYTHONPATH in pipenv

* remove other place this was set
2022-01-03 20:15:10 -08:00
Adeeb Shihadeh bbb47dc860
MultiLogIterator: fix after adding sort_by_time 2022-01-02 20:08:57 -08:00
Adeeb Shihadeh 92f194decc
MultiLogIterator: remove wraparound mode (#23360) 2022-01-02 15:16:44 -08:00
Adeeb Shihadeh 066e3e3626
CI: use ubuntu_setup.sh (#23349)
* CI: use ubuntu_setup.sh

* works?

* need to fix paths

* set paths

* no batman for now

* pyenv version

* rehash after install packages

* unify python install

* revert that

* fix pyenv path

* no pipenv

* flip that

* fix rehash

* skip that

* revert panda
2022-01-02 14:47:16 -08:00
Greg Hogan 9992ea1ae8
LogReader: add arg to sort by time (#23346)
* logreader optional sort by time

* robust logreader sort by time option
2022-01-02 11:56:53 -08:00
Greg Hogan 92b553be3e
plotjuggler: fix layout param (#23348) 2022-01-01 17:17:24 -08:00
Shane Smiskol fed7cfeef0
PC: dynamically set PYTHONPATH from real openpilot path (#23322)
* dynamic PYTHONPATH setting based on actual openpilot location

* right above

* fix path

* absolute path all the time

* Revert "absolute path all the time"

This reverts commit c0bc2e08e7.

* Update tools/openpilot_env.sh

Co-authored-by: Willem Melching <willem.melching@gmail.com>

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2021-12-31 19:34:08 -08:00
Adeeb Shihadeh 7cd6a88638 fix setup scripts if git isn't installed 2021-12-31 19:29:38 -08:00
Adeeb Shihadeh c26f294218
plotjuggler: add mac support (#23344)
* plotjuggler: add mac support

* fix test?

* update readme

* oops

* fix

* cleanup

* typo

* works

* little more

* fix test

* little faster
2021-12-31 16:44:57 -08:00
Adeeb Shihadeh 8fe9c0ef93 mac_setup: install git-lfs 2021-12-31 10:08:34 -08:00
Ewout ter Hoeven 332f568a82
Pyupgrade 3.6: Update syntax with Python 3.6+ features (#23305)
Updated Python code with Python 3.6+ features:
- utf-8 encoding is now the default (PEP 3120)
- Replace list comprehensions by Generator Expressions (PEP 289)
- Replace yield loop by yield from (PEP 380)
- Remove the (object) subclass when defining a class
- Replace the IOError alias by OSError (PEP 3151)
- Define sets with curly braces {} instead of set()
- Remove "r" parameter from open function, which is default

Co-Authored-By: Adeeb Shihadeh <8762862+adeebshihadeh@users.noreply.github.com>
Co-Authored-By: GregorKikelj <96022003+GregorKikelj@users.noreply.github.com>

Co-authored-by: Adeeb Shihadeh <8762862+adeebshihadeh@users.noreply.github.com>
Co-authored-by: GregorKikelj <96022003+GregorKikelj@users.noreply.github.com>
2021-12-24 11:18:39 -08:00
Ewout ter Hoeven 55390d273f
Convert format strings strings to f-strings (#23241)
* Convert all text strings to f-strings

Reformats all the text from the old "%-formatted" and .format(...) format to the newer f-string format, as defined in PEP 498. This requires Python 3.6+.

Flynt 0.69 was used to reformat the strings. 120 f-strings were created in 51 files.

F-strings are in general more readable, concise and performant. See also: https://www.python.org/dev/peps/pep-0498/#rationale

* revert pyextra changes

* revert ublox.py

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2021-12-16 14:58:17 +01:00
grekiki 6951b3271d
Python: Replace more lists with generators (#23116)
* Replace lists with generators v2

* Replace set with {}

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Replace more set() with {}

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2021-12-03 22:57:19 -08:00
Adeeb Shihadeh c8356d3b8f MultiLogIterator: default wraparound to false 2021-12-02 08:14:48 -08:00
Dean Lee 348d2d2b0d
rename yuv streams (#23071)
* rename yuv streams

* bump cereal

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2021-11-29 18:14:59 -08:00
Adeeb Shihadeh 01b99eae35 logreader: remove log path print 2021-11-29 13:44:20 -08:00
Adeeb Shihadeh 920b751888 juggle: add demo flag and improve README 2021-11-28 14:19:49 -08:00
Adeeb Shihadeh 08f9316b56 remove dead + duplicate python code 2021-11-28 14:02:06 -08:00
Willem Melching a4ca8e4835
sim: improve carla performance (#23046) 2021-11-28 11:32:37 +01:00
Adeeb Shihadeh 8160cf3c1b
camerad: remove camera frame stream (#23045)
* camerad: remove camera frame stream

* fix release files
2021-11-27 21:58:21 -08:00
jimw a58d272ae4
CARLA: send YUV and RGB over visionipc from bridge.py (#23012)
* CARLA: send YUV and RGB over visionipc

* CARLA: send YUV and RGB over visionipc-fix pipfile

* CARLA: send YUV and RGB over visionipc-Camerad class

* relock pipfile

* small bridge cleanup

* use tici camera resolution

* update vof

* HUD_SETTING has no counter

* no loggerd

Co-authored-by: jwolffe <wolffja@gmail.com>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
2021-11-26 16:58:25 +01:00
Adeeb Shihadeh b8393f7271 can_replay: warning & clone cmd if jungle lib is missing 2021-11-23 23:33:26 -08:00
Adeeb Shihadeh a64169af26
link to ctf in tools readme 2021-11-19 21:16:49 -08:00
Adeeb Shihadeh 80d0aaadf4 juggle: strip input 2021-11-18 14:56:01 -08:00
Willem Melching f1c77f97b9
cleanup unused pip packages (#22947)
* cleanup unused pip packages

* fix linter
2021-11-17 16:23:03 +01:00
eFini a87190342b
macOS: Fix missing pip command issue. (#22924)
* Fixed missing pip command issue.

* add path to openpilot_env.sh for mac
2021-11-17 11:23:05 +01:00
Adeeb Shihadeh 0674726cf4 ubuntu_setup.sh: add option to continue on unsupported os 2021-11-16 14:30:51 -08:00
qadmus 5f2c7ad69f
plotjuggler: plotjuggler: tuning layout w/ cruise setpoint, use carControl.enable not carControl.active (#22908) 2021-11-15 13:20:53 -08:00
qadmus 65d1b51476
PlotJuggler: Tuning layout (#22902)
* PlotJuggler layout for lateral and longitudinal tuning

* update README and tuning PR template
2021-11-13 23:16:42 -08:00
Adeeb Shihadeh 45ced84acf sim: fix CAN error and block loggerd 2021-11-13 12:21:24 -08:00
Willem Melching 6d6f989b7f
RobustLogReader that can recover corrupted bz2 files (#22835)
* LogReader with bzip2 recovery

* only rlogs

* add comment

* plotjuggler should also use robust logreader
2021-11-10 16:41:00 +01:00
Adeeb Shihadeh ee33f8a8cd tools/lib/route: expose raw file paths 2021-11-04 20:32:02 -07:00
Willem Melching 252f3c1c87
tools/lib/auth.py: support github/apple login (#22766)
* tools/lib/auth.py: support github/apple login

* print some info about logged in user

* add docstring
2021-11-01 15:00:00 +01:00
Dean Lee 41e5e76596
replay: fixed the alignment issue when replaying from C3 qcamera (#22734)
* fix qcamera replay

* fix alignment in replay

* upscale yuv if needed

* remove space
2021-11-01 11:06:00 +01:00
lipniak 1d55f2f23e
tools/setup: do not change global state (#22735)
* tools/setup: do not change global state

1. download packages in the venv
2. never change global python version

* update_requirements.sh: install to system if used by comma employees

* bump pip & pipenv versions

* no --upgrade

* run pre-commmit install in venv

* for consistency

Co-authored-by: predicate@bonzo <noreply@example.com>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
2021-10-31 16:37:07 +01:00
lipniak e68849cfc8
tools: add info on common issues (#22709)
* tools/README.md: add more information

1. Add info about OpenCL drivers
2. Add info about pipenv environment

* ubuntu_setup.sh: add clinfo

Adds the clinfo command so you can verify your OpenCL installation.

* tools/README.md: add info on GUI WSL
2021-10-29 11:19:43 +02:00
Willem Melching b816b5b644
Sphinx docs generation (#22697)
* add sphinx

* switch theme

* Experiment: sphinx docs generation updated (#22708)

* moved build to root gitignore, added .gitkeep

* Improved makefile doc build process

- Removed auto-generated docs from source control
- Moved apidoc.sh into Makefile
- Removed make.bat (can add back if Windows support desired)
- Added sphinx viewcode and markdown extensions
- Added feature to source /docs in build, so any .rst file in /docs will
  override the respective file during the build process
- Added feature to copy all markdown/rst files from source into /build/
  during build process so they can be easily referenced while writing
  docs (see examples in index.md)
- Wrote basic starter index.md file

TODO: Add new dependencies to Pipfile [dev-packages]

* Revert accidental modification to Pipfile

* fix command substitution

* exclude xx

* improve docs

* dont include all docs in release build

* Add dockerfile

* update title

* include normal readme

* build container in CI

* use buildkit

* add login

Co-authored-by: Chad Bailey <chadbailey904@gmail.com>
2021-10-28 15:14:37 +02:00
Andrew 999b2ee5cc
tools/setup: add missing package for plotjuggler (#22713) 2021-10-27 10:56:41 -07:00
Willem Melching 59accdd814 do not run on import 2021-10-26 14:49:51 +02:00
Adeeb Shihadeh e556d3d3d3
sim: set fingerprint with environment variable (#22679) 2021-10-24 21:59:50 -07:00
lipniak 38420a1bef
ubuntu_setup.sh: add 21.10 support and change packages (#22628) 2021-10-22 15:45:20 -07:00