George Hotz
c3d81bba2a
test_train: Adam -> SGD
2023-02-06 08:55:41 -06:00
Jacky Lee
799b3f185a
Refactor getenv into helpers ( #508 )
...
* Refactor getenv into helpers
* Remove unused os
* Fix default value
* Fix more defaults for CI
* Fix bracket
* Revert changes to openpilot/compile.py
* Use getenv from helpers when possible
2023-01-31 15:09:09 -08:00
George Hotz
fff1f046b0
Simple version of the new GPU backend ( #458 )
...
* newgpu
* more to delete
* hmm, tests pass with constant folding
* fix lint/type
* fix constant folding
* comment and rerun tests
* lazy touchups
* fix graph_batchnorm test
* smaller transformer to fix OOM
* Revert "smaller transformer to fix OOM"
This reverts commit a44ef8edc2
2023-01-10 19:16:02 -08:00
George Hotz
29ae21bb0d
import tests from CL metal texture fix
2022-09-19 20:01:47 -04:00
George Hotz
b132de677d
tinygrad.nn ( #367 )
...
* tinygrad.nn
* flake8
* working on pylint
* more pylint
* more pylint
* pylint passes
* networkx
* mypy can't infer that type
* junk
2022-08-18 07:41:00 -07:00
George Hotz
6375e7129a
opencl not imported
2022-07-17 12:14:39 -07:00
George Hotz
bf299802f8
fixup tests
2022-07-17 12:11:53 -07:00
George Hotz
ce15bf2bdb
the big memory gradient didn't even need to be computed
2022-06-16 11:41:29 -07:00
George Hotz
2e58948f6a
Revert "can put that test back"
...
This reverts commit 51b082b41a
2022-06-16 11:25:49 -07:00
George Hotz
51b082b41a
can put that test back
2022-06-16 11:18:14 -07:00
George Hotz
3d4657167b
fix tests hopefully
2022-06-15 17:26:37 -07:00
George Hotz
845bb1fc34
bs 4 -> 2 in training test
2022-01-15 21:34:21 -08:00
George Hotz
e28cdfb0cf
clean up resnet
2021-11-30 16:14:54 -05:00
George Hotz
de938c2d9d
vit is now tested
2021-11-30 00:23:06 -05:00
George Hotz
c752033283
fix GPU OOM in test
2021-11-29 13:05:59 -05:00
George Hotz
99b6051467
add ff_dim to transformer
2021-11-29 12:40:52 -05:00
George Hotz
fc6597a6d9
only resnet18, it's too slow otherwise
2021-10-30 16:48:39 -07:00
Guglielmo Camporese
2b7589db64
Added ResNet-{18, 34, 50, 101, 152} ( #271 )
...
* added resnets
* fix minor
* fix minor
* resnet in models
* added resnet test
* added resnet train test
* added linear, conv2d nn tests
* fix minor in extra/training
* resnet in models
* fix minor
* fix tolerance for linear in nn test
* fix eval, this causes cpu and gpu UT failing
* revert transformer test
* fix minor for CPU test
* improved model get_params for sequential layer
* fix minor for params counting
* commented broken ops tests
* improved train for resnet
2021-06-21 09:37:24 -07:00
George Hotz
89798d2f43
some flags
2021-06-19 11:46:31 -07:00
George Hotz
d3f169b267
move good models to models, add a training step test
2021-06-19 11:24:15 -07:00
