85 lines
1.9 KiB
ReStructuredText
85 lines
1.9 KiB
ReStructuredText
==============
|
|
About tinyrocs
|
|
==============
|
|
tinyrocs is a small and efficient direct to chip liquid cooled GPU AI cluster.
|
|
|
|
|
|
.. figure:: _static/img/tinyrocs-cluster-007.png
|
|
:alt: tinyrocs photo
|
|
:width: 60%
|
|
|
|
|
|
Features
|
|
========
|
|
|
|
* Multiple AMD Radeon 7900XTX GPUs, RNDA3, 24G RAM for AI compute.
|
|
* AMD Epyc CPUs.
|
|
* Direct to chip liquid cooled CPU.
|
|
* Direct to chip liquid cooled GPUs.
|
|
* PCIe 4.0 16x redrivers.
|
|
* USA domestic 110V power (one node per 15-20A circuit).
|
|
Currently using 3x domestic circuits (3x 15-20A)...
|
|
* ASRock ASRack ROMED8-2T motherboards with seven PCIe 4.0 16x.
|
|
* Mining rig chassis.
|
|
* Relative low cost, high performance, perhaps.
|
|
|
|
|
|
Status
|
|
======
|
|
``It.is.alive.``
|
|
|
|
* Hardware built.
|
|
* Toolchain built.
|
|
* ``tinygrad`` works, running the workloads on the AMD GPUs.
|
|
* GNU/Linux.
|
|
* Natively built ROCm, using latest ``6.0.2`` release.
|
|
* Direct to chip liquid cooling setup, with six AMD GPUs.
|
|
* Five AMD GPUs on the PCI bus (e.g. 5/6 GPUs plugged in to motherboard).
|
|
* Custom built working kernel from AMD's Linux repo.
|
|
* Wet Rocks, liquid immersion system started: `<https://wetrocks.fyi>`_
|
|
|
|
|
|
.. figure:: _static/img/tinyrocs-cluster-008.png
|
|
:alt: tinyrocs photo
|
|
:width: 60%
|
|
|
|
tinyrocs running.
|
|
|
|
|
|
Links
|
|
=====
|
|
tinyrocs main page and source code:
|
|
|
|
`<https://tinyrocs.foo>`_
|
|
|
|
`<https://spacecruft.org/deepcrayon/tinyrocs>`_
|
|
|
|
|
|
Upstream
|
|
========
|
|
tinyrocs loosely based on tinybox, a design from tinygrad corp.
|
|
The tinyrocs project is independent of upstream tinygrad.
|
|
|
|
`<https://tinygrad.org>`_
|
|
|
|
`<https://github.com/tinygrad/tinybox>`_
|
|
|
|
|
|
Licenses
|
|
========
|
|
Where possible, libre licenses are used.
|
|
Acceptable licenses are based on the FSF's list, plus
|
|
anything Wikipedia can use. In practice this means GPL-type,
|
|
MIT, most Creative Commons (except NC), public domain, etc. are used.
|
|
|
|
Any exceptions to the above will be duly noted.
|
|
|
|
Copyright (C) 2023, 2024, Jeff Moe
|
|
|
|
|
|
Author
|
|
======
|
|
| Jeff Moe <moe@parrot.codes>
|
|
| Loveland, Colorado
|
|
|