the tiny corp
@__tinygrad__

We make tinygrad; sell tinybox for the GPU middle class. Our mission is to commoditize the petaflop.

 San Diego / Hong Kong
tinygrad.org
Joined June 2023
658 Photos and videos
Article

tiny chestnut eGPU dock

Announcement at 2PM PST today jointly with comma. Everyone have their wallets ready? I think it's the nicest GPU dock ever made. hardware specs: * ASM2464PD based * USB2/3/4 + PCIe 4.0 x4 * fully

32
48
925
65,953
Article

tinygrad is hiring

I'm sure you've heard about the AI arms race in hiring. Automated resume spammers talking to automated screening systems and everyone having their time wasted. For a while, we had a bounty program

7
19
547
63,367
Article

Our Future Hardware

Once tinygrad is 1.0 we will begin to roll out our enterprise hardware strategy. Are you sick of managing hundreds of machines to train a model? Isn't what you really want one huge GPU? Imagine a

15
35
607
41,730

USB4 Mac GPU Driver

The USB4 Mac GPU stuff is ready for you to try. You have to disable SIP and install the DEXT in "extra/usbgpu/tbgpu/installer/TinyGPUDriverExtension.xcodeproj" then tinygrad can see your AMD or NVIDIA

5
14
312
26,637
Article

tinygrad's new scheduler

We've been moving away from the ShapeTracker and the legacy scheduler to one that scales to flash attention and beyond. It's called RANGEIFY. To understand RANGEIFY=1, a few prereq concepts help. A

7
17
378
39,816
Article

MI350X Machine Initial Thoughts

These are amazing machines hardware wise. 2x EPYC Turin 9575F processors, 3 TB of DDR5 RAM, 2.3 TB of GPU RAM, and a whopping 12 power cables. People take it for granted, but AMD makes these CPUs too

11
51
722
73,235

tinygrad in 2024

As summarized from all the commits. Performance & Optimization In 2024, tinygrad made significant strides in performance. A major shift from LazyBuffer to a UOp system led to an overhauled scheduler.

1
8
180
24,705
Load more