Just audited a training step from
@gensynai's open-1b.
On an H100, I downloaded the checkpoint published at step 69,300, trained it for one step, and checked it reproduced the published state hash bit for bit. The original hash was committed on-chain a week before I checked, so it couldn't have been fitted to my result. I was also able to explore the data each step was trained on.
Thanks to
@TargonCompute, running this on their H100 only cost $3.09/hr as well.
Here's hoping we move to a world where every big AI lab ships auditable open training recipes you can check just like this, with the training data just as open.