Currently independent. Exploring some neuro-inspired AI approaches. Former GPU geek at @OpenAI. He/Him.
San Francisco, CA
- Tweets 193
- Following 924
- Followers 15,035
- Likes 4,461
Scott Gray retweeted
The case for 4-bit precision: k-bit Inference Scaling Laws
abs: arxiv.org/abs/2212.09720
2
12
88
32,057
I have no intention of changing my profile link. help.twitter.com/en/rules-an…
1
34
48,947
In case you missed it, here's @model_mechanic @jcjohnss and @karpathy getting into the gritty details of the DALL-E paper: piped.video/PtdpWC7Sr98 . I hope this kind of interaction becomes the more of the norm in the future.
6
111
Scott Gray retweeted
One of the many lessons we should be learning from COVID: the importance of statistics education.
Understanding causality and probability is critical to being informed and making wise choices.
How much better off would we be if schools replaced trig or calculus with stats?
211
860
4,412
Scott Gray retweeted
How do we beat COVID-19, *while protecting our mental & financial health?*
Epidemiologist @MarcelSalathe & I explain Epidemiology 101, #TestTraceIsolate, #MasksForAll, worst-case scenarios... all with playable simulations! 🕹
Check it out!
😷ncase.me/covid-19/😷 (30 min)
19
391
799
Scott Gray retweeted
New video: Simulating an epidemic.
What happens when people avoid each other for the most part but still go to a common central location like a store?
What if you can track and isolate cases, but 20% slip through the cracks? 50%?
And much more.
piped.video/gxAaO2rsdIs
106
2,074
5,062
Scott Gray retweeted
The fact that primaries are not done via ranked-choice voting is absurd
47
407
2,858
This is a really cool project I'm happy to have had the chance to help out with.
Introducing MuseNet, a neural network which discovered how to generate music using many different instruments and styles.
Listen & interact: openai.com/blog/musenet/
MuseNet will play an experimental concert today from 12–3pmPT on livestream: twitch.tv/openai
1
18
Lots more work on sparsity in various forms forthcoming...
Releasing some work today with @scottgray76 @AlecRad and @ilyasut. Contains some simple adaptations for Transformers that extend them to long sequences.
1
2
34
Scott Gray retweeted
We've trained an unsupervised language model that can generate coherent paragraphs and perform rudimentary reading comprehension, machine translation, question answering, and summarization — all without task-specific training: blog.openai.com/better-langu…
420
2,749
12,168
Scott Gray retweeted
Random Network Distillation: A prediction-based method that achieves state-of-the-art performance on Montezuma’s Revenge -blog.openai.com/reinforcemen…
8
151
493
Scott Gray retweeted
OpenAI Five match starting now: twitch.tv/dota2ti !
First OpenAI Five match at The International today!
- Streamed on The International's Twitch channels. English: twitch.tv/dota2ti . For newcomers: twitch.tv/dota2ti_newcomer
- Held at the end of today's 1p PT matches — likely be around 3p PT.
10
73
248
Scott Gray retweeted
First OpenAI Five match at The International today!
- Streamed on The International's Twitch channels. English: twitch.tv/dota2ti . For newcomers: twitch.tv/dota2ti_newcomer
- Held at the end of today's 1p PT matches — likely be around 3p PT.
OpenAI Five will be playing against five of the world's top Dota 2 professionals in front of nearly 20,000 audience members at The International on Wednesday, Thursday, and Friday: openai.com/five/
14
102
331
Scott Gray retweeted
Reminder: OpenAI Benchmark is today! Watch live at twitch.tv/openai starting 12:30p PT (main event at 1:15p). Follow @gdb and @cbd for livetweeting from the event. Good luck, have fun to both teams! blog.openai.com/openai-five-…
5
155
409
Scott Gray retweeted
A real robot hand, trained with same learning algorithm and code as OpenAI Five, has learned human-like motions to rotate objects: blog.openai.com/learning-dex…
33
516
1,273
Scott Gray retweeted
Our team of five neural networks, OpenAI Five, has started to defeat amateur human teams (including a semi-pro team) at Dota 2: blog.openai.com/openai-five/
53
763
2,098
Scott Gray retweeted
How big is the sudden explosion of startups building AI chips? There are 45 of them, and at least five have raised $100 million: nyti.ms/2EEpICX
8
162
328
You can find the slides to my NIPS talk on Small World Network Architectures here: supercomputersfordl2017.gith… There were lots of other great talks in that workshop. Thanks to Google (mainly @erich_elsen) for organizing.
19
51