Research and development of foundational intelligence for the physical world.

San Francisco Bay Area
Deploying physical AI on wearables and phones requires real-time perception inside extreme thermal and battery limits. Reka EdgeQ is an optimized on-device VLM running natively on @Qualcomm #Snapdragon 8 Elite’s Hexagon NPU. ⚡️ 0.73s Time to First Token (Image) 📹 +34 pts over Gemma 4 E4B on MLVU video benchmarks 🔋 6.9 mWh energy per inference (~3x lower heat overhead) By custom-tuning our ConvNeXt V2 vision encoder and decoder directly for the #NPU, EdgeQ keeps the GPU completely idle, minimizing thermal throttling under sustained continuous load. 🔗Our technical breakdown: reka.ai/labs/research/reka-e… #Multimodal #ComputerVision #VLM
2
8
34
2,786
VLMs: language, image → language. Omni: language, image, video, actions → language, image, video, actions. 🚪 Same doors in. It is the way out that changes. New #AIresearch from Reka Labs on omni-world models shares why unifying VLA and world-model (WAM) approaches under one backbone matters for physical-world intelligence. reka.ai/labs/research/evolut… #MultimodalAI #WorldModels #PhysicalAI
2
13
40
2,149
📊 Update: RekaDaily-10k is now complete. The raw tier finished at 10,865 hours. The processed and captioned tier is live for the first time: 10,200 hours, 6,373,064 clips, 74.2 TB. Both tiers are on Hugging Face now, fully open under Apache 2.0. 🔗 Read the updated post: reka.ai/labs/research/rekada… 🔗 Get the dataset on Hugging Face 🤗: huggingface.co/datasets/Reka… #PhysicalAI #WorldModels #OpenSource #EgocentricData
To train physical AI, synthetic environments and polished, tripod-mounted footage aren't enough. You need the actual mess of the real world. 🚀Releasing RekaDaily-10k: 10,312 hours of unscripted, first-person household footage as collected, recorded by paid collectors in real homes across the US, LatAm, Asia, and Africa, with roughly 1,670 hours in native 4K. Raw tier available now on @huggingface🤗, full set live by early next week. Apache 2.0. huggingface.co/datasets/Reka… Read more reka.ai/news/rekadaily-10k-e… This is what Claru, our data engine, produces daily from 100,000+ paid collectors. #RekaDaily10k #PhysicalAI
3
8
34
2,903
Together with @nvidia , we've built a real-time version of our video generation model: 30B parameters, steerable mid-stream in natural language, 720p at 24fps. 11.8x faster on a single H100, no major quality drop in our blind eval. We're one step closer to World Language Action Models: AI that doesn't just generate the physical world, it acts within it. Closed beta open now, contact us for access. reka.ai/labs/research/real-t… #RekaLabs #NVIDIA #AIResearch #VideoGeneration #WorldModels
5
20
70
11,215
we've made freely available a few things over the past few weeks. training datasets - RekaCS2-10k: bit.ly/4zbjpmB - RekaDaily-10k: bit.ly/4gya2F5 eval benchmarks - WorldModelGym: bit.ly/3UvYYR7 - PhysicalRealismBench-U: bit.ly/3Swj512 and share insights into our data processing pipeline: bit.ly/3TZe5Cw we intend to continue sharing our research broadly. the next one is our omni model. still training for now, but looking forward to open weighting it.
3
6
25
2,060
To train physical AI, synthetic environments and polished, tripod-mounted footage aren't enough. You need the actual mess of the real world. 🚀Releasing RekaDaily-10k: 10,312 hours of unscripted, first-person household footage as collected, recorded by paid collectors in real homes across the US, LatAm, Asia, and Africa, with roughly 1,670 hours in native 4K. Raw tier available now on @huggingface🤗, full set live by early next week. Apache 2.0. huggingface.co/datasets/Reka… Read more reka.ai/news/rekadaily-10k-e… This is what Claru, our data engine, produces daily from 100,000+ paid collectors. #RekaDaily10k #PhysicalAI
10
22
163
41,247
Can AI actually reason about a video, or is it still just listing what's in frame? We gave our model a scenario: twenty competitors, nearly identical vehicles, fast-paced motorsport. It has to figure out who's who from pixels alone. Result: 90.9% accuracy, up from 39.6%. 📄 Read the full research: reka.ai/labs/research/beyond…
2
4
26
2,510
A single camera frame might capture a thousand people on a train platform. It's not enough to recognize them. The model has to know which one matters. In our latest post, we share how our models reason about real-world video: spatial grounding, temporal tracking, identity, and judgment. One benchmark jumped from 39.6% to 90.9% top-1 accuracy identifying individual competitors in motorsport broadcasts. The gain came from better evaluation, not a bigger model. 📄 Read more: reka.ai/news/beyond-recognit…
4
20
1,990
Reka has signed the Open Weights and American AI Leadership letter. We believe an open AI ecosystem is essential to advancing research, expanding access, and building a more innovative and resilient field. That's why we've openly released datasets like CS2-10k and Research-Eval, models like Reka Flash 3 and Reka Edge, and frameworks like Reka Quant. microsoft.com/en-us/corporat…
For my first post, I’m sharing a letter @NVIDIA signed on why open models matter. AI will transform every industry, power every company, and be built by every country. Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. The world needs both frontier closed models and frontier open models. images.nvidia.com/pdf/Open-W…
1
12
23
3,458
Today we're opening the WorldModelGym leaderboard 📊 Most world model evals ask one question: does the generated video look real? WMGym asks a different one. Give a model a menu of possible actions, can it correctly predict which one actually leads to the best outcome?🎯 We ran our own Dreamer-v3 across all four benchmark families as the first entry. It currently leads three of them — Meta-World, DeepMind Control, and Classical Control (where it hits 84% decision fidelity), and sits second on Atari. We invite you to also enter your own model: you host a /score endpoint, we call it and compute the score ourselves. Read our full breakdown and methodology: wm-gym.labs.reka.ai/
10
35
294
17,298
Before a single model weight is updated, someone has to answer a deceptively hard question: What's actually in your data? 🤔 Julian Geoffrey López and Fedor Zhdanov share how they think about composition, quality, and annotation, and why getting this right determines what your world model knows, and what it doesn't. 🎥 Watch the full version: piped.video/Zti7Q1Xvn_g 📄 Read more: reka.ai/labs/research/world-… #PhysicalAI #WorldModels #DataPipeline #AI #RekaLabs
5
9
27
3,527
Incase you missed this 😇
@KonradJam leads the data platform team at Reka. His job: prepare hundreds of thousands of hours of video data for world model training, keeping pace with a research team that moves fast. In this episode, he and Julian Lopez share how the data pipeline for world model training actually works. Less than 100 people. Petabytes of data. No two days are the same. 📄Learn more about the work we do → reka.ai/news/world-model-dat… #PhysicalAI #WorldModels #DataPipeline #AI #RekaLabs
2
790
🤔What does it take to train an omni world model from scratch? 📽️Petabytes of video. 6⃣pipeline stages. And every improvement in data quality pays off twice when you're training a model that both generates and understands video. Our Reka Labs' data team on how it works → reka.ai/labs/research/world-… #PhysicalAI #WorldModels #AI #RekaLabs
7
24
95
15,269
Built on Ray on Kubernetes @anyscalecompute 🙌
1
1
9
3,546
Today Roberto and Marianna walk through PhysicalRealismBench-U — how the benchmark works, how they built it, and what VLMs still get wrong about basic physics. 🔗 link.reka.ai/labs/physical-r… #PhysicalAI #AI #RekaLabs #ComputerVision #VLM #PhysicalRealismBench
4
8
20
2,094
In this video, @MateuszOnAI and @zaheri_h_r sat down to talk through two questions driving recent Reka Labs research. 1️⃣ Can VLMs understand physics the way we do? 2️⃣ And if an agent uses a world model to choose between actions, does it pick the right one? Two benchmarks, two complementary questions about what it actually means for a model to understand the physical world. Read more on the benchmarks here: 📄 PhysicalRealismBench-U → link.reka.ai/labs/physical-r… 📄 WorldModelGym → link.reka.ai/labs/world-mode…
5
8
29
2,756