OpenInfer, an AI Agent Engine with a cross-hardware OS, democratizing real-time intelligence, efficiency, and privacy
San Francisco, CA, USA
- Tweets 35
- Following 33
- Followers 98
- Likes 26
Over-provisioning works well for predictable traffic as @ylecun and others shared.
The Agentic traffic needs more manageable traffic, an operating system that can manage ai traffic.
check our coverage on Intel: intel.com/content/www/us/en/…
Anthropic’s most capable model is not becoming its default model.
Fable 5 has plateaued at ~11% of @AnthropicAI spending across 70,000 companies (ref: @tryramp data @FT)
This looks less like weak AI demand... more like workload segmentation / routing. Enterprises used to default to the best model. Now they send cheap tasks to cheaper models and reserve frontier models for the work that needs them.
Right model for the right task. This is good for enterprise AI adoption... makes @patrickc @stripe's timely acquisition of @OpenRouter look even smarter.
@openInfer (early investor) takes same optimization logic below model layer: mapping inference workloads to the right hardware across cloud, on-prem & edge cc @bastani_behnam @RezaNourai
1
137
Anthropic’s most capable model is not becoming its default model.
Fable 5 has plateaued at ~11% of @AnthropicAI spending across 70,000 companies (ref: @tryramp data @FT)
This looks less like weak AI demand... more like workload segmentation / routing. Enterprises used to default to the best model. Now they send cheap tasks to cheaper models and reserve frontier models for the work that needs them.
Right model for the right task. This is good for enterprise AI adoption... makes @patrickc @stripe's timely acquisition of @OpenRouter look even smarter.
@openInfer (early investor) takes same optimization logic below model layer: mapping inference workloads to the right hardware across cloud, on-prem & edge cc @bastani_behnam @RezaNourai
1
2
334
𝗢𝗽𝗲𝗻𝗜𝗻𝗳𝗲𝗿 𝗖𝗹𝗼𝘂𝗱 is live.
Inference is overprovisioned by design. GPUs get statically pinned to models, so capacity sits idle every time traffic dips, and you pay for all of it.
Operating systems fixed this for CPUs decades ago. We're the first inference OS to do it for AI: schedule dynamically, oversubscribe safely.
More tokens per GPU. Lower cost per token. Same quality.
Point your app at it and go. Free through Aug 31.
openinfer.io/cloud
#inference #cloud #inferenceos
1
69
OpenInfer retweeted
Two years ago we built @openInfer around CPUs being central to agentic AI.
Everyone said we were wrong.
NVIDIA just shipped "the CPU for agents."
@intel's CEO called the CPU "the indispensable foundation of the AI era."
CPU:GPU ratios moving from 1:8 → 1:1.
The ground moved.
openinfer.io/news/2026-06-09…
#openinfer #inference #heterogenous
1
2
4
289
OpenInfer retweeted
60 days. Three deals. One bet: agentic inference will not run on one chip.
→ Feb 24: Intel Xeon + SambaNova
→ Mar 13: NVIDIA Rubin + Groq LPX (disaggregated inference)
→ Last week: Meta + millions of AWS Graviton CPU cores
Three stacks. Three processor mixes. One pattern.
━━━━━━━━━━
NVIDIA said it bluntly: "prefill and decode place different demands on hardware." Layer agentic behavior on top (tool calls, planning, retrieval, verification, multi-agent coordination) and the demands shift again on every step.
The future of AI infrastructure isn't more GPUs. It's more kinds of compute, coordinated across a topology.
━━━━━━━━━━
Three things change once multi-processor agentic inference is the default:
→ Accelerator door opens. Every credible silicon player gets a seat.
→ Tail latency becomes an architectural decision, not a tuning problem.
→ Scalability shifts axis. Agentic inference > model inference.
━━━━━━━━━━
At @openInfer we call this vertical disaggregation. First proof point: Intel Xeon CPU + NVIDIA GPU. +50% capacity, zero additional GPUs.
The harder problem is dynamic workloads, multiple models, across aggregated hardware.
That's what agentic inference actually is:
multiple SLAs, multiple models, dynamic behavior changes, served by multiple compute topologies.
→ Intel: CPU + accelerator layer
→ NVIDIA: GPU + LPU layer
→ Meta: CPU layer
→ Next race: the orchestration layer that knits them together
Sources:
Intel + SambaNova: newsroom.intel.com/data-cent…
NVIDIA Groq 3 LPX: developer.nvidia.com/blog/in…
Meta + AWS Graviton: aboutamazon.com/news/aws/met…
Vertical Disaggregation (OpenInfer): openinfer.io/news/2026-04-20…
#A
1
1
3
210
RT @bastani_behnam: We just published how we unlocked +50% inference capacity on a 27B model — no new GPUs, no new nodes, at a fraction of…
25
We got +50% inference capacity on Qwen 3.5 27B.
no new GPUs. no new nodes.
just stopped ignoring the CPU.
openinfer.io/news/2026-04-20…
81
OpenInfer retweeted
@AnthropicAI's @openclaw Restrictions Exposed a Deeper Infrastructure Problem. OpenInfer Is the Fix and its free.
We at @openInfer unlock and round background agents to hardware topologies that are designed for them: same model, fraction of the cost. Drop-in replacement. Zero code changes.
FREE beta live now
openinfer.io/beta
discord.gg/sBQSSXue
#openinfer #openclaw #anthropic #agenticAI
1
1
2
150
Come and Try out our Beta (FREE): OpenClaws Restriction is Fixed
We are opening up our Beta (openinfer.io/beta) hosting openClaw background task on lower end, complex cloud topologies, demonstrating value of an inference system built the agentic world.
1
178
We have building the infrastructure for Agentic flow in mind. What we saw with @AnthropicAI announcement is a demonstration that agents need to be treated differently than conversational ai
probably an infra that is built for agentic applications. thoughts? something we have been cooking @openInfer
100
OpenInfer retweeted
probably an infra that is built for agentic applications. thoughts? something we have been cooking @openInfer
1
209
OpenInfer retweeted
@OpenAI tripling revenue. @AnthropicAI at $14B ARR. @nvidia at $130B.
Who's paying? Enterprises.
But change is coming — cheaper AI, new competitors, margin compression. Some companies will get devalued. Others will explode.
That's exactly why we built @openInfer
Featured in @CIOonline
cio.com/article/4137678/ai-r…
1
2
65
The "wow" phase of AI is over. We’ve entered the era of 𝗣𝗿𝗮𝗰𝘁𝗶𝗰𝗮𝗹 𝗔𝗱𝗼𝗽𝘁𝗶𝗼𝗻.
I’m excited to share my latest interview with @technewsworld. Special thanks to @jpmello for the great conversation on @OpenAI's 2026 strategy.
Key focuses: 𝗔𝗜 𝗮𝘀 𝗜𝗻𝗳𝗿𝗮𝘀𝘁𝗿𝘂𝗰𝘁𝘂𝗿𝗲: Moving from novelty to a foundational operating layer. 𝗔𝗴𝗲𝗻𝘁𝗶𝗰 𝗙𝘂𝘁𝘂𝗿𝗲: AI agents solving real-world problems in health and science. 𝗗𝗲𝗹𝗶𝘃𝗲𝗿𝗶𝗻𝗴 𝗥𝗢𝗜: Scaling to meet global enterprise needs.
Now, the real work of transforming how the world functions begins—driven by the need for transformational infrastructure and @openInfer 𝗯𝘂𝗶𝗹𝗱𝗶𝗻𝗴 𝗶𝗻𝗳𝗿𝗮 to support this new era.
Full interview: technewsworld.com/story/open…
#OpenAI #openInfer #AI #TechTrends #openinfer @TechNewsWorld
73
𝗜𝗻𝗳𝗲𝗿𝗲𝗻𝗰𝗲 𝗶𝘀 𝗮 𝘀𝘆𝘀𝘁𝗲𝗺 𝗽𝗿𝗼𝗯𝗹𝗲𝗺, 𝗻𝗼𝘁 𝗮 𝗺𝗼𝗱𝗲𝗹 𝗼𝗻𝗲.
This is the shift we are building OpenInfer for.
#openinfer #edgeai #inference
𝗧𝗵𝗲 𝗻𝗲𝘅𝘁 𝗔𝗜 𝗰𝗼𝗺𝗽𝘂𝘁𝗲 𝘀𝗵𝗶𝗳𝘁 𝗶𝘀 𝗶𝗻𝗳𝗲𝗿𝗲𝗻𝗰𝗲.
Edge data is exploding.
Inference must move to data.
This requires a ground-up system, not a model upgrade.
NVIDIA + Groq is an early signal.
2026 is when inference infrastructure becomes the battleground.
100
OpenInfer retweeted
🎙️ New Podcast Episode
I joined The Software Leaders UNCENSORED Podcast to talk about why the future of AI is at the edge and how we are building OpenInfer to make reliable, secure, and energy efficient physical AI possible.
Here is what I cover:
• How my experience across @Meta , @Google , and @Roblox shaped @openInfer's edge first mission
• Why AI needs to run where data is created and how our unified stack makes that real
• How we push innovation through custom inference and system mementos to bring datacenter level AI to the edge
• What I learned from 250 enterprise leaders on why most AI projects fail
• How to stay ahead in a field that changes every 90 days
Full episode link in the comments.
#AI #openinfer #edgeai #inference
1
1
1
89
Imagine a world physical AIs could recall the past, could come together and build a stronger reasoning.
To make inference happen on edge, Memory Constraints needs to be addressed as a system architecture (HW+SW).
@openinfer is sharing a glimpse of what is possible if an edge system is designed to recall the past.
Check us out openinfer.io/demos/mementos/
#openinfer #physicalai #inference #edgeai
Bringing inference to edge requires massive innovation around Memory system.
Restructuring how inference on edge should be run, we are sharing a capability to remove the lack of meaningful on-device memory.
Our latest release lets models hold persistent context, reason over larger spans, and collaborate intelligently. all running locally on the OpenInfer engine.
This is how we break past edge memory limits.
🔗 openinfer.io/demos/mementos/
#edgeAi #openinfer #mementos #inference
2
81
OpenInfer retweeted
Bringing inference to edge requires massive innovation around Memory system.
Restructuring how inference on edge should be run, we are sharing a capability to remove the lack of meaningful on-device memory.
Our latest release lets models hold persistent context, reason over larger spans, and collaborate intelligently. all running locally on the OpenInfer engine.
This is how we break past edge memory limits.
🔗 openinfer.io/demos/mementos/
#edgeAi #openinfer #mementos #inference
1
1
144
Exciting news: OpenInfer is now proudly part of @MicrosoftforStartups and @IntelPartnerAlliance!
Together, we’re accelerating the future of #EdgeAI - bringing intelligence to every physical surface, from cloud to edge.
Low latency, limited bandwidth, offline-ready, and zero cloud cost!
openinfer.io/news/2025-10-27…
#EdgeAI #IntelPartnerAlliance #MicrosoftforStartups #BuiltwithMfS #openinfer
1
2
95
Imagine your memory, amplified by AI. 🤯 What if enterprise assistants could remember, recall & act privately, without the cloud?” openinfer.io/ideathon-sept25
#edgeai #openinfer #mementos
2
2
3
648