Co-founder and CEO @firecrawl ️‍🔥 Prompting humans and machines. Be the best version of yourself.

San Francisco
Excited to announce @firecrawl's $14.5M Series A 🔥 We've grown 15x in the past 12 months. The demand for clean web data in AI is real. Here's the story of how we built the web data layer for AI - starting from a side project to powering how 350k+ builders get web data 🧵
66
22
513
122,404
This is big
Introducing Alexandria in Claude. Access over 100 data providers and 113M+ indexed sources easily through Firecrawl. Agents using Alexandria score 21% higher on answer quality than those using built-in web tools. Get started using the Firecrawl connector today!
2
2
25
2,542
Jev is insane
Introducing Jev + Firecrawl Alexandria. We pulled data on every Fortune 1000 company, then Jev analyzed it in 3.6 seconds. With 100+ data sources, there's so much more to work with. Alexandria is live now for anyone using Jev and beyond!
3
1
39
6,525
We're using a swarm of agents to catalog the internet. We're calling it Alexandria. It's live today Search boxes were shaped around human limits. Models are smart enough to navigate a catalog. They don't need a new Google. They need a library
Introducing Alexandria. We raised a $75M Series B led by Smash Capital to build the world’s largest knowledge library for superintelligence. Supercharge your agents with instant access to the most powerful data sets & providers. firecrawl.dev/alexandria
12
6
55
6,293
A catalog shows its own holes. Demand tells us what's missing and what it's worth. Then we fill it
1
2
127
Where this leads: a fast-growing catalog of human and AI-discovered knowledge, used and maintained by agents The Library of Alexandria was built for the greatest minds of its time We're building for the greatest minds yet to come
2
93
Its SI, not AI @realDonaldTrump
Introducing Alexandria. We raised a $75M Series B led by Smash Capital to build the world’s largest knowledge library for superintelligence. Supercharge your agents with instant access to the most powerful data sets & providers. firecrawl.dev/alexandria
1
1
13
1,752
Caleb Peffer (Hiring!) retweeted
Superintelligence isn't coming. It's here. We're building the largest library of knowledge intelligence, designed for a future where intelligence is on tap
Introducing Alexandria. We raised a $75M Series B led by Smash Capital to build the world’s largest knowledge library for superintelligence. Supercharge your agents with instant access to the most powerful data sets & providers. firecrawl.dev/alexandria
4
8
38
4,716
🚪
The doors open tomorrow 🏛️
1
5
1,610
Your coding agents need the best knowledge
Coding agents rely heavily on search tools to find the answers they need. But which tools actually help them find the right sources? Today we're open sourcing DevDex, a benchmark for how reliably search tools find what a coding agent is looking for. firecrawl.dev/benchmarks/dev…
1
15
896
Firecrawl is free with our Keyless plan
We just killed Exa, Tavily, SerpAPI, and Brave. Your agent can now search & fetch any webpage for 100% FREE. Them: $7 per 1,000 searches. Us: $0. No subscriptions, no quotas. Humans search Google for free. Agents shouldn't have to pay either. Made possible by @Tiny_Fish and @MonidHQ.
6
1
68
7,595
ok ok we can rewrite every program better with AI what are some of the coolest AI rewrites?
2
2
682
For a relative noob How much better is pgrust now? why should i use it?
In @pgrustdb, @JasonSeibel and I built a solution to one of the most common causes of Postgres outages: runaway queries. pgrust can selectively throttle queries. By default, we deprioritize long running queries, preventing one big long running query from taking down your db
1
3
2,345
At sf tech dinner host: "what is your controversial take about AI?" 60% of people: "we think open models are going to be the ultimate winners" This is a very consensus take
going to spoil the ending: - chinese or other open weight models end up handling 99% of all inference, maybe 99.99% - frontier models are still able to monetize at $100 s of B in revenue a year, applied to bespoke and enormously complex tasks - labs internalize most or all of that revenue either by becoming biotech (etc) companies themselves or via JVs with selected winners in each industry - the "public frontier" ends up lagging the true frontier by a year or more as the labs keep all the good stuff to themselves
4
12
1,828
Hello startups!
Excited to announce our new @firecrawl startup deal! More companies are being founded than ever & we want to power every one of them. Now startups get 2x their monthly credits for a full year (up to $30k), plus a Slack channel with our team and swag. firecrawl.dev/startups
2
19
1,553
Introducing the Firecrawl CTF V3 🔥 60 problems total, and you only have 4 seconds to solve each. We're building a team of the top agent orchestrators in the world. Solve it and you might be one of them. ctf.firecrawl.dev
17
14
136
52,395
Caleb Peffer (Hiring!) retweeted
My mom is scared/angry about a data center that might open 10 miles away in the next county over in Virginia (land of data centers). She has a bunch of the usual arguments—all basically factless—that she’ll hear noise at her house, it’ll use up all the water in the river, somehow her taxes will go up(?!) When pressed on comparing it to a metalworking factory, she essentially accepted that her specific facts/arguments aren’t super justified… but that she just didn’t want any new data centers in the region. This is clearly based on vibes, but I can’t tell what the actual fear is… because even after accepting that the individual arguments are dumb, there’s still something “scary” about it. Is it as simple as: people she trusts and respects in her political tribe are railing against it, so now she is too?
A data center is almost comically tame as industry goes. No smokestacks. No ore piles. No molten steel. No freight trains of coal. Mostly a very large box containing computers, electrical equipment, cooling systems, and an expensive humming noise. And even this is apparently too industrial for us.
215
123
2,492
236,060
Caleb Peffer (Hiring!) retweeted
I maintain my position that investor updates are dumb. Either you have a small group of investors and you keep them updated informally and / or via board meetings. Or a long list of investors in which case you’re sending a forwardable email with all your company metrics?
19
9
189
22,516
Lets fucking gooo
Introducing Firecrawl Developer Index, an index for supercharging coding agents. Search 70M+ primary sources including repos, docs, & issues with the highest recall of any coding-specific index. Ensure agents ship correct, up-to-date code every time! firecrawl.dev/developer-inde…
1
23
4,774