OpenAI Shelves GPT-6.1 Astra Release Over Safety Fears, Day Before DevDay
We test the top AI tools for writing, video, images & music — so you don't have to.
Explore AI Tools

AI agents are only as smart as the data they can reach. Ask one to compare prices, summarize research papers, or dig up company filings, and it hits the same wall a human would — except it can't open 40 tabs. That's the problem Firecrawl just got $75 million to solve.
Firecrawl is a tool for developers that turns messy websites into clean, structured data AI can actually use. Instead of writing a custom scraper for every site, developers send a URL to Firecrawl's API and get back tidy text, Markdown, or JSON. It's the plumbing underneath a lot of AI products you've already used without knowing it — more than 1.5 million developers build with Firecrawl, and companies like Shopify and several large hedge funds use it for lead generation, price monitoring, and market research.
This week Firecrawl launched Alexandria, a bigger idea: a library where AI agents can ask questions directly instead of scraping pages. Alexandria works like a router — an agent asks a question, and Alexandria decides the best place to find the answer: official data providers under paid agreements (like Wikimedia Enterprise), Firecrawl's own indexes, or the live web. Those indexes are serious: a Research Index of tens of millions of scientific paper abstracts, a Developer Index of documentation, READMEs, and code issues, and a Government Index of laws and regulations. At launch, Alexandria connects to 82 data providers across 28 categories — finance, government, code, shopping, real estate — with over 113 million documents, papers, and READMEs.
Here's the part that could change the industry. Firecrawl says it will use "a good chunk" of the $75M to buy knowledge — paying official data providers (it already pays Wikimedia Enterprise) and eventually letting individuals and publishers earn money when agents use their data. In a world where AI companies keep getting accused of scraping for free, a model where the people who supply the knowledge get paid is a big deal.
Data is becoming AI's new battleground. Firecrawl's internal tests say agents using Alexandria answer 21% better than with built-in web tools. The round was led by Smash Capital, with Y Combinator, Altos Ventures, Nexus Venture Partners, Freestyle, and Offline Ventures joining in. If agents are the future of software, whoever owns the library they read from holds a powerful seat at the table.
Comments
Post a Comment