3b1b Talent
More 3b1b Partners

Exa

Apply

About

Exa's research vision is "Attention Over Everything." How do we attend over the world's 100 trillion tokens, at sub-200ms speed, to find the right information?

To start, we build massive-scale infra to crawl the entire web, train state-of-the-art language models to process it, and design super high performant vector databases to retrieve over it. We're building a search engine unlike the world has ever seen, and power search for Cursor, Cognition, HubSpot, and over 400,000 developers.

Our team is small, talent-dense, and driven by the mission of responsible and complete information infrastructure for humanity. If we can achieve perfect search so that every AI has the highest quality information, then every human will too.

Image
ImageImage

A technical challenge for the 3blue1brown audience

Exa's research vision is "Attention Over Everything." How do we attend over the world's 100 trillion tokens, at sub-200ms speed, to find the right information?

In that spirit, a small puzzle below: a message is hidden in a librarian's scroll. Can you follow the historical clues, find the important tokens, and decipher its meaning?


The Library of Alexandria existed for centuries. It served knowledge to citizens of the world and provided answers to all types of queries far and wide. A librarian, grey and weary, looked after the scrolls, and loved each and every one equally.

In 48 BCE, there was one final query delivered to the Library of Alexandria. It was a warning…

The library is soon to perish. Read only the most important words from your scrolls and use them to inscribe and deliver one message to the world. Enemies will find you. They must think your message is nonsense at first glance. Know how importance is reckoned: a word is important if important words stand near it. You can hold eighteen words in mind at once; two words within that span are joined. Joined or not joined. Cast out words that are just connectors before you begin. When the reckoning settles, save the eighteen worth most, and speak them in the order the scroll first spoke them.

And that's all we knew, until, on June 30th, 2021, the librarian's answer was finally found. One scroll of eighteen lines, found in front of a sign: ΕΞΑ.

If you can solve it, we'd love to hear from you.

Submit a solution

Better RL agents with Exa as their search backend

Agents trained with Exa as the search backend during reinforcement learning reach higher performance with less training compute.

ImageRead the post

Dynamic Highlights: 95% fewer tokens

Given a search query and a set of URLs, Exa's Dynamic Highlights model retrieves the tokens that matter and reduces token usage by 95%.

ImageRead the post

WebCode: evals for coding agents

Exa built WebCode, an open-source eval to measure web search quality for coding agents.

ImageRead the post
ImageImage

What our team says

What you do at Exa is only constrained by your appetite. There is an infinite backlog of interesting problems to work on and an amazing team to tackle those problems with. And I've always really enjoyed software engineering from a very young age. So it's a really nice place for someone like that.

— Miguel Brandão, Engineer