EXPLORE

The original Transformer paper 'Attention Is All You Need' was rejected from a top conference before becoming the most cited AI paper of the decade.

GPT-3 has 175 billion parameters. If each parameter were a grain of sand, it would fill roughly 7 dump trucks.

The term 'hallucination' in AI was borrowed from psychiatry. LLMs don't see things that aren't there — they confidently generate plausible-sounding fiction.

The attention mechanism in transformers was inspired by human visual attention — how your eyes focus on relevant parts of a scene while ignoring the rest.

A single ChatGPT query uses roughly 10x more energy than a Google search. At scale, AI inference is becoming a significant portion of global compute.

The 'context window' metaphor comes from signal processing, where a window function selects a section of a signal for analysis. In LLMs, it's how much text the model can 'see' at once.