Subquadratic launches with $29M to bring 12M-token context windows to AI

Subquadratic Launches SubQ, a 12M-Token AI Model for Long-Context Tasks

“AI memory” has been a euphemism for workarounds, because models can’t actually hold much in context. Transformer attention scales O(n²) (double the input, quadruple the cost), so the industry duct-taped fixes on top: chunk it, summarize it, pre-search it, pray. Subquadratic wants to flush the duct tape. The lab came out of stealth on Tuesday with $25 million in seed funding and launched SubQ, the first commercial LLM built on a fully sub-quadra…

New AI Model 'Subquadratic' Destroys Context Window Records With Clever New Architecture

Subquadratic has launched its first AI model, claiming it can process up to 12 million tokens using a new architecture called Subquadratic Selective Attention (SSA). The company said SSA scales linearly in compute and memory, avoiding the quadratic scaling issues seen in traditional transformer models. Subquadratic also said it plans to release a model with a 50-million-token context window later. Benchmark Claims The startup said its model scor…

Subquadratic launches with $29M to bring 12M-token context windows to AI

Subquadratic, a company developing a novel generative artificial intelligence model, launched today with $29 million in seed funding. The new large language model, dubbed SubQ, uses what the company calls a subquadratic architecture that greatly increases the context window — how much information the AI can read at once — without significantly increasing the amount […] The post Subquadratic launches with $29M to bring 12M-token context windows t…