OpenAI’s Jalapeño chip, which it claims is better than Nvidia’s Blackwell chips at AI inference, is good in part because its Sol and Astra models helped with the design and software process.
And Google’s tensor processing unit team credited its DeepMind researchers for using AI to help make TPU v8, its latest chips, 6% more power efficient and also 6% more powerful.
Nvidia of course has also leaned into AI-driven chip design, with an array of software libraries that apply AI to everything from the stencil layout for how circuits are lasered onto a chip to how data moves between the millions of microscopic parts of a chip.
Design startup Agentrys, which on Wednesday announced it has raised $25 million, aims to help chip designers use AI agents to automate the process and teach chip designs to improve themselves...the best-known of the group is Ricursive, which notched a $4 billion valuation in February.
A company that previously needed 100 or more engineers to design a particular chip can now, thanks to AI, design a chip with similar capabilities with just 30 to 40 people or twice as fast, he said.
Presumably Anthropic is doing something similar. AI lends itself really well to things with a lot of structure and defined outputs. Just like most things involving AI, it's a race to functional scale. Tokenmaxxing itself is inherently stupid, but aggressive, thoughtful R&D, a tight feedback loop, and rebuilding your knowledge process is smart could separate the winners from the losers pretty fast.
As a lot of knowledge work gets amplified or replaced by AI, there could be some big shifts in the pecking order of a lot of knowledge-based companies, especially for companies and people whose main value was based on sitting on a lot of it either in direct form or applied functionality. The time to scale knowledge or applied representations of it will shrink considerably. Knowledge-based moats like software, patents, IP, etc. might not go away, but they are starting to narrow.
Keep in mind Palantir's Karp's warning:
https://x.com/PalantirTech/status/2072114267776491695?lang=en
Controlling your weights is controlling your fate. Weights are the distilled form of hard-won, accumulated institutional knowledge. If you let others control your weights, you are allowing them to migrate the alpha of your business to theirs.
There is no contradiction between sovereignty and alpha. The architecture that maximally preserves sovereignty is one that enables institutions to own their tribal knowledge, and to compound it as alpha.
I'm curious if frontier labs will move beyond just token pricing into something like a revenue share across industries. Lower floor but much higher ceiling.