r/technology • u/ControlCAD • 15h ago

Security Linux kernel nears record 2,000 vulnerabilities per release as AI bug hunters scour 40 million lines of code — maintainers say they are "completely overwhelmed" by CVE finds

https://www.tomshardware.com/software/linux/linux-kernel-nears-2-000-cves-per-release-as-ai-bug-hunters-scour-40-million-lines-of-code-maintainers-say-they-are-completely-overwhelmed
1.7k Upvotes

96% Upvoted

274 comments sorted by

View all comments

Show parent comments

-2

u/Legionof1 14h ago

The Linux kernel is roughly 40m lines of code, there are context windows big enough for that… what you can buy and what exists are also two massively different things. 

3

u/MartinMystikJonas 14h ago edited 13h ago

No there are no contsxt windows big enough for that. Frontier models have 1M tokens. That is about 100k lines of code. So you are about two orders of magnitude off. And I doubt we will se LLM with such context window anytime soon because compute required to generate token scales by power of two with context window size. So 100x bigger context would require 10 000x times more compute for every token. Not to mention you would need completely new hardware architecture to be able to scale by 4 orders of magnitude on singke machine or accept distributed computing delay that will slow down token generation about 1000 times (so you can expect one token every few months tops) .

0

u/Legionof1 13h ago

https://codingscape.com/blog/llms-with-largest-context-windows

2

u/MartinMystikJonas 13h ago

Yeah you can trade bigger context window for big rediction in capabilities to stay in resonable compute times and do not care recall would be terrobible (by using limited attention size). But that is not what you need if you trying to decode machine code.

1

u/Olangotang 13h ago

Context window doesn't matter when it comes to context rot, which starts around 50k for all models. The attention mechanism gets overwhelmed and drops information in the middle.

This is yet another weakness of LLMs that the hype bros need to ignore along with the other dozen issues with the bubble 😁.

1

u/MartinMystikJonas 13h ago

Frontier models moved it a bit higher but we are still in range of few hundreds of thousands tops before recall drops significantly.

1

u/Olangotang 13h ago

There's only so much you can do when you are weighing an increasing amount of words against one another.