r/LocalLLaMA • u/SavunOski • Jul 27 '26

News Kimi K3 weights now released.

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

97% Upvoted

661 comments sorted by

View all comments

Show parent comments

56

u/VeterinarianOne1349 Jul 27 '26

Doesn't really work that well. This 550k setup wouldn't allow a lot of developers to work in parallel, while sitting idle during non-work hours. Makes much more sense to pay a 3rd-party to host and pay per token.

40

u/crusaderky Jul 27 '26

waiting for large corpos to rent their hardware on vast.ai during nighttime, only to find the next morning that someone ran a container jailbreak and ran wild on their private networks

2

u/aeroumbria Jul 28 '26

Yea, principle of lowest viable distributed scale!

7

u/[deleted] Jul 27 '26

[removed] — view removed comment

6

u/ProgrammersAreSexy Jul 27 '26 edited Jul 27 '26

I'm sure you will be able to run a model like kimi k3 at home, probably in much less than 5 years.

However I think it's unlikely that there will be a point in time at which the frontier models of that point in time will be runnable at home.

6

u/[deleted] Jul 27 '26

[removed] — view removed comment

6

u/a-wiseman-speaketh Jul 27 '26

He means we'll get frontier model capability on a lag, probably months before it fits in even prosumer hardware.

That might be pessimistic though, I think right now scaling up parameters is the best lever for intelligence but that might not be the case forever.

3

u/Maleficent_Sir_7562 Jul 27 '26

but kimi is frontier

1

u/ProgrammersAreSexy Jul 27 '26

Oh, and can you run it at home?

2

u/Maleficent_Sir_7562 Jul 27 '26

No

That’s the point

Your comment is contradictory

“You can run Kimi k3 in home soon”

“But I think the current frontier models can’t be ever”

But k3 is the frontier

1

u/ProgrammersAreSexy Jul 27 '26

I think my phrasing was just unclear, edited

2

u/eightbyeight Jul 27 '26

They might pay a aws/gcp/azure to run it on their private cloud. But I doubt they will just buy access from a random third party.

1

u/VeterinarianOne1349 Jul 28 '26

yeah, cloud providers would be that 3rd party...

1

u/eightbyeight Jul 28 '26

As in they will pay the ec2 price and run their own model 24/7 instead of per token.

1

u/Bakoro Jul 28 '26

What company/developer these days wouldn't be setting up agents to be working overnight?

Besides, a lot of companies are international, the latency would suck, but they could be having people in Europe or India using the hardware while the U.S workers are asleep.