r/LocalLLM • u/Cp_SparroW • 1d ago

Discussion Llm local run

Can i run 32 gb ram ddr5 laptop

In run 27b llm run?

0 Upvotes

43% Upvoted

8 comments sorted by

1

u/Deep_Mood_7668 1d ago

On cpu? Yeah. Veeeeeeery slowly, but yes

1

u/Cp_SparroW 1d ago

ASUS ROG Strix G18 18" 300Hz HDR Gaming Laptop - Intel Core Ultra 9 290HX Plus - 16GB DDR5 - 1TB SSD - RTX 5060 - Windows 11 Home - Eclipse Grey This laptop

1

u/Deep_Mood_7668 1d ago

You said 32gb? Anyway.

How much vram do we have in the 5060?

1

u/Cp_SparroW 1d ago

I don't know how much in this model how to find

1

u/OddRefrigerator4714 22h ago

5060 should have 8

1

u/gundamcs 1d ago

On CPU try MoE models

1

u/vinotok 1d ago

Yes, you can. I'm just testing, playing with Qwen 3.8-27B-GSQ-RCO, IQ3_XXS from ISTA-DASLab (about 10GB file size, uses about 15-16GB memory) - no VRAM here just 32GB RAM, takes a few hours for each prompt, (about 2 tokens/second) but hey, I would need several weeks for the same thing to do it myself and it would be way worse quality ;-) If speed is not a concern, then you are good.

1

u/jacek2023 18h ago

yes run, but no fun ;)