r/LocalLLaMA • u/FormalAd7367 • 23h ago
Discussion why does OpenAi buy Mac mini?
i just don’t see the use case for them. other than web crawling ?
18
u/OkFly3388 llama.cpp 23h ago
Because its cheaper for them to buy all macs now then let users have self hosted alternatives in future.
2
u/Practical-Collar3063 21h ago
I think we assume that we are much more important than we are, I think your comment is probably at least partially sarcastic but if it is not, I don’t think the people running local models « hurting » their profits are even considered by big AI
1
u/OkFly3388 llama.cpp 17h ago
They are forced to keep price low only because competition exists, thats just how market works.
They sure trying to lobby for protection against Chinese models and at the same time they trying to destroy local alternatives.
When all of this will be done, both api and subscription price will skyrocket.
1
u/Practical-Collar3063 8m ago
They sure trying to lobby for protection against Chinese models and at the same time they trying to destroy local alternatives.
Those are 2 completely different concepts and on very different tiers of priority for OpenAI or Anthropic. They are 100% trying to derail Chinese efforts because they are loosing customers to Qwen, DeepSeek or Kimi. However, they are loosing customers due to API pricing not really to the people running AI models locally. We are niche, those big corpos do not consciously cater nor hinder niches, it is a waste of time for them. We are not important to them, we just catch stray bullets
1
u/Green-Rule-1292 22h ago
The funny thing is that people still won't need proprietary LLM gatekeepers such as OpenAI in the future so they won't ever be able to do anything more than delaying the inevitable a few years at best.
The sad thing is that it might just be enough for them to survive their IPO and get their dirty little hands on new funds to keep financing their BS for several more years...
11
9
u/Infamous-Bed-7535 23h ago
Maybe they just want to push further the prices of products that could serve capable local models, so more people choose to use their services until IPO..
8
u/ImportancePitiful795 22h ago
So you won't be able to run LLM at home. Same thing is doing with buying 50% of the DRAM waffers from Samsung & SK Hynix, just storing them in a warehouse, so other companies won't be able to build servers, or you a larger server at home.
3
u/misha1350 22h ago
Because they're run by completely tech illiterate people with no sense of how finances work.
Small wonder the chinese unicorns create killer models and run them on domestically produced cheap hardware. OpenAI and Anthropic won't be around for long.
5
u/Nice_Cellist_7595 23h ago
MacOS is the only way to get access to things like "blue" texting and accessing certain aspects of the Apple eco system. See the announcement about Chat GPT being able to use iMessage.
5
6
u/MrCatberry 23h ago
My guess: So nobody else can buy them before them.
I really believe that Sam Altman is an asshole at this point that just wants to make sure he slows done every competitor (this includes the local guys) until he can figure out a way to make his own LLM profitable in any way.
In my opinion that ship has sailed and he just wants scorched earth now.
2
1
1
u/revolverXD 22h ago
Maybe they want the ram
Maybe it's a denial tactic
The mac mini can be used for local inference
2
u/BothYou243 22h ago
openAI won't use datacentres but mac mini for inference. Good, fair point
well done
1
u/Ok_Cow1976 20h ago
Yeah, they build or buy datacenters because there aren't enough mac mini to buy and run.
1
0
u/BothYou243 22h ago
"They'll scrap 16Gigs cards from each one of them, and combine them to make a bigger one" wow dude, you're genius
2
u/vogelvogelvogelvogel 23h ago edited 22h ago
imo energy efficient inference compared to nvidia
edit because of questions: 4090 i have about 400-500W with 50-70, sometimes 100t/s with qwen3.8 at q4; on the mac 't pro 64 at 33-40W 27t/s with qwen3.8 at q6 and q8 and qwen flash next, quite consistent
2
u/Embarrassed-Noise269 23h ago
Is it though? Afaik Nvidia is still best when it comes to tokens per watt. I don't have any source at hand, it's more top of my head from what I read the last couple of months.
I guess there could be a nice setup with Nvidia GPUs doing the prefill and the Macs are handling the token generation. Not sure how viable that is.
1
u/myidispg 22h ago
I don't know if it's token/watt. Nvidia GPUs are definitely faster but not sure about energy efficiency.
1
1
u/myidispg 22h ago
I also think that Apple M Series devices are extremely energy efficient as compared to other alternatives. Atleast for the end user devices they sell. And compact also.
1
0
u/IngwiePhoenix llama.cpp 22h ago
Because it runs AI. And thus it is useful to them.
What else were you expecting?
0
u/RedditCryptoGuy 22h ago
They're not only buying Mac Mini's, they're buying all the possible hardware that will be relevant for the next 3-5 years for LLMs
0
u/benson_c8 18h ago
apple silicon is power efficient for inference compared to nvidia gpus.. at scale the electricity savings alone justify it for certain workloads
25
u/tat_tvam_asshole 23h ago
It's for creating training data for computer use.