Apple Reportedly Building M2 Ultra and M4-Powered AI Servers

Apple has started building its own AI servers that use the M2 Ultra chip, Haitong analyst Jeff Pu reports.

Apple Silicon AI Optimized Feature Siri
Pu provided the analysis based on supply chain checks in a new note to investors seen by MacRumors. Foxconn is said to currently be assembling Apple AI servers that contain the ‌M2‌ Ultra, with plans to assemble AI servers powered by the M4 chip in late 2025. Last month, a reputable source on Weibo said that Apple was working on processors for its own AI servers made with TSMC's 3nm process, targeting mass production by the second half of 2025, which may line up with this report about M4-powered AI servers.

Apple's decision to build its own AI server is reflective of the company's ongoing strategy to vertically integrate its supply chain. Apple will likely use its own chips to enhance the performance of its data centers and future AI tools that rely on the cloud.

While Apple is rumored to be prioritizing on-device processing for many of its upcoming AI tools, it is inevitable that some operations will have to occur in the cloud. By the time M4-based servers could be operational in data centers, Apple's new AI strategy should be well underway.

In line with broader industry expectations, Pu also expects Apple to announce on-device AI features at WWDC in June, such as audio recording summarization, photo and video editing, and live translation. While the iPhone 16 lineup will tout a range of AI features, 2025's iPhone 17 models will apparently be more focused AI devices.

Popular Stories

iPhone 17 Plus Feature

iPhone 17 'Slim': Everything We Know So Far

Friday July 5, 2024 5:13 am PDT by
In 2025, Apple is expected to discontinue the iPhone "Plus" device in its iPhone 17 lineup to make way for an iPhone "Slim" – although it may not actually be called this when it debuts in the fall of next year. Even though the iPhone 16 series launch is still over two months away, when you consider that we learned about larger displays on the iPhone 16 Pro models way back in May 2023, rumors...
iPhone 16 Camera Lozenge 2

Apple Leak Confirms Four iPhone 16 Models With Same A18 Chip

Tuesday July 2, 2024 9:48 am PDT by
Code discovered in Apple's backend by Nicolás Alvarez and shared with MacRumors confirms Apple's plans to release four iPhone 16 models this year, and it indicates that the devices will all have the same A-series chip. There are mentions of new model numbers that are not associated with existing iPhones, and that have the numbering scheme Apple uses for its flagship devices. The code...
f1662570472

Report: Apple Watch Series 10 to Offer Larger Screens and Faster Chip, but New Health Features in Trouble

Sunday July 7, 2024 8:31 am PDT by
The Apple Watch Series 10 will feature a larger display and a new chip, but new health monitoring features for the device are now in question, Bloomberg's Mark Gurman reports. In the latest edition of his "Power On" newsletter, Gurman said that the design of the Apple Watch Series 10 is "unlikely to look much different" to its predecessor, but it will be thinner. Meanwhile, the Apple Watch...
macbook pro blue

Best Buy Takes Up to $500 Off M3 MacBook Pro in New Sale

Sunday July 7, 2024 10:40 am PDT by
Best Buy this weekend is offering a big selection of discounts on Apple's late 2023 14-inch and 16-inch MacBook Pro, with up to $500 off select models. These deals are available to all shoppers and do not require a My Best Buy Plus or Total membership. Note: MacRumors is an affiliate partner with Best Buy. When you click a link and make a purchase, we may receive a small payment, which helps...
HomePod G4 Feature

Leak Confirms Apple's Work On 'Home Accessory'

Thursday July 4, 2024 9:15 am PDT by
Code discovered on Apple's backend by MacRumors confirms Apple is indeed working on a long-rumored home accessory in addition to the HomePod and Apple TV. The code references a device with the identifier "HomeAccessory17,1," which is a new identifier category. The name is similar to the HomePod's "AudioAccessory" identifier. Interestingly, the 17,1 in the identifier name suggests that...

Top Rated Comments

CWallace Avatar
9 weeks ago
Makes sense for them to leverage their own hardware, especially if their AI implementation is designed around their neural engine and GPU designs as opposed to "commodity / off-the-shelf" hardware.

And I do not expect Apple to offer these servers at retail, so this is not the "return of the Xserve".
Score: 17 Votes (Like | Disagree)
257Loner Avatar
9 weeks ago
There is only one reason Apple is making their own AI servers: to avoid paying Nvidia billions of dollars!
Score: 14 Votes (Like | Disagree)
Think|Different Avatar
9 weeks ago
Cannot wait to see what they do in this space! WWDC is gonna be a good one.

Attachment Image
Score: 9 Votes (Like | Disagree)
gank41 Avatar
9 weeks ago
Would be amazing if Apple started offering a newer version of their Xserve lineup again.
Score: 9 Votes (Like | Disagree)
TallGuyGT Avatar
9 weeks ago
If they're using M2 Ultras, I hope that means they're saving the M4 Ultras for a Mac Studio / Pro release at WWDC 24 (and not WWDC 2025).
Score: 8 Votes (Like | Disagree)
tkaravou Avatar
9 weeks ago

What's the point of AI servers if apple users have on device AI?
For GPT, they need something called a LLM (Large Language Model). Think of this as a massive snapshot of the internet at a given point in time. Once that snapshot is generated, they can copy it locally to the user. So when you ask it something, it checks the local LLM (on device) and gets you the answer.

So what's the point of the AI server?

1. Generating those models takes a LOT of GPU power for a long period of time. This is what all these companies are paying the big bucks for.

2. Those snapshots get stale quickly, so they need to run a new model every so often. It can cost billions to generate a new model so you don't want to do it too often.

3. As they improved their code, they need to regenerate parts or all of those models.

So does that mean if the snapshot is from Jan 1 I won't get any recent data?

Yes.

To fix that, a lot of the GPTs will leverage the internet to get more up-to-date results. That's slower and the results aren't as good. This part will not be handled on-device obviously.

This is why Apple is trying to strike a deal with Gemini and OpenAI. It's also possible that Apple is looking to handle the fresh data on their own, which would require more servers.
Score: 5 Votes (Like | Disagree)