AI Inference
Ongoing coverage on AI Inference.
Latest coverage
AI Yi-Yi!
Older Nvidia GPUs with 24GB of VRAM are outperforming newer cards in local AI inference tasks due to their memory capacity. Meanwhile, Meta's stock has declined amidst growing concerns about its substantial AI investment plans, and OpenAI is reportedly offering free AI services.
Rumour suggests Intel is cooking up a 12 Xe desktop Nova Lake CPU
A new rumor suggests Intel's upcoming Nova Lake desktop CPUs will feature 12 Xe graphics cores, potentially offering a significant boost in integrated graphics performance. This leak, attributed to leaker Jaykihn, indicates that both mobile and desktop variants of Nova Lake will include these 'Xe3p' cores, which are expected to be geared towards AI inference.
It looks like Nvidia's AI inference GPU won't see the light of day this year, which could actually be good…
Nvidia's dedicated AI inference GPU, Rubin CPX, is reportedly cancelled or significantly delayed, with no PCB or GDDR7 orders indicating a halt in production. This development, potentially linked to a licensing deal with Groq, could positively impact the pricing of Nvidia's GeForce RTX 50-series graphics cards by alleviating VRAM supply constraints.
Starcrafty strategy game Stormgate is about to lose its multiplayer modes, due to an AI company buying up Frost Giant's server provider
Frost Giant Studios announced that Stormgate's multiplayer modes will go offline at the end of April due to its server provider, Hathora, being acquired by an AI company. The new owner, Fireworks AI, plans to discontinue Hathora's game server services to focus on AI inference. Frost Giant hopes to restore online play in a future patch after finding a new partner.