tag: data centers

From Host Node To Heterogeneous Rack: Rethinking The AI CPU
By Satadal Bhattacharjee - 09 Jul, 2026 - Comments: 0

AI infrastructure is entering a crucial new phase. The first phase of generative AI infrastructure was defined by accelerator scale: how many GPUs, NPUs or custom AI accelerators could be deployed, powered, cooled and connected. That phase is not over, but it is no longer sufficient. The next phase is about rack-scale system composition: heterogeneous AI racks where different compute resourc... » read more

Data Center AI Growth Faces Challenging Bottlenecks
By Geoff Tate - 06 Jul, 2026 - Comments: 0

AI is rocketing ahead. It is the biggest industrial revolution of our age. AI adoption is growing, but still most are at early stages of learning. Anthropic, the leading frontier model provider with an annualized revenue run rate (ARR) of ~$47 billion with OpenAI close behind at ~$30 billion (Forbes). Google Gemini revenues aren’t broken out but Google Gemini processes over 3.2 quadrillion... » read more

AI Data Centers And Auto Industry Converge On Same Issues
By Liz Allan - 02 Jul, 2026 - Comments: 0

Key Takeaways:   AI data centers need power from a range of sources, including batteries, to safeguard against blackouts, transient voltage spikes, and grid demand spikes.  As with regenerative braking and bidirectional charging in electric vehicles, data centers could feed power or heat back into the grid for public use, but the immediate goal is to disrupt the grid as little as pos... » read more

Platform Firmware Resiliency: How To Protect Your Data Center From The Ground Up
By Nilesh Badodekar - 02 Jul, 2026 - Comments: 0

Data centers have become the foundation of modern digital infrastructure, but one of their most critical security layers remains dangerously exposed. Platform firmware, which controls everything from system initialization to hardware configuration, is increasingly targeted by sophisticated cyberattacks. A successful firmware compromise is difficult to detect, survives reboots, and can give atta... » read more

Cadence Reality Digital Twin Platform and NVIDIA Omniverse Integration
By Cadence - 01 Jul, 2026 - Comments: 0

The rapid expansion of AI infrastructure requires a paradigm shift in how data centers are designed, built, and operated. Traditional workflows are often fragmented, relying on isolated tools that obscure the full operational context required for high-performance computing (HPC) environments. The Cadence Reality Digital Twin Platform addresses these challenges by integrating physics-... » read more

More Massive Still: Why AI Infrastructure Demands A Unified Design Approach
By Antti Lautanen - 25 Jun, 2026 - Comments: 0

At the recent Data Center World 2026 in Washington, D.C., one message came through louder than ever: AI infrastructure is scaling faster than any system we’ve built before—and the industry can no longer afford to design it in silos. The workshop: “More Massive Still! Delivering AI-Driven Scale in the Face of Historic Constraints” captured this perfectly: the industry is shifting fr... » read more

Cloud HPC For AI: Addressing Latency, Cost, And Scale At The Architectural Level
By Sumit Vishwakarma - 22 Jun, 2026 - Comments: 0

Many organizations assume that moving HPC workloads to the cloud is simply a matter of lifting and shifting on-premises clusters. In practice, that approach often erodes performance, inflates costs, and undermines AI training efficiency. Getting the most out of HPC in the cloud requires a fundamentally different architectural approach — one that minimizes latency, maximizes utilization, an... » read more

Building A Production-Ready Optically Connected Rack For AI Scale-Up
By Nandita Aggarwal - 11 Jun, 2026 - Comments: 0

By Nandita Aggarwal and Nicholas Chang As AI models drive compute demand, servers keep getting bigger. Rack‑scale AI systems (such as the 72-GPU systems from NVIDIA or AMD) enable many GPUs to work together through system-level optimization. They push beyond the limits of single-chip performance and meet the soaring compute needs of the AI era. But this is just the beginning. The next s... » read more

CPO Will Dominate Scale-Up: Link Budgets For dB And $ Are Key
By Geoff Tate - 10 Jun, 2026 - Comments: 0

In the next five years, scale-up interconnects will transition from copper to optical interconnects — primarily co-packaged optics (CPO), with some near-packaged optics (NPO), and perhaps some vertical-cavitity-surface-emitting lasers (VCSELs). The demand for AI has become visibly real with Anthropic hitting a $47 billion annual run rate, followed closely by OpenAI and Google Gemini. Anthr... » read more

1 Megawatt Racks In Data Centers
By Ed Sperling - 03 Jun, 2026 - Comments: 0

The demand for performance in an AI data center is causing a huge spike in the amount of power being consumed. Within a rack are a half-dozen SoC components housed in different types of advanced packages and connected with an assortment of blazing-fast interface IP and optical signaling. Manmeet Walia, director of product management for mixed-signal PHY IP in the Synopsys Solutions Group, talks... » read more

← Older posts

  • Sponsors

About

Navigation

Connect With Us

Copyright ©2013-2026 SMG   |  Terms of Service  |  Privacy Policy