Why did Nvidia form a major alliance with MediaTek? A technical breakdown from customized ASICs and advanced packaging to chip interconnect architecture.

工程實驗室中進行高密度晶片封裝、SerDes 眼圖量測與 AI 加速器模組測試的寫實場景

When news broke that Nvidia was investing billions of dollars to acquire MediaTek's unsecured convertible bonds (ECBs), the market's initial interpretation often focused on capital operations and stock price. However, in the reality of semiconductor hardware engineering, the underlying foundation for massive capital commitments always follows the evolution of chip architecture and supply chain infrastructure.

Why would Nvidia, with its world-leading AI GPU ecosystem and CUDA software moat, need to establish a decade-long strategic alliance with MediaTek, a company deeply rooted in smartphone SoCs? The answer isn't about who buys whom, but rather that the competition in AI computing infrastructure has shifted from peak floating-point performance on a single die to system engineering involving rack-level heterogeneous integration, customized ASICs (Application-Specific Integrated Circuits), ultra-high-speed interface interconnects, and extreme thermal power consumption (TDP).

This article will completely detach itself from financial figures and speculative themes, and will focus purely on chip engineering, transmission interfaces, advanced packaging physical limits and system power consumption to break down the complementary relationship between the two companies in the technology chain, as well as MediaTek's core competitive advantage in the AI era.

More Than Just Financial Investment: The Chip Engineering Map Behind This Alliance

In the field of chip design, no single company can monopolize all silicon intellectual property (IP) and process resources. Nvidia has an unshakeable advantage in large model pre-training and general matrix operations, but as AI computing enters the stage of inference popularization and terminal deployment, data center operators and terminal manufacturers are beginning to demand "cost per watt" and "cost per token" that go beyond pure computing performance.

This has led to two major branches in hardware architecture: one is cloud service providers (CSPs, such as Google, Meta, Amazon, and Microsoft) actively developing their own custom-designed accelerators (ASICs/XPUs) for specific search, recommendation systems, and generative inference workloads; the other is edge devices such as smart cockpits, AI PCs, and industrial control equipment, which require multimodal sensing and real-time inference to be performed under harsh space conditions and passive or limited cooling.

Nvidia's strength lies in its general-purpose architecture and massive cluster expansion; however, to meet dozens of highly divergent ASIC demands with varying profit structures and requiring customized turnkey designs, Nvidia needs an ally with world-class mass production experience in advanced physical design, low-power control, and heterogeneous chip integration. This is precisely where MediaTek comes in.

The Rise of Cloud-Based Customized ASICs: Why are CSPs No Longer Just Buying General-Purpose GPUs?

To understand this alliance, we must first understand why there is a strong demand for customized ASICs in data centers. General-purpose GPUs, to be compatible with game rendering, scientific computing, ray tracing, and various deep learning algorithms, retain a large amount of control units, register stacks, and flexible scheduling hardware within the die. For highly specific production environments (such as embedded layer queries in recommendation models or large-scale sparse attention operations), many transistors in general-purpose GPUs are actually idle or operating inefficiently during certain cycles.

Custom ASICs involve specialized hardware tailoring for specific mathematical operation pipelines. By removing unnecessary graphics pipelines and general-purpose floating-point units, the saved silicon wafer area is entirely replaced with dedicated tensor cores or high-bandwidth on-chip static memory (SRAM). This can create multi-fold performance gains per watt for specific tasks and significantly reduce the total cost of ownership (TCO) for large-scale deployments. For information on how these chips interact with cloud rack systems, please refer to previous discussions.MediaTek's product positioning of customized XPUs for AI data centersA detailed analysis.

However, even with architectural ideas, CSPs cannot be implemented by software engineers alone to create a massive 2nm/3nm chip integrating multiple HBMs and high-speed I/O. It requires front-end architecture transformation, standard cell optimization, clock tree synthesis (CTS), power integrity (PI), and signal integrity (SI) simulation. MediaTek, a fabless giant shipping hundreds of millions of advanced process chips annually, offers a complete turnkey ASIC service team capable of providing turnkey services from specification to wafer delivery (RTL to GDSII to Silicon), significantly shortening the time-to-market for custom chips.

Chip Interconnect Architecture Decoded: NVLink Fusion and MediaTek's SerDes Competitive Advantage

In multi-chip collaborative AI systems, the computing core is often not the most critical bottleneck; rather, it is the "interconnect bandwidth" between chips. This is precisely the core motivation behind Nvidia's NVLink Fusion architecture: if customers insist on developing their own custom XPUs, rather than letting these chips flow to completely independent competing standards, it is better to open up proprietary interconnect communication protocols so that third-party custom ASICs can also seamlessly access Nvidia's NVLink mesh topology and NVSwitch switch matrix.

However, for external chips to access this highway, the physical hardware layer (PHY) must possess an extremely powerful SerDes (serializer/deserializer) IP. In high-speed transmission, data is not transmitted along parallel lines, but rather hundreds of internal chip data signals are converted into a few pairs of extremely high-speed differential signal lines via SerDes.

When the transmission rate is pushed up to 112 Gbps or even 224 Gbps per channel, the modulation technique used is fourth-order pulse amplitude modulation (PAM4). At the 224 GHz band, the dielectric loss and reflection of high-frequency signals in PCB traces and connectors are extremely severe, and the eye diagram opening height is only tens of millivolts, making it very easy to be overwhelmed by jitter and crosstalk.

At this point, the analog front-end (AFE), continuous-time linear equalizer (CTLE), and digital signal processor (DSP)-based feedforward equalization (FFE) and decision feedback equalization (DFE) algorithms within SerDes become the lifeline determining the success or failure of the entire chip's transmission. MediaTek has a long track record of self-developed silicon proof on its 112G and 224G PAM4 SerDes IPs. Through MediaTek's SerDes physical layer and ASIC integration capabilities, the dedicated computing chips developed by CSP can possess electrical characteristics that precisely match the Nvidia NVLink physical specification, forming a hardware-software interlocked interconnect ecosystem.

Advanced Packaging Engineering Integration Capabilities: CoWoS, Wafer Stacking, and Heterogeneous Integration

The physical area of a single monolithic die is strictly limited by the lithography mask limit (approximately 858 mm²). To pack in more transistors and terabytes of memory bandwidth, the only feasible engineering solution for the industry is the chiplet architecture and 2.5D/3D advanced packaging.

Within TSMC's 3D Fabric ecosystem, CoWoS (Chip-on-Wafer-on-Substrate) is currently the only mass-production standard for ultra-large-scale AI chips:

  • CoWoS-S: Using a passive silicon interposer, extremely fine submicron-level metal traces are etched on a silicon substrate to connect logic chips and high-bandwidth memory (HBM).
  • CoWoS-L: For ultra-giant chips with a photomask area many times larger, a redistribution layer (RDL) is used in combination with a micro local silicon interconnect (LSI) to balance yield and thermal stress.
  • SoIC (System Integration Chip): By utilizing bumpless copper-to-copper hybrid bonding, vertical 3D wafer stacking is achieved, pushing vertical interconnect density to below micrometers.

The design difficulty of advanced packaging is no less than that of wafer lithography. When multiple computing chips, I/O control chips, and 6 to 8 HBM3e/HBM4 chips are tightly bonded to the same substrate, the microbump spacing is typically less than 40 micrometers. The mismatch in the coefficient of thermal expansion (CTE) between different materials can cause severe warpage and solder joint fatigue peeling during repeated heating and cooling processes.

MediaTek is one of the few design companies globally to be listed as a top priority customer for both TSMC's advanced process and advanced packaging technologies. From in-package signal integrity and power delivery network (PDN) impedance optimization to capacity allocation coordination with foundries, MediaTek possesses the capability to rapidly bring extremely complex multi-die systems to mass production. This aligns with our discussion...Synergistic effect of wafer foundry and advanced packagingThis aligns perfectly with the concept emphasized at the time: advanced packaging is an amplifier that multiplies computing power, but it must be supported by high-precision physical design capabilities.

From 5W to 1000W: TDP Power Optimization Shift at the Edge and Cloud

There's a common misconception in the semiconductor industry that low-power mobile phone chips and kilowatt-level data center chips belong to completely different worlds. However, in essence, from a thermodynamic and electrophysical perspective, they both pursue the same metric: effective computing throughput per watt (Tokens per Watt).

MediaTek has undergone decades of rigorous refinement in the smartphone and mobile device field. Within a phone chassis less than 8 millimeters thick, without fans or water cooling, the thermal design power (TDP) of the entire flagship SoC is locked between 5W and 15W. To squeeze performance out of this limited space without causing overheating and throttling, MediaTek has established an extremely sophisticated advanced power management architecture:

  • Dynamic Voltage and Frequency Regulation (DVFS): Within a microsecond timescale, the voltage and operating frequency of each computing core are precisely scheduled based on the real-time computational load.
  • Power Gating and Subthreshold Leakage Suppression: Power off unused computing modules immediately to minimize static leakage.
  • Integrated power management IC (PMIC) collaboration: By using a self-developed PMIC, multi-phase high-efficiency power supply is achieved, reducing the internal power supply voltage drop (IR Drop) of the chip.

When this capability is scaled up to the data center level, its value is dramatically amplified. Modern AI computing trays often consume over 1000W of thermal power, and power supply limitations and thermal resistance constraints in data centers have become the biggest obstacles to cluster expansion. As we discussed...TDP (Thermal Power Consumption) and System ArchitectureAs mentioned earlier, the thermal budget determines the physical upper limit of computing power. MediaTek's profound expertise in microwatt and milliwatt-level power consumption tuning, when combined with Nvidia's high-speed parallel computing logic, can provide highly competitive power management designs for high-energy-efficiency custom chips.

In-vehicle smart cockpit and edge computing: The integration of the physical and virtual worlds by Dimensity Auto and Drive

Besides cloud data centers, another major battleground for this alliance is in-vehicle smart cockpits and software-defined vehicles (SDVs).

A modern intelligent cockpit needs to handle extremely complex and diverse heterogeneous tasks:

  1. In-cabin infotainment (IVI): Multi-screen 4K/8K rendering, smooth 3D user interface, voice interaction, and real-time edge large language model (Edge LLM) inferences.
  2. Communication and environmental sensing: 5G connectivity, Wi-Fi 7, ultra-wideband (UWB), satellite positioning, and surround view signal processing (ISP).
  3. Automotive-grade reliability and functional safety: It must be AEC-Q100 certified, meet the ASIL-B or even ASIL-D functional safety level of ISO 26262, and have an operating temperature range from -40°C to 105°C.

MediaTek's "Dimensity Auto" automotive platform has a solid foundation in connectivity, in-cabin multimedia, and system integration; however, in the field of ultra-large-scale tensor neural network computing required for advanced autonomous driving (AD/ADAS), the industry-recognized leading architecture is still Nvidia's Drive platform and Thor chip architecture.

The technological path of the alliance between the two companies is very clear: to integrate Nvidia's high-end graphics computing and autonomous driving acceleration cores into MediaTek's automotive SoC platform through chip-level or module-level high-bandwidth interconnects. This architecture allows automakers to avoid installing separate high-power-consuming intelligent driving computers and separate cockpit chips in the vehicle. Instead, they can use a single compact motherboard or a single centralized computing unit to handle navigation, entertainment, and advanced driver assistance systems simultaneously, achieving optimal system cost under the premise of extremely limited in-vehicle space and power consumption.

A comprehensive comparison of the complementarity of the two parties' technology assets and architecture

By breaking down and comparing the technology landscapes of the two semiconductor giants, it is clear that they are highly complementary in terms of chip architecture, interconnect standards, and engineering implementation:

Evaluation of engineering dimensionsNvidia's core advantagesMediaTek's core advantagesThe complementary effect of the alliance architecture
Core computing architectureGPU parallel computing, Tensor Cores, CUDA, and a vast developer ecosystemHeterogeneous multi-core SoC integration, low-power NPU/APU, general-purpose control logicCombining a top-tier general-purpose acceleration ecosystem with highly customized computing units
Transmission interconnection technologyNVLink protocol, NVSwitch rack-level topology112G / 224G PAM4 SerDes IP, UCIe Die-to-Die InterfaceEnabling third-party ASICs to connect to the NVLink ecosystem through advanced SerDes PHY
Energy consumption and power managementExtreme computing throughput, large liquid-cooled rack power supply architectureMilliwatt-level fine-grained dynamic power consumption tuning (DVFS), PMIC power coordinationSuppressing static leakage current and IR drop in large AI chips improves overall TCO.
Advanced Packaging and FoundryDefine ultra-large package specifications and top-tier HBM procurement scaleCoWoS / SoIC physical design experience, multi-die routing integration, close collaboration with TSMCProvides complete turnkey services for CSPs, from architecture to 2.5D/3D packaging mass production.
Terminal and communication layoutCloud servers, supercomputing clusters, and advanced autonomous driving platformsMobile communications (5G Modem), Wi-Fi 7, multimedia ISP, smart cockpitEstablish a complete supply chain from cloud-based AI factories to edge-based smart cockpits/AI PCs.

This comparison chart clearly illustrates one thing: this is not simply contract manufacturing, nor is it a zero-sum division of market share. Rather, it is about seamlessly integrating the most advanced computing and communication protocols in the cloud with top-notch physical implementation capabilities to custom hardware and terminal devices.

Four real-world challenges that cannot be ignored in project implementation

Despite the highly synergistic nature of the technology roadmap, there are still four significant physical boundaries and business risks in the practical implementation of semiconductor engineering:

  1. Cross-company IP integration and verification cycles are too long: Integrating IPs from two different systems, design flows, and clock domains into a single package increases the complexity of timing closure and formal verification exponentially. A slight misstep could increase the risk of months of respinning during tape-out.
  2. Advanced packaging capacity crowding-out effect: Even with continued expansion of CoWoS and high-end substrate production capacity, capacity allocation remains tight due to competition from general-purpose GPUs, HBMs, and emerging ASICs. Delays in custom projects will severely impact CSP launch schedules.
  3. Non-recurring engineering costs (NRE) threshold for custom chips: Entering the 2nm/3nm node, the cost of a single mold and photomask development can easily reach tens of millions to hundreds of millions of US dollars. As we have seen...Architecture trade-offs between advanced and mature processesThe analysis suggests that if the workload lifecycle of a customer-specific algorithm is too short, or if the shipment volume fails to exceed one million units, the average cost over the entire lifecycle of an ASIC may actually be higher than that of directly purchasing a general-purpose GPU.
  4. The closed-loop balance of interconnection protocols: NVLink is, after all, a proprietary protocol that Nvidia has complete control over. With the industry simultaneously pushing open standards (such as UALink and the Ultra Ethernet Consortium), achieving an architectural balance between the high performance of proprietary ecosystems and the compatibility of open ecosystems is a choice that system architects must continuously face.

Interconnectivity and energy efficiency are the real watershed moments for the next stage of AI chips.

Looking back at this high-stakes alliance that captivated the semiconductor industry, the most fundamental lesson is:With the slowdown of Moore's Law in semiconductors, the key to winning the chip competition no longer depends solely on who buys the more advanced lithography machines, but on who can tightly link distributed computing and memory chips together with the lowest energy consumption.

By establishing a long-term partnership through convertible bond subscriptions, Nvidia is essentially solidifying a physical implementation channel for its NVLink architecture, enabling it to quickly serve cloud-based CSP custom ASICs. At the same time, by leveraging MediaTek's system integration capabilities, Nvidia is extending its massive GPU computing power to smart cockpits and edge devices. In turn, MediaTek, through this alliance, is breaking the stereotype that it is "centered around mobile processors," directly injecting its years of accumulated SerDes IP, advanced packaging and integration capabilities, and ultra-low power consumption technology into the core infrastructure of AI data centers.

When computing power becomes a universal resource like electricity, the value of infrastructure will no longer be determined solely by the peak transistor count, but rather by the bandwidth density of the transmission interface, the yield of multi-die heterogeneous integration, and the precision of overall power consumption control. This is precisely the architectural signal that this technological alliance, beneath its capital facade, leaves for the semiconductor engineering community to ponder most deeply.

Recommended Posts