{"id":2724,"date":"2024-11-06T23:06:48","date_gmt":"2024-11-06T15:06:48","guid":{"rendered":"https:\/\/taichungbro.com\/?p=2724"},"modified":"2024-11-07T21:11:33","modified_gmt":"2024-11-07T13:11:33","slug":"tdp","status":"publish","type":"post","link":"https:\/\/www.taichungbro.com\/en\/2024\/11\/06\/tdp\/","title":{"rendered":"What are TDP and PUE? Understanding Thermal Requirements and Solutions"},"content":{"rendered":"<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-wide\"\/>\n\n\n\n<div class=\"wp-block-rank-math-toc-block\" id=\"rank-math-toc\"><h2>Table of Content<\/h2><nav><ul><li class=\"\"><a href=\"#tdp-thermal-design-power\uff0c\u71b1\u8a2d\u8a08\u529f\u8017\">TDP (Thermal Design Power)<\/a><\/li><li class=\"\"><a href=\"#pue-power-usage-effectiveness\uff0c\u96fb\u6e90\u4f7f\u7528\u6548\u7387\">PUE (Power Usage Effectiveness)<\/a><\/li><li class=\"\"><a href=\"#\u5982\u4f55\u964d\u4f4epue\">How to reduce PUE?<\/a><\/li><li class=\"\"><a href=\"#\u71b1\u8a2d\u8a08\u529f\u8017\u9700\u6c42\u7684\u6f14\u9032\">Evolution of Thermal Design Power Requirements<\/a><\/li><li class=\"\"><a href=\"#\u6db2\u51b7\u6280\u8853\u7684\u4e3b\u6d41\u8da8\u52e2\">Mainstream trend of liquid cooling technology<\/a><\/li><\/ul><\/nav><\/div>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-wide\"\/>\n\n\n\n<p class=\"wp-block-paragraph\">With the rapid development of technology, the performance improvements of electronic devices have brought significant challenges in heat generation. Whether it&#039;s a personal computer used daily or a data center supporting massive computing workloads, these systems require effective thermal design to ensure stable operation. The evolution of thermal requirements has become increasingly apparent over the past two decades, especially with the ever-increasing power consumption of processors and graphics cards. Thermal systems must keep pace to maintain optimal performance. Modern thermal design not only protects hardware but also considers energy efficiency, such as TDP (Thermal Design Power) and PUE (Power Usage Effectiveness).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"tdp-thermal-design-power\uff0c\u71b1\u8a2d\u8a08\u529f\u8017\">TDP (Thermal Design Power)<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">TDP (Total Power Dissipation) refers to the maximum heat generated by a processor under high load, measured in watts (W). This metric provides a reference for the design of cooling systems, ensuring that devices can effectively dissipate heat under high load and avoid overheating that could lead to performance degradation or damage. It&#039;s important to note that TDP does not represent the processor&#039;s maximum power consumption, but rather the upper limit of the heat that the cooling system needs to handle.<br>High TDP processors require more efficient heatsinks to prevent overheating, which could lead to automatic processor throttling or system instability. Furthermore, TDP is a crucial parameter in the design of server room cooling systems for servers and high-performance computing devices.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"pue-power-usage-effectiveness\uff0c\u96fb\u6e90\u4f7f\u7528\u6548\u7387\">PUE (Power Usage Effectiveness)<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">\u25cfPUE = IT equipment energy consumption \u00f7 Total data center energy consumption<br><a>\u25cf<\/a>Total energy consumption of a data center: refers to the total power consumption of a data center, including all power consumption of IT equipment (servers, storage devices, network equipment) and support equipment (such as cooling, lighting, UPS, etc.). <br>\u25cfIT equipment energy consumption: refers only to the power consumption of IT equipment inside the data center, excluding cooling systems and other support equipment.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Power Usage Effectiveness (PUE) is a metric for measuring the energy efficiency of a data center. It is calculated by dividing the total energy consumption of the data center by the energy consumption of IT equipment. The closer the PUE value is to 1, the more efficient the energy utilization of the data center and the lower the energy consumption of non-IT equipment. The ideal PUE value is 1.0, meaning that all energy is used for IT equipment with no additional energy consumption. This requires optimizing the cooling system and reducing the energy consumption of non-IT equipment, thereby reducing overall energy consumption and operating costs.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"\u5982\u4f55\u964d\u4f4epue\">How to reduce PUE?<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">\u25cf Improve the cooling system: Use liquid cooling, air cooling, optimized design, natural cooling, or use more efficient cooling equipment.<br>\u25cf Optimized airflow management: Prevents mixing of hot and cold air, ensuring that cold air can effectively cool the server.<br>\u25cf Adopt energy-efficient equipment: Use more energy-efficient servers and storage devices to reduce the energy consumption of IT equipment.<br>\u25cf Adjusting temperature and humidity settings: Increasing the room temperature in the data center to a reasonable range can reduce the energy consumption of the cooling system.<br>\u25cfUtilize renewable energy: Some data centers use renewable energy sources such as solar and wind power to reduce their dependence on traditional energy sources.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">TDP (Total Dissipation Requirement) is a metric for the thermal requirements of a single electronic device, describing the maximum heat generated by the device under high load. It is primarily used for designing and selecting cooling systems to ensure effective heat dissipation and prevent overheating when the device is operating at full load. An effective cooling solution needs to meet or exceed TDP requirements. PUE (Power Usage Effectiveness), on the other hand, is a metric focused on the entire data center level, measuring the energy efficiency of the data center and indicating how much energy is used for IT equipment relative to how much energy is consumed by other non-IT equipment.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A data center&#039;s Power Usage Effectiveness (PUE) depends not only on the energy consumption of IT equipment but also on the power consumption of cooling systems, lighting, and other infrastructure. Therefore, a poorly designed or inefficient cooling system can lead to high cooling power consumption, thus increasing the PUE value and reducing the data center&#039;s energy efficiency. By reducing the power consumption of high-TDP equipment (e.g., using low-power processors), data centers can reduce cooling energy consumption and thereby lower the PUE. This is a method of indirectly improving energy efficiency by reducing heat dissipation requirements. Ideally, however, a more efficient cooling system is still needed to ensure that the data center maintains energy efficiency even with high-TDP equipment.<\/p>\n\n\n\n<div style=\"height:var(--wp--preset--spacing--30)\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-wide\"\/>\n\n\n\n<h5 class=\"wp-block-heading has-text-align-center\" id=\"\u60f3\u4e86\u89e3\u6709\u95dc\u7ba1\u87ba\u7d0b\u3001\u76f4\u87ba\u7d0b\u3001\u9310\u87ba\u7d0b\u3001\u5c3a\u5bf8\u8868\u793a\u3001\u82f1\u5236\u7ba1\u87ba\u7d0b\u3001\u516c\u5236\u7ba1\u87ba\u7d0b\u7684\u77e5\u8b58\u55ce\uff1f-\u5ef6\u4f38\u95b1\u8b80\uff1a\u300a\u7ba1\u87ba\u7d0b\u767e\u767e\u7a2e-\u4f60\u90fd\u8a8d\u8b58\u55ce-\u300b\">Want to learn about the structure, working principle, types and applications of heat pipes? <br>Further Reading :<a href=\"https:\/\/www.taichungbro.com\/en\/2024\/08\/08\/heat-pipe\/\" data-type=\"link\" data-id=\"https:\/\/taichungbro.com\/2023\/10\/28\/screw\/\" target=\"_blank\" rel=\"noopener\">&quot;Ultra-High Efficiency Thermal Conductive Elements \u2013 Principles and Applications of Heat Pipes&quot;<\/a><\/h5>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-wide\"\/>\n\n\n\n<div style=\"height:11px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"\u71b1\u8a2d\u8a08\u529f\u8017\u9700\u6c42\u7684\u6f14\u9032\">Evolution of Thermal Design Power Requirements<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">With the rapid development of artificial intelligence and high-performance computing (HPC), the demand for general-purpose graphics processing units (GPGPUs) continues to grow. The rise of generative AI, such as large language models like ChatGPT, has further increased this demand.<a>The demand for computing resources has increased significantly.<\/a>According to TrendForce, the compound annual growth rate from 2022 to 2026 will reach 291 billion tons.<br>Therefore, with the significant increase in demand for computing resources, the thermal design power (TDP) of GPGPUs is also constantly rising, and traditional air cooling methods are gradually becoming insufficient to meet the requirements. For example, the TDP of the NVIDIA H100 has reached 700W. Currently, the TDP of mainstream high-end server CPUs has reached 350-400W, and GPGPUs and switch ICs have even exceeded 600W and 800W. Liquid cooling is generally recommended for CPUs reaching 350W. Therefore, the adoption of liquid cooling technology will become the mainstream heat dissipation solution.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img fetchpriority=\"high\" decoding=\"async\" width=\"933\" height=\"722\" src=\"https:\/\/taichungbro.com\/wp-content\/uploads\/2024\/11\/image-3.png\" alt=\"\" class=\"wp-image-2734\" style=\"width:673px;height:auto\" srcset=\"https:\/\/www.taichungbro.com\/wp-content\/uploads\/2024\/11\/image-3.png 933w, https:\/\/www.taichungbro.com\/wp-content\/uploads\/2024\/11\/image-3-300x232.png 300w, https:\/\/www.taichungbro.com\/wp-content\/uploads\/2024\/11\/image-3-768x594.png 768w, https:\/\/www.taichungbro.com\/wp-content\/uploads\/2024\/11\/image-3-16x12.png 16w, https:\/\/www.taichungbro.com\/wp-content\/uploads\/2024\/11\/image-3-600x464.png 600w\" sizes=\"(max-width: 933px) 100vw, 933px\" \/><figcaption class=\"wp-element-caption\">TDP (Thermal Design Power) data of mainstream GPGPUs (General-Purpose Graphics Processing Units) from 2008 to present<\/figcaption><\/figure>\n<\/div>\n\n\n<p class=\"wp-block-paragraph\">While pursuing high performance, energy efficiency has become an important consideration. Liquid cooling systems perform exceptionally well in reducing energy consumption. According to NVIDIA tests, liquid cooling can reduce the number of server racks by 661 TP3T, reduce energy consumption by 281 TP3T, and lower the PUE from 1.6 to 1.15.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">With the increasing power consumption demands of electronic devices, especially in GPGPU and data center applications, Direct Liquid Cooling (DLC) technology has become a major highlight in thermal solutions. For high TDP devices, liquid cooling technology can not only effectively reduce operating temperature but also maintain device stability, especially in GPGPU systems that handle AI and high-performance computing, where its importance is becoming increasingly prominent.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"\u6db2\u51b7\u6280\u8853\u7684\u4e3b\u6d41\u8da8\u52e2\">Mainstream trend of liquid cooling technology<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">In the field of liquid cooling technology, there are two main types: direct liquid cooling (DLC) and indirect liquid cooling.<strong><\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Direct liquid cooling (DLC):<br>Direct liquid cooling (DLC) technology brings the coolant directly into contact with the heat-generating components, effectively removing heat through a cold plate or immersion method. This technology is suitable for high heat density equipment, such as high-performance computing (HPC) systems and data center servers. According to market research reports, the global liquid cooling system market is projected to grow from US$4.27 billion in 2023 to US$10.51 billion in 2030, representing a CAGR of 13.701 billion USD\/ton. Direct liquid cooling technology, due to its high efficiency and energy-saving characteristics, is particularly suitable for high-performance computing (HPC) and data center applications, and is expected to capture a larger share of the market in the future.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Indirect liquid cooling:<br>In indirect liquid cooling systems, the coolant circulates in closed pipes, exchanging heat with heat-generating components through heat exchangers, preventing direct contact between the coolant and electronic components. This technology is commonly used in traditional data centers and for cooling IT equipment. Currently, indirect liquid cooling technology holds a large market share, primarily due to its high technological maturity and low requirement for retrofitting existing infrastructure. However, with the increasing prevalence of high heat density equipment and higher demands for energy efficiency, the application of direct liquid cooling technology is growing rapidly, especially in areas requiring highly efficient heat dissipation.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Although indirect liquid cooling technology is still the mainstream technology in the market, the market share of direct liquid cooling technology is gradually increasing, and it is expected to occupy a larger market share in fields such as high-performance computing and data centers in the future.<\/p>\n\n\n\n<div style=\"height:var(--wp--preset--spacing--30)\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-wide\"\/>\n\n\n\n<h5 class=\"wp-block-heading has-text-align-center\" id=\"\u60f3\u4e86\u89e3\u6709\u95dc\u7ba1\u87ba\u7d0b\u3001\u76f4\u87ba\u7d0b\u3001\u9310\u87ba\u7d0b\u3001\u5c3a\u5bf8\u8868\u793a\u3001\u82f1\u5236\u7ba1\u87ba\u7d0b\u3001\u516c\u5236\u7ba1\u87ba\u7d0b\u7684\u77e5\u8b58\u55ce\uff1f-\u5ef6\u4f38\u95b1\u8b80\uff1a\u300a\u7ba1\u87ba\u7d0b\u767e\u767e\u7a2e-\u4f60\u90fd\u8a8d\u8b58\u55ce-\u300b\">Want to know about<strong>Modern water cooling technology<\/strong>\u3001<strong>Liquid cooling mechanism<\/strong>Do you have that knowledge? <br>Further Reading :<a href=\"https:\/\/www.taichungbro.com\/en\/2024\/09\/18\/liquid-cooling\/\" data-type=\"link\" data-id=\"https:\/\/taichungbro.com\/2023\/10\/28\/screw\/\" target=\"_blank\" rel=\"noopener\">\u300aThe Rise of Liquid Cooling Systems \u2013 How Liquid Cooling Has Become the New Standard for High-Performance Devices\u300b<\/a><\/h5>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-wide\"\/>\n\n\n\n<div style=\"height:11px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>","protected":false},"excerpt":{"rendered":"<p>\u96a8\u8457\u79d1\u6280\u9032\u6b65\uff0c\u96fb\u5b50\u8a2d\u5099\u7684\u6027\u80fd\u63d0\u5347\u5e36\u4f86\u4e86\u986f\u8457\u7684\u6563\u71b1\u9700\u6c42\u3002TDP\uff08\u71b1\u8a2d\u8a08\u529f\u8017\uff09\u548cPUE\uff08\u96fb\u6e90\u4f7f\u7528\u6548\u7387\uff09\u662f\u8861\u91cf\u8a2d\u5099\u53ca\u6578\u64da\u4e2d\u5fc3\u6563\u71b1\u6548\u7387\u7684\u95dc\u9375\u6307\u6a19\u3002TDP\u8868\u660e\u55ae\u4e00\u8a2d\u5099\u5728\u9ad8\u8ca0\u8f09\u4e0b\u7684\u6700\u5927\u6563\u71b1\u9700\u6c42\uff0c\u800cPUE\u5247\u8861\u91cf\u6578\u64da\u4e2d\u5fc3\u7684\u80fd\u6e90\u4f7f\u7528\u6548\u7387\uff0c\u8d8a\u63a5\u8fd11\u8d8a\u4f73\u3002<\/p>\n<p>\u56e0\u61c9\u9ad8TDP\u7684\u9700\u6c42\uff0c\u6563\u71b1\u6280\u8853\u9010\u6f38\u5f9e\u50b3\u7d71\u6c23\u51b7\u8f49\u5411\u6db2\u51b7\u3002\u6db2\u51b7\u6280\u8853\u5177\u5099\u9ad8\u6548\u6563\u71b1\u548c\u7bc0\u80fd\u512a\u52e2\uff0c\u5305\u542b\u76f4\u63a5\u6db2\u51b7\uff08DLC\uff09\u8207\u9593\u63a5\u6db2\u51b7\u3002DLC\u76f4\u63a5\u51b7\u537b\u767c\u71b1\u5143\u4ef6\uff0c\u9069\u5408\u9ad8\u71b1\u5bc6\u5ea6\u7cfb\u7d71\uff0c\u5982\u9ad8\u6027\u80fd\u8a08\u7b97\uff08HPC\uff09\u548c\u6578\u64da\u4e2d\u5fc3\u3002\u9810\u8a08DLC\u5e02\u5834\u5c07\u5feb\u901f\u589e\u9577\uff0c\u6210\u70ba\u672a\u4f86\u6563\u71b1\u6280\u8853\u7684\u4e3b\u6d41\u8da8\u52e2\u3002<\/p>","protected":false},"author":2,"featured_media":2782,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[45],"tags":[225,222,221,164,198,224,223],"class_list":["post-2724","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-industrial-knowledge","tag-dlc","tag-pue","tag-tdp","tag-164","tag-198","tag-224","tag-223"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.taichungbro.com\/en\/wp-json\/wp\/v2\/posts\/2724","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.taichungbro.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.taichungbro.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.taichungbro.com\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.taichungbro.com\/en\/wp-json\/wp\/v2\/comments?post=2724"}],"version-history":[{"count":0,"href":"https:\/\/www.taichungbro.com\/en\/wp-json\/wp\/v2\/posts\/2724\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.taichungbro.com\/en\/wp-json\/wp\/v2\/media\/2782"}],"wp:attachment":[{"href":"https:\/\/www.taichungbro.com\/en\/wp-json\/wp\/v2\/media?parent=2724"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.taichungbro.com\/en\/wp-json\/wp\/v2\/categories?post=2724"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.taichungbro.com\/en\/wp-json\/wp\/v2\/tags?post=2724"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}