{"id":144637,"date":"2023-08-09T15:30:06","date_gmt":"2023-08-09T06:30:06","guid":{"rendered":"http:\/\/ee.presscat.kr\/?post_type=ai-in-circuit&p=144637"},"modified":"2026-04-05T10:46:44","modified_gmt":"2026-04-05T01:46:44","slug":"ee-professor-kim-joo-young-developed-a-chatgpt-core-ai-semiconductor-with-a-2-4-fold-improvement-in-price-efficiency","status":"publish","type":"ai-in-circuit","link":"http:\/\/ee.presscat.kr\/en\/ai-in-circuit\/ee-professor-kim-joo-young-developed-a-chatgpt-core-ai-semiconductor-with-a-2-4-fold-improvement-in-price-efficiency\/","title":{"rendered":"EE Professor Kim Joo-Young Developed A ChatGPT Core AI Semiconductor with A 2.4-fold Improvement in Price efficiency"},"content":{"rendered":"

EE Professor Kim Joo-Young Developed A ChatGPT Core AI Semiconductor with A 2.4-fold Improvement in Price efficiency<\/span><\/strong><\/span><\/p>\n

 <\/p>\n

 <\/p>\n

\"\"<\/p>\n

 <\/p>\n

The ChatGPT released by OpenAI has captured global attention, and everyone is closely observing the changes this technology will bring out. <\/span><\/p>\n

This technology is based on large language models (LLM), which represent an unprecedented scale of artificial intelligence (AI) models compared to conventional AI. <\/span><\/p>\n

However, the operation of these models requires a significant number of high-performance GPUs, leading to astronomical computing costs. \u00a0<\/span><\/p>\n

 <\/p>\n

KAIST (President: Lee Kwang-Hyung) announced that research team led by EE Professor Kim Joo-Young Kim has successfully developed an AI semiconductor that efficiently accelerates the inference operations of large language models, which play a crucial role in ChatGPT.\u00a0<\/span><\/p>\n

The developed AI semiconductor, named the ‘Latency Processing Unit (LPU),’ efficiently accelerates the inference operations of large language models. It incorporates a high-speed computing engine capable of maximizing memory bandwidth utilization and performing all necessary inference computations rapidly.<\/span><\/p>\n

Additionally, it comes equipped built-in networking capabilities, making it easily expandable with multiple accelerators.\u00a0This LPU-based acceleration appliance server achieved up to a 50% higher performance and approximately 2.4 times better performance-to-price ratio compared to a supercomputer based on the industry-leading high-performance GPU, NVIDIA A100.<\/span><\/p>\n

 <\/p>\n

This advancement holds the potential to replace high-performance GPUs in data centers that are experiencing a rapid surge in demand for generative AI services.\u00a0This research was conducted by Professor HyperExcel Co., founded by Professor Kim Joo-Young and achieved the remarkable accomplishment of receiving the “Engineering Best Presentation Award” at the International Design Automation Conference (DAC 2023) held in San Francisco on July 12th (U.S. time).<\/span><\/p>\n

DAC is a prestigious international conference in the field of semiconductor design, particularly showcasing global semiconductor design technologies related to Electronic Design Automation (EDA) and Semiconductor Intellectual Property (IP).<\/span><\/p>\n

DAC attracts participation from renowned semiconductor design companies such as Intel, NVIDIA, AMD, Google, Microsoft, Samsung, TSMC, as well as top universities including Harvard, MIT, and Stanford.<\/span><\/p>\n

 <\/p>\n

Among the world\u2019s notable semiconductor technologies, Professor Kim’s team stands out as the sole recipient of an award for AI semiconductor technology tailored for large language models.<\/span><\/p>\n

This award acknowledges their AI semiconductor solution as a groundbreaking means to drastically reduce the substantial costs associated with inference operations for large language models on the global stage.<\/span><\/p>\n

 <\/p>\n

Professor Kim stated, “With the new processor ‘LPU’ for future large AI computations, I intend to pioneer the global market and take a lead over big tech companies in terms of technological prowess.”<\/span><\/p>\n

(Note: The provided translation is an elaboration and summary of the original text for clarity and readability.)<\/span><\/p>\n

 <\/p>\n

\"\"<\/span><\/p>\n

[Related News]<\/span><\/div>\n
Chosun Ilbo :\u00a0\ucc57GPT \uac00\uc131\ube44 2.4\ubc30 \ub192\uc774\ub294 \ubc18\ub3c4\uccb4 \ub098\uc654\ub2e4 – \uc870\uc120\ube44\uc988 (chosun.com)<\/a>\u00a0<\/span><\/div>\n
DongA Science :\u00a0\ucc57GPT \ud6a8\uc728 \ub192\uc77c ‘AI \ubc18\ub3c4\uccb4’ \uac1c\ubc1c\u2026\uad6d\uc81c\ud559\ud68c\uc11c ‘\ucd5c\uace0 \ubc1c\ud45c\uc0c1’ : \ub3d9\uc544\uc0ac\uc774\uc5b8\uc2a4 (dongascience.com)<\/a>\u00a0<\/span><\/div>\n
\u00a0<\/div>\n","protected":false},"excerpt":{"rendered":"

1298<\/p>\n","protected":false},"featured_media":0,"template":"","class_list":["post-144637","ai-in-circuit","type-ai-in-circuit","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"http:\/\/ee.presscat.kr\/en\/wp-json\/wp\/v2\/ai-in-circuit\/144637","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/ee.presscat.kr\/en\/wp-json\/wp\/v2\/ai-in-circuit"}],"about":[{"href":"http:\/\/ee.presscat.kr\/en\/wp-json\/wp\/v2\/types\/ai-in-circuit"}],"wp:attachment":[{"href":"http:\/\/ee.presscat.kr\/en\/wp-json\/wp\/v2\/media?parent=144637"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}