KT Cloud releases AI inference GPU infrastructure service

AI SERV allows the constant use of low-capacity GPUs to lower cost

KT Cloud releases AI inference GPU infrastructure service
Ji-Eun Jeong 1
2023-10-17 10:48:35 jeong@hankyung.com
Tech, Media & Telecom

South Korea’s KT Cloud on Monday launched the service AI SERV, which allows the use of infrastructure for high-performance graphics processing units (GPU) designed for artificial intelligence (AI) inference at reasonable cost. 

AI inference requires the use of low-capacity GPUs at all times, while large-scale AI learning intensively employs large-capacity GPUs for a short time.

“Use of the infrastructure for inference learning incurs more cost than necessary,” a KT Cloud source said. “We expect high demand for GPU infrastructure services specialized for inference.”

AI SERV uses slicing technology in which the GPU service, which was previously provided in a single unit with a value of 1, is divided into five units each with a smaller value of 0.2. This prevents infrastructure waste by reducing the minimum usable unit. 

KT Cloud targets as clients of AI SERV corporate providers of AI services after the company completes AI development and learning.
 
Write to Ji-Eun Jeong at jeong@hankyung.com
#KT Cloud #AI SERV #high-performance GPU #slicing technology

KT Cloud to adopt liquid immersion cooling system for data centers

KT Cloud to adopt liquid immersion cooling system for data centers

South Korea’s KT Cloud on Tuesday said it signed a deal with Immersion 4, a Swiss provider of liquid cooling solutions, to install next-generation immersion cooling technology at KT Cloud data centers.Immersion cooling removes heat by immersing information and communications technology

Korean KT Cloud to raise $452 mn from IMM via rights offering

Korean KT Cloud to raise $452 mn from IMM via rights offering

KT Cloud Summit 2023 on April 18, 2023 (Courtesy of KT Cloud) KT Cloud Corp., a subsidiary of South Korea’s telecom giant KT Corp., is set to raise 600 billion won ($452 million) from a unit of Seoul-based private equity powerhouse IMM Holdings Inc. through a rights offering.KT Cloud said

KT Cloud, DigitalBridge join hands for data center biz in Korea

KT Cloud, DigitalBridge join hands for data center biz in Korea

Yun Dong-sik (left), KT Cloud CEO, and Tae E. Ahn, managing director and head of Asia capital formation at DigitalBridge (Courtesy of KT Cloud) KT Cloud Co., the cloud computing unit under South Korea’s second-largest mobile carrier KT Corp., and US infrastructure investment firm DigitalB
(* comment hide *}