DEAL Galaxy S24 FE, Galaxy Watch 7. Subscribe today and be the first to learn about One 7 beta!

SamMobile has affiliate and sponsored partnerships. If you buy something through one of these links, we may earn a commission.

News For You
News For You
Notifications

NVIDIA announces H200 GPU with better memory for generative AI

Tech
By 

Last updated: November 14th, 2023 at 16:33 UTC+01:00

NVIDIA has announced a new enterprise-grade GPU with improved AI computing capabilities for generative AI and large language model workloads. The upcoming NVIDIA H200 is the first GPU to boast HMB3e memory, which is faster and has greater capacity than the previous solution used by the NVIDIA H100.

Although the H200 is essentially the same as the H100, aside from the memory upgrade, the improvements enabled by the HMB3e memory are substantial.

The company says that the new memory used by the upcoming H200 GPU offers a bandwidth of 4.8 terabytes per second and a total memory capacity of 141B. In contrast, the NVIDIA H100 GPU achieved a memory bandwidth of 3.35 terabytes per second and 80GB capacity.

Story continues after the video

“With NVIDIA H200, the industry's leading end-to-end AI supercomputing platform just got faster to solve some of the world's most important challenges,” said NVIDIA vice president of hyperscale and HPC, Ian Buck.

The NVIDIA H200 will be available in HGX H200 server boards with four and eight-way configurations compatible with the hardware and software of the current HGX H100 systems.

Will H200 availability be a problem?

The US-based GPU manufacturer says the H200 GPU will be shipping in the second quarter of 2024.

With the previous H100 GPU, NVIDIA had issues meeting the high demand (via The Verge). Whether or not the H200 GPU will face the same supply issues is to be determined. However, NVIDIA says it's working with the “world's leading server manufacturers and cloud service providers” for a Q2 2024 release.

In other AI news, Samsung has just announced its generative AI and large language model solution, Gauss. It will be used as the basis for new on-device AI for the Galaxy S24 series. One of the first AI-based features available for the Galaxy S24 will enable users to carry real-time phone conversations with people who speak a different language.

Tech AINvidia
Galaxy AI summarized

Scroll for more related content
News For You

You might also like

Samsung hints its flagship HBM3E chips being approved by Nvidia

Samsung hints its flagship HBM3E chips being approved by Nvidia

Samsung announced its earnings for the third quarter earlier today. A large part of its earnings call was spent discussing memory chips since those are considered the company's biggest source of profit. However, the company had problems getting its high-bandwidth memory (HBM) chips approved by Nvidia, the world's biggest AI chip firm. Now, the company […]

  • By Asif Iqbal Shaik
  • 15 hours ago
Apple AI is now live, doesn’t look like a threat to Samsung Galaxy AI

Apple AI is now live, doesn’t look like a threat to Samsung Galaxy AI

Samsung was the first OEM to really push the concept of generative AI tools into the mainstream. It started at the beginning of the year with the launch of the Galaxy S24 series featuring the Galaxy AI suite, and the saga continued throughout the year without much competition standing in Samsung's way. Today, that should […]

  • By Mihai Matei
  • 3 days ago
Samsung to unveil One UI 7.0 at SDC Korea next month?

Samsung to unveil One UI 7.0 at SDC Korea next month?

Earlier this month, the Samsung Developer Conference (SDC) 2024 was held in the US, but the company didn't unveil the design and features of One UI 7.0 at the event. Instead, it said it would open the One UI 7.0 Beta Program before the end of this year. Now, it appears that it could open […]

  • By Asif Iqbal Shaik
  • 3 days ago
You can install native ChatGPT app on your Galaxy Book laptop

You can install native ChatGPT app on your Galaxy Book laptop

ChatGPT has changed the world of technology over the past couple of years. Ever since it was launched, several technology firms have started adding Generative AI-powered features to their products and services. However, ChatGPT didn't have a native Windows client. That changed recently when OpenAI launched its app for Windows-powered devices like the Galaxy Books. […]

  • By Abid Iqbal Shaik
  • 3 days ago
Samsung brings Generative AI wallpapers to its 2024 TVs

Samsung brings Generative AI wallpapers to its 2024 TVs

Samsung has announced it is bringing Generative AI wallpapers to its most recent high-end TVs. This feature debuted with the Galaxy S24 series earlier this year and then expanded to older high-end smartphones. The company announced it will bring the feature to its TVs at the Samsung Developer Conference (SDC) 2024. Samsung's TVs launched in […]

  • By Asif Iqbal Shaik
  • 1 week ago
Nvidia could get some of its gaming chips made by Samsung

Nvidia could get some of its gaming chips made by Samsung

Over the past couple of years, Samsung has lost two big-name chip clients—Nvidia and Qualcomm—to TSMC due to power consumption issues. However, Nvidia could come back to Samsung Foundry in the future, as it doesn't want to rely too much on TSMC for its future chips. This is great news for Samsung. Nvidia's future GPUs […]

  • By Asif Iqbal Shaik
  • 2 weeks ago