Latest Benchmarks Show Supermicro Systems with the NVIDIA B200 Outperformed the Previous Generation of Systems with 3X the Token Generation Per Second
SAN JOSE, Calif., April 3, 2025 /PRNewswire/ -- Super Micro Computer, Inc. (SMCI), a Total IT Solution Provider for AI/ML, HPC, Cloud, Storage, and 5G/Edge, is announcing first-to-market industry leading performance on several MLPerf Inference v5.0 benchmarks, using the NVIDIA HGXâ„¢ B200 8-GPU. The 4U liquid-cooled and 10U air-cooled systems achieved the best performance in select benchmarks. Supermicro demonstrated more than 3 times the tokens per second (Token/s) generation for Llama2-70B and Llama3.1-405B benchmarks compared to H200 8-GPU systems.
"Supermicro remains a leader in the AI industry, as evidenced by the first new benchmarks released by MLCommons in 2025," said Charles Liang, president and CEO of Supermicro. "Our building block architecture enables us to be first-to-market with a diverse range of systems optimized for various workloads. We continue to collaborate closely with NVIDIA to fine-tune our systems and secure a leadership position in AI workloads."
Learn more about the new MLPerf v5.0 Inference benchmarks at: https://mlcommons.org/benchmarks/inference-datacenter/
Supermicro is the only system vendor publishing record MLPerf inference performance (on select benchmarks) for both the air-cooled and liquid-cooled NVIDIA HGXâ„¢ B200 8-GPU systems. Both air-cooled and liquid-cooled systems were operational before the MLCommons benchmark start date. Supermicro engineers optimized the systems and software to showcase the impressive performance. Within the operating margin, the Supermicro air-cooled B200 system exhibited the same level of performance as the liquid-cooled B200 system. Supermicro has been delivering these systems to customers while we conducted the benchmarks.
MLCommons emphasizes that all results be reproducible, that the products are available and that the results can be audited by other MLCommons members. Supermicro engineers optimized the systems and software, as allowed by the MLCommons rules.
The SYS-421GE-NBRT-LCC (8x NVIDIA B200-SXM-180GB) and SYS-A21GE-NBRT (8x NVIDIA B200-SXM-180GB) showed performance leadership running the Mixtral 8x7B Inference, Mixture of Experts benchmarks with 129,000 tokens/second. The Supermicro air-cooled and liquid-cooled NVIDIA B200 based system delivered over 1,000 tokens/second inference for the large Llama3.1-405b model, whereas the previous generations of GPU systems have much smaller results. For smaller inferencing tasks, using the LLAMA2-70b benchmark, a Supermicro system with the NVIDIA B200 SXM-180GB installed shows the highest performance from a Tier 1 system supplier.
Specifically:
"MLCommons congratulates Supermicro on their submission to the MLPerf Inference v5.0 benchmark. We are pleased to see their results showcasing significant performance gains compared to earlier generations of systems," said David Kanter, Head of MLPerf at MLCommons. "Customers will be pleased by the performance improvements achieved which are validated by the neutral, representative and reproducible MLPerf results."
Supermicro offers a comprehensive AI portfolio with over 100 GPU-optimized systems, both air-cooled and liquid-cooled options, with a choice of CPUs, ranging from single-socket optimized systems to 8-way multiprocessor systems. Supermicro rack-scale systems include computing, storage, and network components, which reduce the time required to install them once they are delivered to a customer site.
Supermicro's NVIDIA HGX B200 8-GPU systems utilize next-generation liquid-cooling and air-cooling technology. The newly developed cold plates and the new 250kW coolant distribution unit (CDU) more than double the cooling capacity of the previous generation in the same 4U form factor. Available in 42U, 48U, or 52U configurations, the rack-scale design with the new vertical coolant distribution manifolds (CDM) no longer occupies valuable rack units. This enables eight systems, comprising 64 NVIDIA Blackwell GPUs in a 42U rack, and up to 12 systems with 96 NVIDIA Blackwell GPUs in a 52U rack.
The new air-cooled 10U NVIDIA HGX B200 system features a redesigned chassis with expanded thermal headroom to accommodate eight 1000W TDP Blackwell GPUs. Up to 4 of the new 10U air-cooled systems can be installed and fully integrated in a rack, the same density as the previous generation, while providing up to 15x inference and 3x training performance.
About Super Micro Computer, Inc.
Supermicro (NASDAQ: SMCI) is a global leader in Application-Optimized Total IT Solutions. Founded and operating in San Jose, California, Supermicro is committed to delivering first-to-market innovation for Enterprise, Cloud, AI, and 5G Telco/Edge IT Infrastructure. We are a Total IT Solutions provider with server, AI, storage, IoT, switch systems, software, and support services. Supermicro's motherboard, power, and chassis design expertise further enables our development and production, enabling next-generation innovation from cloud to edge for our global customers. Our products are designed and manufactured in-house (in the US, Asia, and the Netherlands), leveraging global operations for scale and efficiency and optimized to improve TCO and reduce environmental impact (Green Computing). The award-winning portfolio of Server Building Block Solutions® allows customers to optimize for their exact workload and application by selecting from a broad family of systems built from our flexible and reusable building blocks that support a comprehensive set of form factors, processors, memory, GPUs, storage, networking, power, and cooling solutions (air-conditioned, free air cooling or liquid cooling).
Supermicro, Server Building Block Solutions, and We Keep IT Green are trademarks and/or registered trademarks of Super Micro Computer, Inc.
All other brands, names, and trademarks are the property of their respective owners.
** The press release content is from PR Newswire. Bastille Post is not involved in its creation. **
Industry's First-to-Market Supermicro NVIDIA HGX™ B200 Systems Demonstrate AI Performance Leadership on MLPerf® Inference v5.0 Results
SHENZHEN, China, April 11, 2025 /PRNewswire/ -- Recently, Yole Group, an international research institute and market research & strategy consulting company, released the LiDAR for Automotive 2025 report (hereinafter referred to as the "Report"). According to the Report, RoboSense has secured three global No.1 positions in the automotive LiDAR market: No.1 in 2024 global passenger car LiDAR market share, annual sales champion for ADAS LiDAR, and cumulative ADAS sales champion from 2018 to 2024. These achievements further demonstrate RoboSense's leading position and strong capabilities in the global LiDAR industry.
The Report also highlights RoboSense's progress in globalization, expansion into the Robotaxi market, and cutting-edge technology development over the past year, indicating a promising future.
Market Leadership
Market Share Leader, Annual and Cumulative Sales Champion
According to the Report, the global passenger car LiDAR market is experiencing rapid growth, with a 68% YOY increase in 2024 and market size reaching USD 692 million. RoboSense ranked first globally with a 26% market share. Thanks to the widespread adoption of high-level ADAS with LiDAR in China, the global market is booming, with Chinese LiDAR brands accounting for 92% of global share — closely linked to Chinese automakers' large-scale deployment and reliance on domestic supply chains.
The Report also notes that approximately 1.6 million LiDAR units were installed in passenger vehicles globally in 2024, more than doubling from the previous year. RoboSense ranked No.1 in global annual sales with 519,800 units sold. Among the rapidly expanding passenger car LiDAR market, the Report identifies RoboSense as the leader among the "Big Four" Chinese LiDAR companies.
RoboSense's impressive market performance is the result of its long-standing commitment to market-driven collaboration and continuous technological innovation. As of the end of March 2025, RoboSense has established close partnerships with over 30 OEMs and Tier 1 suppliers worldwide, including BYD, Zeekr, and IM, with more than 100 vehicle models awarded. From January to March 2025, RoboSense has supported the launch and debut of 15 collaborative models, including Toyota bZ3X, GAC Trumpchi S7, and Geely Galaxy E8. With the rapid adoption of L2+ advanced driving assistance systems, over 10 vehicle models in the ¥150,000–¥200,000 range have launched mass-produced models equipped with RoboSense LiDAR.
Furthermore, Yole Group estimates that between 2018 and 2024, RoboSense led the cumulative global passenger car LiDAR sales with over 800,000 units sold, far ahead of other brands — solidifying its position as a global leader in LiDAR technology and delivery capabilities.
Accelerating Global Expansion
Mass Production Collaboration in EU, U.S., and Japan
The Report indicates that China, the EU, the U.S., Japan, and Korea are all showing active plans to release car models equipped with LiDAR. Chinese OEMs are expected to release 111 car models with LiDAR in 2025 or soon after. EU OEMs are projected to launch 4+ car models with LiDAR, while U.S. OEMs plan to release 2. Additionally, Japanese and Korean OEMs are expected to release 2+ car models with LiDAR in 2024 or soon after.
While maintaining its leading position in China, RoboSense is rapidly expanding globally with its high-performance and highly reliable LiDAR products, becoming a preferred partner for overseas OEMs in their smart transformation. RoboSense has secured 8 overseas and Sino-foreign joint venture brand partnerships, including a top-tier Sino-American joint venture automaker, all three of Japan's top automakers, two Sino-European collaborative brands, a leading emerging automaker in North America, and a North American new energy vehicle brand — covering major automotive markets across Europe, North America, and Asia-Pacific.
L4 LiDAR Market
Rapid Expansion and Securing Multiple Leading Robotaxi Clients
As the global Robotaxi market shifts from pilot programs to large-scale deployment, the number of LiDAR units per vehicle is expected to rise significantly, accelerating growth in the L4 LiDAR segment.
Yole Group forecasts that the global L4 LiDAR market will reach USD 166 million in 2024, a 35% YOY increase. Among the 10 L4 autonomous driving companies listed in the Report, six have adopted RoboSense's LiDAR product, reflecting its exceptional performance and industry recognition.
With its stable, reliable, and automotive-grade LiDAR, RoboSense is poised to become a mainstream supplier for commercial Robotaxi vehicles, unlocking significant growth opportunities.
Cutting-Edge Technology and Full Product Portfolio
Full-Stack Chip Self-Development Drives Digital Transformation
The Report also analyzes technology trends among leading global LiDAR suppliers. According to Yole Group, RoboSense is the only global LiDAR brand offering a complete portfolio that includes mechanical, 1D and 2D hybrid solid-state, and full solid-state LiDAR products — leveraging innovation to stay ahead in diverse application scenarios.
Yole Group also notes that RoboSense, among others, has begun incorporating SPAD-SoC chips in its latest product designs. By combining VCSEL with SPAD-SoC, LiDAR systems can achieve longer detection range and higher resolution, breaking through performance limitations.
As a pioneer of LiDAR technology, RoboSense integrated LiDAR technology architecture in 2024 and mastered full-stack chip self-development, covering transceiving, scanning, and data processing. With a comprehensive product platform featuring "1D mechanical scanning, 2D MEMS scanning, and all-solid-state array scanning," RoboSense has pioneered the mass production of digital LiDAR and established the industry's most complete product portfolio. This allows rapid development and iteration to meet the diverse needs of intelligent driving, robotics, and other applications.
Amid widespread adoption of intelligent driving and rapid growth in the robotics industry, demand for LiDAR sensors and fusion perception solutions is rising rapidly. As the world's first company to ship over one million LiDAR units, RoboSense will continue to strengthen its global leadership in technology and mass production, driving the industry toward a smarter, safer, and more efficient future.
About RoboSense
RoboSense (2498.HK), founded in 2014, is an AI-driven robotic technology company that supplies advanced and reliable incremental components and solutions for the robotic industry. The company is committed to "become a global leader in robotic technology platforms," and its mission is "Safer world, Smarter life." For more information about RoboSense, visit https://www.robosense.ai
** The press release content is from PR Newswire. Bastille Post is not involved in its creation. **
RoboSense Ranked No. 1 in Global Passenger Car LiDAR Market Share, Annual and Cumulative Sales in 2024 | Yole Annual Report
RoboSense Ranked No. 1 in Global Passenger Car LiDAR Market Share, Annual and Cumulative Sales in 2024 | Yole Annual Report
RoboSense Ranked No. 1 in Global Passenger Car LiDAR Market Share, Annual and Cumulative Sales in 2024 | Yole Annual Report
