News from the AI & ML world
DeeperML - #gpus
|
Ben Lorica@Gradient Flow
//
Nvidia's Dynamo is a new open-source framework designed to tackle the complexities of scaling AI inference operations. Dynamo optimizes how large language models operate across multiple GPUs, balancing individual performance with system-wide throughput. Introduced at the GPU Technology Conference, Nvidia CEO Jensen Huang has described it as "the operating system of an AI factory".
This framework includes components designed to function as an "air traffic control system" for AI processing. These key components include libraries like TensorRT-LLM and SGLang, which provide efficient mechanisms for handling token generation, memory management, and batch processing to improve throughput and reduce latency when serving AI models. Nvidia's nGPT combines transformers and state-space models to reduce costs and increase speed while maintaining accuracy.
Share:
References :
Classification:
staff@insidehpc.com
//
Nvidia's GTC 2025 event showcased the company's advancements in AI, particularly highlighting the integration of AI into various industries. CEO Jensen Huang emphasized that every industry is adopting AI and it is becoming critical for future revenue. Nvidia also unveiled an open Physical AI dataset to advance robotics and autonomous vehicle development. The dataset is claimed to be the world’s largest unified and open dataset for physical AI development, enabling the pretraining and post-training of AI models.
Central to Nvidia’s ambitions for Physical AI is its Omniverse platform, a digital development platform connecting spatial computing, 3D design, and physics-based workflows. Originally designed as a simulation and visualization tool, Omniverse has evolved significantly and has now become more of an operating system for Physical AI, allowing users to train autonomous systems before physical deployment. In quantum computing, SEEQC and Nvidia announced they have completed an end-to-end fully digital quantum-classical interface protocol demo between a QPU and GPU.
Share:
References :
Classification:
@www.cnbc.com
//
Nvidia's stock plummeted, experiencing a historic single-day loss of nearly $600 billion in market capitalization. This dramatic downturn was primarily fueled by investor concerns surrounding the rise of DeepSeek, a Chinese AI startup. The drop, which saw Nvidia shares fall by 16.86% to close at $118.58, marks the largest one-day market cap loss in US history, more than doubling any previous single day drop for an American company. Anxiety over DeepSeek's advancements has also triggered a sell-off in other US tech stocks pre-market and a slump in Japanese chip stocks, highlighting the widespread impact of the AI competition.
The market's negative reaction stems from DeepSeek's breakthroughs in AI training efficiency, which investors fear could reduce the demand for Nvidia's high-end GPUs. Concerns over DeepSeek are further compounded by a broader narrative of hardware competitors and the ability to translate Large Language Model code to avoid Nvidia's CUDA lock-in. DeepSeek's recent success with its low-cost AI model overtaking ChatGPT on the App store has intensified the worries, sparking discussions about a potential "Sputnik moment" for the US AI industry.
Share:
References :
Classification:
|
BenchmarksBlogsResearch Tools |