DeeperML

Nvidia has unveiled new tools and capabilities designed to streamline AI deployment and enhance efficiency for enterprises. A key component of this release is the general availability of NVIDIA NeMo microservices, empowering companies to construct AI agents that leverage data flywheels to improve employee productivity. These microservices provide an end-to-end platform for developers, allowing them to create and continuously optimize state-of-the-art agentic AI systems through the integration of inference, business, and user feedback data. The company also highlighted the importance of maintaining a constant stream of high-quality inputs to ensure the accuracy, relevance, and timeliness of AI agents.

Nvidia is also introducing the G-Assist plug-in builder, a tool enabling customization of AI on GeForce RTX AI PCs. This plug-in builder expands the functionality of G-Assist by allowing users to add new commands and connect external tools, which can range from large language models to simple functions like controlling music. Developers can use coding languages like JSON and Python to create tools integrated into G-Assist, and they can submit plug-ins for review and potential inclusion in the NVIDIA GitHub repository, making new capabilities available to others. G-Assist can be modified to perform different actions with different LLMs and software, gaming-related or not.

Researchers at the University College London (UCL) Deciding, Acting, and Reasoning with Knowledge (DARK) Lab are leveraging NVIDIA NIM microservices in their new game-based benchmark suite, BALROG, designed to evaluate the agentic capabilities of models on challenging, long-horizon interactive tasks. By using NVIDIA NIM, the DARK lab was able to accelerate their benchmarking process, deploying and hosting the DeepSeek-R1 model without needing to do so locally. This showcases the flexibility and efficiency of NIM microservices, which can be deployed across various platforms, including cloud environments, data centers, and local workstations, enabling seamless integration into diverse workflows and handling workloads of any size.

ImgSrc: techstrong.ai

References :

• techstrong.ai: NVIDIA Releases NeMo Microservices Bringing AI Agents to Enterprises
• www.nextplatform.com: Nvidia NeMo Microservices For AI Agents Hits The Market
• blogs.nvidia.com: Enterprises Onboard AI Teammates Faster With NVIDIA NeMo Tools to Scale Employee Productivity
• developer.nvidia.com: Enhance Your AI Agent with Data Flywheels Using NVIDIA NeMo Microservices
• NVIDIA Technical Blog: Enhance Your AI Agent with Data Flywheels Using NVIDIA NeMo Microservices
• The Next Platform: Nvidia NeMo Microservices For AI Agents Hits The Market
• The Register - Software: This article discusses NVIDIA's NeMo microservices, software tools for building AI agents, and their role in enterprise workflows.
• MarkTechPost: Long-Context Multimodal Understanding No Longer Requires Massive Models: NVIDIA AI Introduces Eagle 2.5, a Generalist Vision-Language Model that Matches GPT-4o on Video Tasks Using Just 8B Parameters
• NVIDIA Newsroom: Enterprises Onboard AI Teammates Faster With NVIDIA NeMo Tools to Scale Employee Productivity
• cloudnativenow.com: NVIDIA Makes Microservices Framework for AI Apps Generally Available
• www.tomshardware.com: Nvidia introduces G-Assist plug-in builder, allowing its AI to integrate with LLMs and software
• techstrong.ai: NeMo microservices, the software tools behind AI agents for enterprises, are now available in general availability, working with partner platforms to offer prompt tuning, supervised fine-tuning, and knowledge retrieval.

Classification:

• HashTags: #NvidiaAI #AIMicroservices #RTXAI
• Company: Nvidia
• Target: Enterprises
• Product: NeMo
• Feature: AI Deployment
• Type: AI
• Severity: Informative