DeeperML

AMD has announced Gaia, an open-source project enabling the local execution of Large Language Models (LLMs) on any PC. This initiative aims to bring AI processing closer to users by facilitating the running of LLMs directly on Windows machines. Gaia is designed to run various LLM models and offers performance optimizations for PCs equipped with Ryzen AI processors, including the Ryzen AI Max 395+.

Gaia utilizes the open-source Lemonade SDK from ONNX TurnkeyML for LLM inference, allowing models to adapt for tasks such as summarization and complex reasoning. It functions through a Retrieval-Augmented Generation agent, combining an LLM with a knowledge base for interactive AI experiences and accurate responses. Gaia offers several agents including Simple Prompt Completion, Chaty, Clip, and Joker. The new AI chatbot has two installers: a mainstream installer that works on any Windows PC and a "Hybrid" installer optimized for Ryzen AI PCs, using the XDNA NPU and RDNA iGPU.

ImgSrc: cdn.mos.cms.fut

References :

• BigDATAwire: NVIDIA Pushes Boundaries of Apache Spark With RAPIDS and Project Aether
• www.tomshardware.com: AMD introduces Gaia, an open-source project designed to run large language models locally on any PC. It also boasts optimizations to run quickly on Ryzen AI-equipped PCs.

Classification:

• HashTags: #AI #OpenSource #LocalAI
• Company: NVIDIA
• Target: PCs
• Product: Gaia
• Feature: Local LLM execution
• Malware: Gaia
• Type: AI
• Severity: Informative