News from the AI & ML world
DeeperML - #llama
|
@www.eweek.com
//
Meta is making a significant move into military technology, partnering with Anduril Industries to develop augmented and virtual reality (XR) devices for the U.S. Army. This collaboration reunites Meta with Palmer Luckey, the founder of Oculus who was previously fired from the company. The initiative aims to provide soldiers with enhanced situational awareness on the battlefield through advanced perception capabilities and AI-enabled combat tools. The devices, potentially named EagleEye, will integrate Meta's Llama AI models with Anduril's Lattice system to deliver real-time data and improve operational coordination.
The new XR headsets are designed to support real-time threat detection, such as identifying approaching drones or concealed enemy positions. They will also provide interfaces for operating AI-powered weapon systems. Anduril states that the project will save the U.S. military billions of dollars by using high-performance components and technology originally developed for commercial use. The partnership reflects a broader trend of Meta aligning more closely with national security interests. In related news, Meta's research team has made a surprising discovery that shorter reasoning chains can significantly improve AI accuracy. A study released by Meta and The Hebrew University of Jerusalem found that AI models achieve 34.5% better accuracy when using shorter reasoning processes. This challenges the conventional belief that longer, more complex reasoning chains lead to better results. The researchers developed a new method called "short-m@k," which runs multiple reasoning attempts in parallel, halting computation once the first few processes are complete and selecting the final answer through majority voting. This method could reduce computing costs by up to 40% while maintaining performance levels. Recommended read:
References :
@www.marktechpost.com
//
Meta is making significant strides in the AI landscape, highlighted by the release of Llama Prompt Ops, a Python package aimed at streamlining prompt adaptation for Llama models. This open-source tool helps developers enhance prompt effectiveness by transforming inputs to better suit Llama-based LLMs, addressing the challenge of inconsistent performance across different AI models. Llama Prompt Ops facilitates smoother cross-model prompt migration and improves performance and reliability, featuring a transformation pipeline for systematic prompt optimization.
Meanwhile, Meta is expanding its AI strategy with the launch of a standalone Meta AI app, powered by Llama 4, to compete with rivals like Microsoft’s Copilot and ChatGPT. This app is designed to function as a general-purpose chatbot and a replacement for the “Meta View” app used with Meta Ray-Ban glasses, integrating a social component with a public feed showcasing user interactions with the AI. Meta also previewed its Llama API, designed to simplify the integration of its Llama models into third-party products, attracting AI developers with an open-weight model that supports modular, specialized applications. However, Meta's AI advancements are facing legal challenges, as a US judge is questioning the company's claim that training AI on copyrighted books constitutes fair use. The case, focusing on Meta's Llama model, involves training data including works by Sarah Silverman. The judge raised concerns that using copyrighted material to create a product capable of producing an infinite number of competing products could undermine the market for original works, potentially obligating Meta to pay licenses to copyright holders. Recommended read:
References :
Michael Nuñez@AI News | VentureBeat
//
Meta has officially launched its Llama API, marking a significant entry into the commercial AI services market. This move allows developers to easily explore and fine-tune artificial intelligence models, accessing inference speeds up to 18 times faster than traditional GPU-based solutions. Meta's partnership with Cerebras is central to this achievement, enabling processing speeds of 2,648 tokens per second for Llama 4. This partnership transforms Meta’s popular open-source Llama models into a commercial service and positions them to compete directly with OpenAI, Anthropic, and Google.
The Llama API leverages Cerebras’ specialized AI chips to deliver unprecedented speed increases. This breakthrough is a result of Meta's collaboration with Cerebras, whose system outperforms competitors like SambaNova and Groq, as well as traditional GPU-based services. The API provides access to a lightweight software development kit (SDK) compatible with OpenAI, streamlining the process for developers to convert models. As part of the launch, Meta is also providing partners with tools to detect and prevent threats such as phishing attacks and various types of online fraud created using AI technologies. Furthermore, Meta is working with Groq to accelerate the official Llama API, serving it on the world’s most efficient inference chip. Meta is also launching the Meta AI app, its first dedicated app for its AI assistant, powered by Llama 4. The app will include a discover feed so people can share and explore how others are using the AI. It is intended to provide a more personalized experience by adapting to user preferences and maintaining context across conversations. The Meta AI app represents a new way for users to interact with Meta's AI assistant beyond existing integrations with WhatsApp, Instagram, Facebook, and Messenger. Recommended read:
References :
@techcrunch.com
//
References:
techcrunch.com
, Last Week in AI
,
Meta's release of Llama 4, a multimodal LLM, has stirred controversy in the AI community. While it boasts multimodality and a large context window, the model has faced criticism due to its performance on a popular chat benchmark, LM Arena. Specifically, the "vanilla" version of the Maverick AI model, a variant of Llama 4, ranked below competitors like OpenAI's GPT-4o, Anthropic's Claude 3.5 Sonnet, and Google's Gemini 1.5 Pro, despite these models being several months old. This poor ranking raises questions about the model's reliability and the validity of the evaluation methodologies used.
Meta's initial strategy of using an experimental, unreleased version of Llama 4 Maverick to achieve a high score on LM Arena further exacerbated the issue. This prompted LM Arena maintainers to change their policies and re-evaluate the unmodified version, revealing its comparatively weak performance. Meta explained that the experimental version was optimized for conversationality, which may have artificially inflated its score on LM Arena. However, experts caution that tailoring a model to a specific benchmark can be misleading and may not accurately reflect its performance in real-world applications. The controversy surrounding Llama 4's benchmark results highlights the challenges in evaluating and comparing large language models. While benchmarks like LM Arena can provide some insights, they may not fully capture the nuances of model performance across different contexts. Meta's spokesperson stated that they experiment with "all types of custom variants" and are excited to see how developers customize Llama 4 for their own use cases, emphasizing the open-source nature of the release and the potential for future improvements based on community feedback. Recommended read:
References :
Carl Franzen@AI News | VentureBeat
//
Meta has recently unveiled its Llama 4 AI models, marking a significant advancement in the field of open-source AI. The release includes Llama 4 Maverick and Llama 4 Scout, with Llama 4 Behemoth and Llama 4 Reasoning expected to follow. These models are designed to be more efficient and capable than their predecessors, with a focus on improving reasoning, coding, and creative writing abilities. The move is seen as a response to the growing competition in the AI landscape, particularly from models like DeepSeek, which have demonstrated impressive performance at a lower cost.
The Llama 4 family employs a Mixture of Experts (MoE) architecture for enhanced efficiency. Llama 4 Maverick is a 400 billion parameter sparse model with 17 billion active parameters and 128 experts, making it suitable for general assistant and chat use cases. Llama 4 Scout, with 109 billion parameters and 17 billion active parameters across 16 experts, stands out with its 10 million token context window, enabling it to handle extensive text and large documents effectively, making it suitable for multi-document summarization and parsing extensive user activity. Meta's decision to release these models before LlamaCon gives developers ample time to experiment with them. While Llama 4 Maverick shows strength in areas such as large context retrieval and writing detailed responses, benchmarks indicate that DeepSeek v3 0324 outperforms it in coding and common-sense reasoning. Meta is also exploring the intersection of neuroscience and AI, with researchers like Jean-Rémi King investigating cognitive principles in artificial architectures. This interdisciplinary approach aims to further improve the reasoning and understanding capabilities of AI models, potentially leading to more advanced and human-like AI systems. Recommended read:
References :
Carl Franzen@AI News | VentureBeat
//
Meta has unveiled its latest advancements in AI with the Llama 4 family of models, consisting of Llama 4 Scout, Maverick, and the upcoming Behemoth. These models are designed for a variety of AI tasks, ranging from general chat to document summarization and advanced reasoning. Llama 4 Maverick, with 17 billion active parameters, is positioned as a general-purpose model ideal for image and text understanding tasks, making it suitable for chat applications and AI assistants. Llama 4 Scout is designed for document summarization.
Meta is emphasizing efficiency and accessibility with Llama 4. Both the Maverick and Scout models are designed to run efficiently, even on a single NVIDIA H100 GPU, showcasing Meta’s dedication to balancing high performance with reasonable resource consumption. TheSequence #530 highlights that Llama 4 brings unquestionable technical innovations. Furthermore, the Llama 4 series introduces three distinct models—Scout, Maverick, and Behemoth—designed for a range of use cases, from general-purpose reasoning to long-context and multimodal applications. The release of Llama 4 includes enhancements beyond its technical capabilities. In the UK, Ray-Ban Meta glasses are receiving an upgrade to integrate Meta AI features, enabling users to interact with their surroundings through questions and receive intelligent, context-aware responses. Soon to follow is the rollout of live translation on these glasses, facilitating real-time speech translation between English, Spanish, Italian, and French, further enhancing the user experience and accessibility. Recommended read:
References :
Alex Knapp,@Alex Knapp
//
References:
Meta Newsroom
, Alex Knapp
,
Meta's open-source large language model (LLM), Llama, has achieved a significant milestone, surpassing one billion downloads since its release in 2023. This achievement underscores the growing influence of Llama in the AI community, attracting both researchers and enterprises seeking to integrate it into various applications. The model's popularity has surged, with companies like Spotify, AT&T, and DoorDash adopting Llama-based models for production environments.
Meta views open sourcing AI models as crucial, with each download of Llama moving closer to this goal. However, Llama's widespread use hasn't been without its challenges, including copyright lawsuits alleging training on copyrighted books without permission. The company plans to introduce multimodal models and improved reasoning capabilities. Additionally, Meta has been working to incorporate innovations from competing models to enhance Llama's performance. Recommended read:
References :
|
BenchmarksBlogsResearch Tools |