News from the AI & ML world

DeeperML - #aihallucinations

@siliconangle.com // 30d
Vectara has announced the launch of its Hallucination Corrector, a new guardian agent integrated within the Vectara platform designed to significantly improve the reliability and accuracy of AI agents and assistants. This innovative approach aims to reduce AI hallucinations to below 1%, addressing a critical challenge in enterprise AI deployments where accuracy is paramount. The Hallucination Corrector builds upon Vectara's existing leadership in hallucination detection and mitigation, offering organizations a solution that not only identifies unreliable responses but also provides explanations and options for correction.

The Hallucination Corrector functions as a 'guardian agent,' actively monitoring and protecting agentic workflows. It leverages the Hughes Hallucination Evaluation Model (HHEM), a widely-used tool with 4 million downloads on Hugging Face, to compare AI-generated responses against source documents and identify inaccuracies. When inconsistencies are detected, the Corrector provides detailed explanations and corrected versions of the responses, ensuring minimal changes are made to maintain accuracy. This capability is particularly beneficial for smaller language models, enabling them to achieve accuracy levels comparable to larger models from Google and OpenAI.

According to Vectara, initial testing of the Hallucination Corrector has shown promising results, reducing hallucination rates in enterprise AI systems to approximately 0.9%. The system not only identifies and corrects factual inconsistencies but also provides a detailed explanation of why a statement is a hallucination. While the corrected output is automatically used in summaries for end-users, experts can utilize the detailed explanations and suggested fixes to refine their models and guardrails, further mitigating the risk of hallucinations in AI applications. The Hallucination Corrector represents a significant step towards building trusted AI and unlocking the full potential of generative AI for enterprises.

Share: bluesky twitterx--v2 facebook--v1 threads


References :
  • aithority.com: Vectara Announces Significant Step Toward Greater Reliability & Accuracy for AI Agents and Assistants with Launch of Vectara Hallucination Corrector
  • SiliconANGLE: Vectara launches Hallucination Corrector to increase the reliability of enterprise AI
  • AI News | VentureBeat: Guardian agents: New approach could reduce AI hallucinations to below 1%
Classification:
  • HashTags: #Vectara #AIHallucinations #GuardianAgent
  • Company: Vectara
  • Target: Enterprises
  • Product: Hallucination Corrector
  • Feature: Hallucination Correction
  • Type: AI
  • Severity: Informative
@www.analyticsvidhya.com // 54d
OpenAI has launched its latest AI models, o3 and o4-mini, marking a significant upgrade in the company's offerings. According to Greg Brockman of OpenAI, these models "feel incredibly smart" and are already demonstrating potential in generating novel ideas for top scientists. These models are designed to provide better access to tools and enhance the ability to discern when to use them, ultimately delivering more practical value. The focus is on effective tool utilization, stringing tasks together, and maintaining persistence, which are key strengths of the o3 model. Sam Altman has announced the forthcoming release of o3-pro to the pro tier in the coming weeks.

The o3 model, in particular, is highlighted for its capabilities and tool use. It excels in scenarios requiring image generation, with or without reasoning, provided o3 has the necessary tools. It has been used to answer questions and helps with writing its own review. However, concerns have been raised regarding the naming conventions, with confusion surrounding the relationship between models like 4o-mini, o4-mini, and o4-mini-high. Usage is limited to 50 queries a week for o3, 150 a day for o4-mini and 50 a day for o4-mini-high for plus users, with 10 Deep Research queries per month.

The o3 and o4-mini models bring smarter tools and faster reasoning to ChatGPT, allowing the models to decide when to invoke web search, Python, file analysis, or image generation tools, finishing multi-step tasks in under a minute. The models can also "think with images," accepting sketches or screenshots and adjusting them during reasoning. O3 sets new highs on Codeforces and SWE‑bench and makes 20% fewer major errors than o1, while the leaner o4‑mini scores 99.5% pass‑at‑1 on the 2025 AIME with tools and offers higher rate limits. The new features are currently available to Pro and Team subscribers, with Enterprise, Education tiers and API access to follow soon.

Share: bluesky twitterx--v2 facebook--v1 threads


References :
  • thezvi.wordpress.com: Thezvi WordPress post discussing OpenAI's o3 and o4-mini models.
  • Interconnects: Interconnects.ai article about OpenAI's o3 over-optimization.
  • TestingCatalog: testingcatalog.com article about OpenAI's o3 and o4-mini bringing smarter tools and faster reasoning to ChatGPT
  • thezvi.wordpress.com: OpenAI has finally introduced us to the full o3 along with o4-mini. Greg Brockman (OpenAI): Just released o3 and o4-mini! These models feel incredibly smart. We’ve heard from top scientists that they produce useful novel ideas. Excited to see their …
  • www.techrepublic.com: OpenAI’s New AI Models o3 and o4-mini Can Now ‘Think With Images’
  • bdtechtalks.com: OpenAI's new reasoning models, o3 and o4-mini, enhance problem-solving capabilities and tool use, making them more effective than their predecessors.
  • bdtechtalks.com: What to know about o3 and o4-mini, OpenAI’s new reasoning models
  • THE DECODER: OpenAI has made the Deep Research tool in ChatGPT available to free-tier users. Access is limited to five uses per month, using a lightweight version based on the o4-mini-model.
  • TestingCatalog: OpenAI may have increased the o3 model's quota to 50 messages/day and added task-scheduling to o3 and o4 Mini. An "o3 Pro" tier might be on the horizon.
  • www.tomsguide.com: OpenAI has unveiled a cheaper but less effective deep research tool that'll be used across tiers and also available for free.
  • TestingCatalog: OpenAI tests Deep Research Mini tool for free ChatGPT users
Classification:
Chris McKay@Maginative // 57d
OpenAI has released its latest AI models, o3 and o4-mini, designed to enhance reasoning and tool use within ChatGPT. These models aim to provide users with smarter and faster AI experiences by leveraging web search, Python programming, visual analysis, and image generation. The models are designed to solve complex problems and perform tasks more efficiently, positioning OpenAI competitively in the rapidly evolving AI landscape. Greg Brockman from OpenAI noted the models "feel incredibly smart" and have the potential to positively impact daily life and solve challenging problems.

The o3 model stands out due to its ability to use tools independently, which enables more practical applications. The model determines when and how to utilize tools such as web search, file analysis, and image generation, thus reducing the need for users to specify tool usage with each query. The o3 model sets new standards for reasoning, particularly in coding, mathematics, and visual perception, and has achieved state-of-the-art performance on several competition benchmarks. The model excels in programming, business, consulting, and creative ideation.

Usage limits for these models vary, with o3 at 50 queries per week, and o4-mini at 150 queries per day, and o4-mini-high at 50 queries per day for Plus users, alongside 10 Deep Research queries per month. The o3 model is available to ChatGPT Pro and Team subscribers, while the o4-mini models are used across ChatGPT Plus. OpenAI says o3 is also beneficial in generating and critically evaluating novel hypotheses, especially in biology, mathematics, and engineering contexts.

Share: bluesky twitterx--v2 facebook--v1 threads


References :
  • Simon Willison's Weblog: OpenAI are really emphasizing tool use with these: For the first time, our reasoning models can agentically use and combine every tool within ChatGPT—this includes searching the web, analyzing uploaded files and other data with Python, reasoning deeply about visual inputs, and even generating images. Critically, these models are trained to reason about when and how to use tools to produce detailed and thoughtful answers in the right output formats, typically in under a minute, to solve more complex problems.
  • the-decoder.com: OpenAI’s new o3 and o4-mini models reason with images and tools
  • venturebeat.com: OpenAI launches o3 and o4-mini, AI models that ‘think with images’ and use tools autonomously
  • www.analyticsvidhya.com: o3 and o4-mini: OpenAI’s Most Advanced Reasoning Models
  • www.tomsguide.com: OpenAI's o3 and o4-mini models
  • Maginative: OpenAI’s latest models—o3 and o4-mini—introduce agentic reasoning, full tool integration, and multimodal thinking, setting a new bar for AI performance in both speed and sophistication.
  • THE DECODER: OpenAI’s new o3 and o4-mini models reason with images and tools
  • Analytics Vidhya: o3 and o4-mini: OpenAI’s Most Advanced Reasoning Models
  • www.zdnet.com: These new models are the first to independently use all ChatGPT tools.
  • The Tech Basic: OpenAI recently released its new AI models, o3 and o4-mini, to the public. Smart tools employ pictures to address problems through pictures, including sketch interpretation and photo restoration.
  • thetechbasic.com: OpenAI’s new AI Can “See†and Solve Problems with Pictures
  • www.marktechpost.com: OpenAI Introduces o3 and o4-mini: Progressing Towards Agentic AI with Enhanced Multimodal Reasoning
  • MarkTechPost: OpenAI Introduces o3 and o4-mini: Progressing Towards Agentic AI with Enhanced Multimodal Reasoning
  • analyticsindiamag.com: Access to o3 and o4-mini is rolling out today for ChatGPT Plus, Pro, and Team users.
  • THE DECODER: OpenAI is expanding its o-series with two new language models featuring improved tool usage and strong performance on complex tasks.
  • gHacks Technology News: OpenAI released its latest models, o3 and o4-mini, to enhance the performance and speed of ChatGPT in reasoning tasks.
  • www.ghacks.net: OpenAI Launches o3 and o4-Mini models to improve ChatGPT's reasoning abilities
  • Data Phoenix: OpenAI releases new reasoning models o3 and o4-mini amid intense competition. OpenAI has launched o3 and o4-mini, which combine sophisticated reasoning capabilities with comprehensive tool integration.
  • Shelly Palmer: OpenAI Quietly Reshapes the Landscape with o3 and o4-mini. OpenAI just rolled out a major update to ChatGPT, quietly releasing three new models (o3, o4-mini, and o4-mini-high) that offer the most advanced reasoning capabilities the company has ever shipped.
  • THE DECODER: Safety assessments show that OpenAI's o3 is probably the company's riskiest AI model to date
  • shellypalmer.com: OpenAI Quietly Reshapes the Landscape with o3 and o4-mini
  • BleepingComputer: OpenAI details ChatGPT-o3, o4-mini, o4-mini-high usage limits
  • TestingCatalog: OpenAI’s o3 and o4‑mini bring smarter tools and faster reasoning to ChatGPT
  • simonwillison.net: Introducing OpenAI o3 and o4-mini
  • bdtechtalks.com: What to know about o3 and o4-mini, OpenAI’s new reasoning models
  • bdtechtalks.com: What to know about o3 and o4-mini, OpenAI’s new reasoning models
  • thezvi.wordpress.com: OpenAI has finally introduced us to the full o3 along with o4-mini. Greg Brockman (OpenAI): Just released o3 and o4-mini! These models feel incredibly smart. We’ve heard from top scientists that they produce useful novel ideas. Excited to see their …
  • thezvi.wordpress.com: OpenAI has upgraded its entire suite of models. By all reports, they are back in the game for more than images. GPT-4.1 and especially GPT-4.1-mini are their new API non-reasoning models.
  • felloai.com: OpenAI has just launched a brand-new series of GPT models—GPT-4.1, GPT-4.1 mini, and GPT-4.1 nano—that promise major advances in coding, instruction following, and the ability to handle incredibly long contexts.
  • Interconnects: OpenAI's o3: Over-optimization is back and weirder than ever
  • www.ishir.com: OpenAI has released o3 and o4-mini, adding significant reasoning capabilities to its existing models. These advancements will likely transform the way users interact with AI-powered tools, making them more effective and versatile in tackling complex problems.
  • www.bigdatawire.com: OpenAI released the models o3 and o4-mini that offer advanced reasoning capabilities, integrated with tool use, like web searches and code execution.
  • Drew Breunig: OpenAI's o3 and o4-mini models offer enhanced reasoning capabilities in mathematical and coding tasks.
  • TestingCatalog: OpenAI’s o3 and o4-mini bring smarter tools and faster reasoning to ChatGPT
  • www.techradar.com: ChatGPT model matchup - I pitted OpenAI's o3, o4-mini, GPT-4o, and GPT-4.5 AI models against each other and the results surprised me
  • www.techrepublic.com: OpenAI’s o3 and o4-mini models are available now to ChatGPT Plus, Pro, and Team users. Enterprise and education users will get access next week.
  • Last Week in AI: OpenAI’s new GPT-4.1 AI models focus on coding, OpenAI launches a pair of AI reasoning models, o3 and o4-mini, Google’s newest Gemini AI model focuses on efficiency, and more!
  • techcrunch.com: OpenAI’s new reasoning AI models hallucinate more.
  • computational-intelligence.blogspot.com: OpenAI's new reasoning models, o3 and o4-mini, are a step up in certain capabilities compared to prior models, but their accuracy is being questioned due to increased instances of hallucinations.
  • www.unite.ai: unite.ai article discussing OpenAI's o3 and o4-mini new possibilities through multimodal reasoning and integrated toolsets.
  • Unite.AI: On April 16, 2025, OpenAI released upgraded versions of its advanced reasoning models.
  • Digital Information World: OpenAI’s Latest o3 and o4-mini AI Models Disappoint Due to More Hallucinations than Older Models
  • techcrunch.com: TechCrunch reports on OpenAI's GPT-4.1 models focusing on coding.
  • Analytics Vidhya: o3 vs o4-mini vs Gemini 2.5 pro: The Ultimate Reasoning Battle
  • THE DECODER: OpenAI's o3 achieves near-perfect performance on long context benchmark.
  • the-decoder.com: OpenAI's o3 achieves near-perfect performance on long context benchmark
  • www.analyticsvidhya.com: AI models keep getting smarter, but which one truly reasons under pressure? In this blog, we put o3, o4-mini, and Gemini 2.5 Pro through a series of intense challenges: physics puzzles, math problems, coding tasks, and real-world IQ tests.
  • Simon Willison's Weblog: This post explores the use of OpenAI's o3 and o4-mini models for conversational AI, highlighting their ability to use tools in their reasoning process. It also discusses the concept of
  • Simon Willison's Weblog: The benchmark score on OpenAI's internal PersonQA benchmark (as far as I can tell no further details of that evaluation have been shared) going from 0.16 for o1 to 0.33 for o3 is interesting, but I don't know if it it's interesting enough to produce dozens of headlines along the lines of "OpenAI's o3 and o4-mini hallucinate way higher than previous models"
  • techstrong.ai: Techstrong.ai reports OpenAI o3, o4 Reasoning Models Have Some Kinks.
  • www.marktechpost.com: OpenAI Releases a Practical Guide to Identifying and Scaling AI Use Cases in Enterprise Workflows
  • Towards AI: OpenAI's o3 and o4-mini models have demonstrated promising improvements in reasoning tasks, particularly their use of tools in complex thought processes and enhanced reasoning capabilities.
  • Analytics Vidhya: In this article, we explore how OpenAI's o3 reasoning model stands out in tasks demanding analytical thinking and multi-step problem solving, showcasing its capability in accessing and processing information through tools.
  • pub.towardsai.net: TAI#149: OpenAI’s Agentic o3; New Open Weights Inference Optimized Models (DeepMind Gemma, Nvidia…
  • composio.dev: OpenAI o3 vs. Gemini 2.5 Pro vs. o4-mini
  • Composio: OpenAI o3 and o4-mini are out. They are two reasoning state-of-the-art models. They’re expensive, multimodal, and super efficient at tool use.
Classification: