DeeperML - #realtimeai

Microsoft is enhancing its Copilot AI assistant with new features designed to make it a more versatile and personalized companion. As part of its 50th-anniversary celebration, Microsoft is rolling out updates that aim to transform Copilot "from an AI companion to your AI companion." Among the most notable additions is the memory feature, enabling Copilot to recall details from previous conversations, such as favorite foods, movies, or important dates. This allows the AI to offer more tailored solutions, proactive suggestions, and timely reminders, fostering a more natural and helpful interaction. Concerns about privacy are being addressed with a user dashboard that allows users to control the type of information Copilot remembers or to opt out entirely.

One of the most impressive features being expanded is Copilot Vision, which allows the AI to interact with the real world through both mobile and Windows platforms. On mobile devices, users can point their phone's camera at objects to ask Copilot questions, such as identifying the model of a camera or determining the cost of a sculpture. Copilot can even provide real-time advice, such as how to adjust the aperture of a camera for better portraits. On Windows, Copilot Vision can analyze on-screen content and interact with it, such as helping users navigate applications or adjust settings. This feature is initially rolling out to Windows Insiders, with broader availability planned for the coming weeks.

Furthermore, Microsoft is exploring ways to personalize the appearance of Copilot, potentially allowing users to create a unique look for their AI companion. Copilot is also gaining new capabilities, such as Deep Research, an AI search engine, and the ability to create AI-generated audio podcasts from uploaded content. Microsoft adds ChatGPT-style features to expand Copilot's capabilities including an “Actions” feature, letting Copilot carry out tasks on websites independently. Copilot will fetch responses from Bing. Previews for most of these features will begin rolling out with stable public versions launching for all users in the coming weeks and months.


References :

• PCMag Middle East ai: As Microsoft celebrates its today, the company is rolling out some updates that are intended to "take Copilot from an AI companion to your AI companion." That includes a Memory feature that will recall details about your conversations (favorite …
• THE DECODER: Microsoft adds ChatGPT-style features to expand Copilot's capabilities
• www.tomsguide.com: I went hands-on with Copilot's newest features. Here's the three that stood out the most.

Classification:

• HashTags: #CopilotVision #AIforVision #RealTimeAI
• Company: Microsoft
• Product: Copilot
• Feature: real-time vision understanding
• Type: AI
• Severity: Major

Google has begun rolling out real-time interaction features to its AI assistant, Gemini, enabling live video and screen sharing. These enhancements, powered by Project Astra, allow users to engage more intuitively with their devices, marking a significant advancement in AI-assisted technology. These features are available to Google One AI Premium subscribers.

The new live video feature allows users to utilize their smartphone cameras to engage in real-time visual interactions with Gemini, enabling the AI to answer questions about what it observes. Gemini can analyze a user’s phone screen or camera feed in real-time and instantly answer questions. The screen-sharing feature enables the AI to analyze and provide insights on the displayed content, useful for navigating complex applications or troubleshooting issues. Google plans to expand access to more users soon.


References :

• The Tech Basic: Google has started releasing new AI tools for Gemini that let the assistant analyze your phone screen or camera feed in real time.
• gHacks Technology News: Google has begun rolling out new features for its AI assistant, Gemini, enabling real-time interaction through live video and screen sharing.
• The Verge: Google is rolling out Gemini’s real-time AI video features

Classification:

• HashTags: #GoogleGemini #ProjectAstra #RealTimeAI
• Company: Google
• Target: Users
• Product: Gemini
• Feature: Gemini Live
• Type: AI
• Severity: Informative

Google has started rolling out new AI tools for Gemini, allowing the assistant to analyze your phone screen or camera feed in real time. These features are powered by Project Astra and are available to Google One AI Premium subscribers. The update transforms Gemini into a visual helper, enabling users to point their camera at an object and receive descriptions or suggestions from the AI.

These features are part of Google's Project Astra initiative, which aims to enhance AI's ability to understand and interact with the real world in real-time. Gemini can now analyze your screen in real-time through a "Share screen with Live" button and analyze your phone's camera. Early adopters have tested the screen-reading tool, and Google plans to expand access to more users soon. With Gemini's live video and screen sharing functionalities, Google is positioning itself ahead in the competitive landscape of AI assistants.


References :

• The Tech Basic: Google has started releasing new AI tools for Gemini that let the assistant analyze your phone screen or camera feed in real time.
• gHacks Technology News: Google rolls out Project Astra-powered features in Gemini AI
• www.techradar.com: Gemini can now see your screen and judge your tabs

Classification:

• HashTags: #GeminiAI #ProjectAstra #GoogleOne
• Company: Google
• Target: Users
• Product: Gemini
• Feature: Real-Time Analysis
• Type: AI
• Severity: Informative