News from the AI & ML world
DeeperML - #copilot
|
Kailyn Sylvester@Microsoft Security Blog
//
Microsoft is making significant strides in the AI landscape, expanding its Copilot features to directly compete with leading AI models like ChatGPT and Gemini. These enhancements include web browsing capabilities, allowing users to task Copilot with booking tickets, making reservations, or shopping online. Furthermore, Copilot now boasts enhanced multimodal functionality, capable of analyzing live video feeds from mobile devices and responding to questions based on visual content. A key addition is the memory retention feature, enabling personalized interactions by remembering user preferences, although users retain control over managing or deleting these memories for privacy.
Microsoft is also investing in nurturing local AI start-ups through initiatives like the Cyberport x Microsoft AI Partnership Programme in Hong Kong. This program provides resources such as solution support, technical expert guidance, and business matching opportunities, aimed at enabling these start-ups to develop innovative AI solutions across various sectors. Six companies were selected to launch solutions on the Microsoft Azure Marketplace, addressing healthcare, insurance claims, risk management, and corporate sustainability. These companies showcased their technologies at a DEMO Day, attracting significant interest and fostering business collaborations. In addition to software advancements, Microsoft is pushing the boundaries of AI in gaming with WHAMM (World and Human Action MaskGIT Model). This generative AI model creates game visuals in real-time, representing a significant upgrade from its predecessor, WHAM-1.6B. WHAMM boasts faster visual output, generating images at over 10 frames per second with enhanced resolution. Trained on Quake II using intentionally curated data, WHAMM demonstrates enhanced performance in tracking existing environments and responding to user input, despite some limitations regarding stat accuracy, input lag, and context length. Recommended read:
References :
lance.ulanoff@futurenet.com (Lance@techradar.com
//
Microsoft has unveiled a significant overhaul of its Copilot AI assistant, introducing new features designed to enhance its capabilities and transform it into a personalized AI companion. This marks a pivotal moment as Microsoft aims to make AI more accessible and beneficial for everyday life. The updates include improvements to memory, allowing Copilot to remember user preferences and details such as favorite foods, movies, and important dates. This personalization enables Copilot to offer customized solutions, proactive suggestions, and timely reminders, making it more intuitive and responsive to individual needs.
The upgraded Copilot now boasts enhanced multimodal capabilities, including the ability to analyze live video from mobile devices and answer questions based on visual content. It can also perform tasks on websites, such as booking tickets, making reservations, and shopping online, streamlining various online activities. The introduction of "Pages" organizes notes and research into a cohesive workspace, while the "Deep Research" function synthesizes information from documents and images, aiding in comprehensive information gathering and analysis. These features are aimed at making Copilot a more versatile and indispensable tool for both personal and professional use. These enhancements position Microsoft's Copilot as a direct competitor to other AI tools like OpenAI's ChatGPT and Google's Gemini. However, Microsoft has not provided detailed performance data or addressed potential limitations. User feedback has also highlighted mixed experiences with its functionality and privacy concerns regarding data tracking, suggesting that further refinement and transparency are needed. The rollout of these features and subsequent user reception will likely shape future iterations of the chatbot, as Microsoft strives to create an AI assistant that truly understands and caters to individual user needs. Recommended read:
References :
Michael Muchmore@PCMag Middle East ai
//
References:
PCMag Middle East ai
, THE DECODER
,
Microsoft is enhancing its Copilot AI assistant with new features designed to make it a more versatile and personalized companion. As part of its 50th-anniversary celebration, Microsoft is rolling out updates that aim to transform Copilot "from an AI companion to your AI companion." Among the most notable additions is the memory feature, enabling Copilot to recall details from previous conversations, such as favorite foods, movies, or important dates. This allows the AI to offer more tailored solutions, proactive suggestions, and timely reminders, fostering a more natural and helpful interaction. Concerns about privacy are being addressed with a user dashboard that allows users to control the type of information Copilot remembers or to opt out entirely.
One of the most impressive features being expanded is Copilot Vision, which allows the AI to interact with the real world through both mobile and Windows platforms. On mobile devices, users can point their phone's camera at objects to ask Copilot questions, such as identifying the model of a camera or determining the cost of a sculpture. Copilot can even provide real-time advice, such as how to adjust the aperture of a camera for better portraits. On Windows, Copilot Vision can analyze on-screen content and interact with it, such as helping users navigate applications or adjust settings. This feature is initially rolling out to Windows Insiders, with broader availability planned for the coming weeks. Furthermore, Microsoft is exploring ways to personalize the appearance of Copilot, potentially allowing users to create a unique look for their AI companion. Copilot is also gaining new capabilities, such as Deep Research, an AI search engine, and the ability to create AI-generated audio podcasts from uploaded content. Microsoft adds ChatGPT-style features to expand Copilot's capabilities including an “Actions” feature, letting Copilot carry out tasks on websites independently. Copilot will fetch responses from Bing. Previews for most of these features will begin rolling out with stable public versions launching for all users in the coming weeks and months. Recommended read:
References :
Alexey Shabanov@TestingCatalog
//
Microsoft is significantly enhancing its Copilot AI assistant across various platforms as part of its 50th-anniversary celebrations. The upgrades aim to transform Copilot from a simple chatbot into a more proactive and personalized AI companion. These enhancements include memory capabilities, allowing Copilot to remember user preferences and past interactions, as well as new features such as real-time camera analysis, AI-generated podcasts, and the ability to perform tasks on the user's behalf, creating a more intuitive and helpful experience. Microsoft aims to make AI work for everyone, modeling Copilot after the helpful AI assistant Jarvis from Iron Man.
A key aspect of the Copilot update is the introduction of "Actions," enabling Copilot to act as an AI agent that can browse the web and carry out tasks like booking event tickets, making dinner reservations, and even buying gifts. This functionality will work with various websites and is designed to complete tasks without requiring constant user intervention. Copilot Vision is also expanding, now available on iOS, Android, and Windows, which enables the AI to analyze surroundings in real time through the device's camera, offering suggestions such as interior design tips or identifying objects and providing relevant information. Additionally, Copilot will offer customizable appearances, potentially through the use of avatars. Microsoft is also focusing on improving Copilot's ability to conduct research and analyze information. The new "Deep Research" feature analyzes and synthesizes data from multiple sources, similar to features in ChatGPT and Google Gemini, providing users with comprehensive insights in minutes. Microsoft has also launched Copilot Search in Bing, combining AI-generated summaries with traditional search results, providing clear source links for easy verification and a more conversational search experience. These updates are intended to make Copilot a more valuable and integrated tool for users in both their personal and professional lives. Recommended read:
References :
Alexey Shabanov@TestingCatalog
//
Microsoft is significantly enhancing its Copilot AI assistant with new features focused on personalization, memory, and proactive task completion. These upgrades are designed to make Copilot a more useful and intuitive companion for users, moving beyond simple Q&A to a more personable and supportive AI experience. Microsoft's CEO of AI, Mustafa Suleyman, emphasizes that the key differentiator in the competitive AI assistant market will be the personality and tone of the AI, aiming to create a relationship where users feel like they are interacting with someone they know well.
Copilot's new capabilities include improved memory, allowing it to remember user preferences, important details like birthdays and favorite foods, and even corrections made by the user. This enhanced memory enables Copilot to provide more customized solutions, proactive suggestions, and personalized reminders. Additionally, Copilot is gaining the ability to take action on behalf of users, such as booking flights, making dinner reservations, and purchasing items online. This functionality, known as Copilot Actions, will work with various websites, making Copilot a more versatile and helpful tool for everyday tasks. Further upgrades include a new "Discover" screen on both mobile and web platforms, offering interactive cards and personalized daily briefings. The "Vision" feature allows Copilot to access and understand content from other websites when used within the Edge browser. Microsoft is also exploring features like adjustable reasoning effort, "Pages" for content creation, and animated avatars to enhance the user experience. These advancements, along with tools like "Deep Research" and the ability to generate podcasts, position Copilot as a comprehensive AI assistant capable of assisting users in various aspects of their lives. Recommended read:
References :
@laptopmag.com
//
Microsoft is celebrating its 50th anniversary on April 4th, 2025, marking a significant milestone focused on its AI driven future. Top executives highlighted the company's vision for AI, centered around Copilot, which will be further integrated into Microsoft products. Mustafa Suleyman, CEO of Microsoft AI, emphasized that Copilot will understand users in the context of their lives and show up in the right way at the right time, calling it "a new kind of relationship with technology."
Microsoft is launching Researcher and Analyst AI agents in Microsoft 365 Copilot. Researcher integrates OpenAI's deep research model with Microsoft 365 Copilot's orchestration and search capabilities to perform complex, multi-step research workflows. Analyst, powered by OpenAI's o3-mini reasoning model, helps turn raw data into actionable insights within minutes, capable of running Python code to process complex data queries. These agents, accessible through the "Frontier" program, aim to provide on-demand assistance in data analysis and general research tasks, enhancing user capabilities across various applications. Recommended read:
References :
Alexey Shabanov@TestingCatalog
//
Microsoft is supercharging its Copilot assistant with new capabilities, transforming it into a companion for all. The company is equipping Copilot with new features designed to make it more responsive and helpful, including memory recall and personalization. This will allow the AI assistant to better understand and remember user preferences, complete tasks, analyze surroundings, and keep life organized. Microsoft aims to make AI work for everyone and wants Copilot to become the AI companion people want, tailored just for them.
Microsoft launched two AI reasoning agents for 365 Copilot: Researcher and Analyst. Researcher handles complex research using multiple sources, while Analyst functions as a data scientist to transform raw data into insights. These agents will roll out this month as part of a new program called "Frontier". The company is also adding new mobile and web features, personalization options, and exclusive tools for Surface devices. Recommended read:
References :
alex.wawro@futurenet.com (Alex@tomsguide.com
//
Microsoft is actively integrating AI across its product lines to enhance both functionality and security. One significant development involves the use of AI-powered Security Copilot to identify vulnerabilities in open-source bootloaders. This expedited discovery process has revealed 20 previously unknown vulnerabilities in GRUB2, U-Boot, and Barebox, which could impact systems relying on Unified Extensible Firmware Interface (UEFI) Secure Boot. These vulnerabilities, particularly in GRUB2, could allow threat actors to bypass Secure Boot and install stealthy bootkits, potentially granting them complete control over affected devices.
Microsoft is also expanding AI capabilities on Copilot Plus PCs, particularly those powered by Intel and AMD processors. Features like Live Captions, which translates audio into English subtitles in real-time, as well as creative tools like Cocreator in Paint, Restyle Image, and Image Creator in Photos, are becoming more widely available. The company is additionally testing a new tool called Quick Machine Recovery, designed to remotely restore unbootable Windows 11 devices by automatically diagnosing and deploying fixes through Windows Update, preventing widespread outages similar to those experienced in the past. Recommended read:
References :
Ken Yeung@Ken Yeung
//
Microsoft is launching a 50-day AI Skills Fest, starting April 8, 2025, aimed at helping individuals advance their technical knowledge in artificial intelligence. The global event will feature a wide array of activities including hackathons, both live in-person and virtual events, self-paced tutorials, and community events. Microsoft hopes to set a Guinness World Record for the most participants completing an online multi-level AI lesson in 24 hours as part of the inaugural launch.
Microsoft is also rolling out updates to its Copilot+ PCs. AMD and Intel-powered Copilot+ PCs will gain access to Windows Copilot features like Cocreator, Image Creator, Live Captions and Restyle Image, previously available only on Snapdragon-powered devices. These features utilize the onboard Neural Processing Unit (NPU) and generative AI to enhance user experiences within Microsoft Paint and Photos, enabling image generation and modification. Recommended read:
References :
Mike Wheatley@SiliconANGLE
//
Microsoft is enhancing its Copilot AI assistant with advanced reasoning and agent capabilities aimed at boosting productivity across various Microsoft 365 applications. Key updates include deep reasoning within Copilot Studio and the introduction of specialized AI agents like Researcher and Analyst, designed to tackle complex problems and provide more nuanced insights. These agents leverage advanced reasoning models, such as OpenAI's o1 and o3-mini, to perform detailed analysis, methodical thinking, and data-driven decision-making, simulating the approach of skilled professionals.
Microsoft is also integrating its Security Copilot with AI agents to automate tasks. New agents being added to Security Copilot include ones designed to sort through large volumes of security info, analyze notifications, and fix insecure user access rules. Microsoft also released a new Knowledge Base-Augmented Language Models (KBLaM) system which is a more efficient way to incorporate external knowledge into language models. All of these tools are designed to give you the help you need faster. Recommended read:
References :
Ken Yeung@Ken Yeung
//
Microsoft is enhancing its Copilot Studio platform with new 'deep reasoning' capabilities, allowing AI agents to solve complex problems more effectively. This upgrade also includes 'agent flows' which blend AI's flexibility with structured business automation. The new Researcher and Analyst agents for Microsoft 365 Copilot represent a significant step forward in AI agent evolution, enabling them to handle sophisticated tasks requiring detailed analysis and methodical thinking.
Microsoft's Security Copilot service is also getting a boost with a set of AI agents designed to automate repetitive tasks, freeing up security professionals to focus on more critical threats. These AI agents are designed to assist with critical tasks such as phishing, data security, and identity management. These agents showcase the breadth of what can be created when combining enterprise business data, access to advanced reasoning models, and structured workflows. Recommended read:
References :
mpesce@Windows Copilot News
//
Microsoft is actively enhancing its Copilot service with regular updates, introducing new features and improvements. Recent updates, as of March 19, 2025, include Copilot Vision which is now available on Android devices for Pro subscribers in the United States, allowing users to leverage their phone's camera for assistance. Copilot Vision access in Edge has expanded to all free users in the U.S., enabling the AI to scan, analyze, and provide insights from webpages. Additionally, the "Think Deeper" reasoning model has been upgraded to OpenAI's o3-mini (high), leading to faster and more flexible responses to complex questions.
Microsoft is also making strides in AI research and security. Microsoft Research has developed a more efficient method for incorporating external knowledge into language models, called KBLaM, which uses vector pairs woven directly into the model's architecture. This system offers faster and more efficient responses by processing knowledge directly within the model. Furthermore, Microsoft is expanding its Security Copilot service with new AI agents designed to help IT teams manage increasing security threats, with 11 agents being added in an April preview, designed to improve security outcomes at machine speed and scale. Recommended read:
References :
mpesce@Windows Copilot News
//
References:
Windows Copilot News
, Microsoft Research
,
Microsoft's AI chief, Mustafa Suleyman, believes that conversational AI represents the future of web interaction, comparing it to the next generation of web browsers and search engines. He envisions a future where users can easily obtain information and assistance by simply using voice commands to interact with AI assistants like Copilot. Suleyman emphasizes the potential for conversational AI to become significantly more user-friendly, making it a go-to tool for a wide range of tasks.
Microsoft is actively developing new features for Copilot, including animated avatars for Voice Mode. Users can select between characters like Mika, Aqua, and Erin, each with a potentially unique voice, to personalize their experience. In addition, Microsoft Research has introduced Claimify, an innovative method that leverages large language models to extract more accurate and comprehensive claims from LLM outputs, enhancing the reliability of AI-generated content. Recommended read:
References :
mpesce@Windows Copilot News
//
References:
blogs.microsoft.com
, Windows Copilot News
,
Microsoft is aggressively pushing forward with AI agent deployments across various platforms. The company is enabling developers to easily build AI agents using OpenAI's new Responses API and Agents SDK. This move aims to simplify the creation of AI-powered assistants capable of tasks like summarizing financials, conducting legal research, and providing real-time customer service.
NASA's Earth Copilot, powered by Microsoft AI, is democratizing access to complex Earth Science data collected by satellites. This initiative allows users to navigate over 100 petabytes of data for various applications, including monitoring wildfires, tracking climate change, and supporting industries like agriculture and urban planning. Additionally, Microsoft has released autonomous Copilot AI agents in public preview, enabling chatbots to perform a series of linked tasks based on user instructions. These agents are designed to automate workflows and handle tasks like sourcing sales leads, managing customer service inquiries, and tracking project deadlines. Recommended read:
References :
@pcmag.com
//
A recent Windows 11 update has inadvertently uninstalled the Copilot AI assistant from some users' PCs, causing frustration. The bug, affecting updates KB5053598, KB5053602, and KB5053606 across Windows 11 and Windows 10, removes the Copilot app and unpins it from the taskbar. Microsoft has acknowledged the issue and updated the release notes, confirming that Copilot for Microsoft 365 is not affected.
Users affected by this bug can manually reinstall the Copilot app from the Microsoft Store and repin it to their taskbar as a temporary solution. It's worth noting that some users on Reddit have expressed that they appreciate this accidental "feature," stating they would prefer the option to install Copilot rather than having it forced upon them. Microsoft is currently working on a permanent solution and likely to issue an update soon. Recommended read:
References :
Thomas Wilde@GeekWire
//
Microsoft has announced Copilot for Games, an AI assistant designed for Xbox users. Revealed on the Official Xbox Podcast, this tool aims to provide real-time game support, including tips and strategy guides. Initial feedback has been negative, with many expressing concerns about the tool's usefulness. The Copilot for Gaming feature is set to roll out for select Xbox Insiders in the coming weeks through the Xbox mobile app, with further details anticipated at GDC 2025.
Microsoft executives Fatima Kardar and Jason Ronald highlighted Copilot's potential to address common gaming frustrations, such as getting lost in old save files or hitting skill plateaus. The tool is designed to be a multi-device helper, accessible on both consoles and the Xbox mobile app. Copilot for Gaming will offer features like personalized game recommendations, save file progress recaps, and in-game tips for titles like Overwatch and Minecraft. Recommended read:
References :
|
BenchmarksBlogsResearch Tools |