DeeperML

Meta has unveiled SeamlessM4T, a groundbreaking AI model that is revolutionizing real-time speech translation. This advanced system is capable of translating speech and text across an impressive 101 languages, offering direct speech-to-speech translation for 36 of them. Unlike traditional models that rely on multiple steps, SeamlessM4T can perform near-instant translations, much like the fictional Babel Fish. The model has achieved a high level of accuracy through extensive training on millions of hours of multilingual audio, surpassing existing systems in both accuracy and noise resilience.

SeamlessM4T also excels in automatic speech recognition, demonstrating human-level performance even in noisy environments, according to studies. Meta's new model can translate text with up to 23% more accuracy than other existing systems. It can filter out background noise and adapt to different speakers which is a huge leap forward in the area of machine learning translation. Meta intends to make resources publicly available for non-commercial use to encourage further research in inclusive speech translation technology. The technology is currently being implemented across Meta products such as RayBan Meta and Instagram to enable real time communication for their users.

ImgSrc: spectrum.ieee.o

References :

• The Register - Software: 'Savvy' shortcuts produce near-instant speech-to-speech translation of 36 languages
• IEEE Spectrum: Meta's New Translation AI Is Nearly a Babel Fish
• techxplore.com: AI Babel Fish becomes reality, allowing direct speech-to-speech translations
• www.nature.com: Research paper about Meta SeamlessM4T AI System.

Classification:

• HashTags: #MetaAI #MachineTranslation #SeamlessM4T
• Company: Meta
• Target: Global Language Speakers
• Product: SeamlessM4T
• Feature: Speech Translation
• Type: AI
• Severity: Informative