Mercedes-Benz is further expanding the use of artificial intelligence and integrating it into the voice control of its vehicles.
“By adding ChatGPT, voice control via the ‘Hey Mercedes’ MBUX voice assistant will become even more intuitive,” the automaker said in a news release.
An optional beta program for U.S. customers began on June 16 for more than 900,000 vehicles equipped with the MBUX infotainment system.
Customers can participate via the Mercedes me app or directly from the vehicle using the voice command, “Hey Mercedes, I want to join the beta program.” The rollout of the beta program will happen over-the-air.
Mercedes-Benz is integrating ChatGPT through Azure OpenAI Service, leveraging the enterprise-grade capabilities of Microsoft’s cloud and AI platform.
Through the Mercedes-Benz MBUX voice assistant, customers can receive sports and weather updates, have questions answered about their surroundings and control smart functions.
ChatGPT complements the existing voice control via “Hey Mercedes,” leveraging a large language model to greatly improve natural language understanding and expand the topics to which it can respond, according to Mercedes.
“Mercedes-Benz combines the best of both worlds, enhancing the validated data of the MBUX Voice Assistant with the more natural dialogue format of ChatGPT,” the automaker said. “Users will experience a voice assistant that not only accepts natural voice commands but can also conduct conversations. Soon, participants who ask the Voice Assistant for details about their destination, to suggest a new dinner recipe or to answer a complex question, will receive a more comprehensive answer – while keeping their hands on the wheel and eyes on the road.”
A collaboration with Microsoft enables the integration of ChatGPT. Through Azure OpenAI Service, Mercedes-Benz is tapping OpenAI’s large-scale generative AI models combined with the enterprise-grade security, privacy and reliability capabilities of Azure. Mercedes-Benz retains complete control over the IT processes in the background. The voice command data collected is stored in the Mercedes-Benz Intelligent Cloud, where it is anonymized and analyzed, according to the automaker.
“Data protection is a top priority for Mercedes-Benz,” the company said in a news release. “Customers know at all times what information is collected and for what purpose, and they are free to make their own decisions. Mercedes-Benz protects all customer data from manipulation and misuse.”
Mercedes-Benz is giving customers the opportunity to try out the latest technologies in their vehicles as early adopters. The U.S.-focused beta program is expected to last three months.
In return, Mercedes-Benz developers will gain helpful insights into specific requests, enabling them to set precise priorities in the further development of voice control. Findings from the beta program will be used to further improve the intuitive voice assistant and to define the rollout strategy for large language models in more markets and languages.
“Mercedes-Benz is taking an approach to the integration of ChatGPT that aligns with the company’s AI principles to make the benefits of innovative AI solutions accessible to customers,” the automaker said. “Mercedes-Benz keeps a close eye on potential risks and the system will be continuously improved for the benefit of all customers. A responsible approach to generative AI solutions is top priority at Mercedes-Benz.”
