Mercedes-Benz cars to have 'supercomputers', unveils Google Partnership

Mercedes and Google partner for Supercomputer Cars

  Mercedes-Benz cars to have 'supercomputers', unveils Google partnership

By Victoria Waldersee and Joseph White

Mercedes-Benz holds a strategy update event focused on software in California

[1/6] A guest looks at the dashboard display of a Mercedes-Benz prototype during a strategy update event focused on software at the company's North American Research and Development center in Sunnyvale, California U.S., February 22, 2023. REUTERS/Carlos Barria

BERLIN, Feb 22 (Reuters) - Mercedes-Benz (MBGn.DE) said on Wednesday it has teamed up with Google (GOOGL.O) on navigation and will offer "super computer-like performance" in every car with automated driving sensors as it seeks to compete with Tesla (TSLA.O) and Chinese newcomers.

Automakers new and old are racing to match software-powered features pioneered by Tesla, which allow for vehicle performance, battery range and self-driving capabilities to be updated from a distance. ...  ' 

Imagining the AI Cockpit

Something we also imagined for running a large enterprise, rather than just a vehicle.  Show all the most useful data and forward simulations.  

Driving the Future: What Is an AI Cockpit?

Intelligent interiors are transforming transportation.

July 20, 2020 by Katie Burke

From Knight Rider’s KITT to Ironman’s JARVIS, intelligent copilots have been a staple of forward-looking pop culture.

Advancements in AI and high-performance processors are turning these sci-fi concepts into reality. But what, exactly, is an AI cockpit, and how will it change the way we move?

AI is enabling a range of new software-defined, in-vehicle capabilities across the transportation industry. With centralized, high-performance compute, automakers can now build vehicles that become smarter over time.

A vehicle’s cockpit typically requires a collection of electronic control units and switches to perform basic functions, such as powering entertainment or adjusting temperature. Consolidating these components with an AI platform such as NVIDIA DRIVE AGX simplifies the architecture while creating more compute headroom to add new features. In addition, NVIDIA DRIVE IX provides an open and extensible software framework for a software-defined cockpit experience.

Mercedes-Benz released the first such intelligent cockpit, the MBUX AI system, powered by NVIDIA technology, in 2018. The system is currently in more than 20 Mercedes-Benz models, with the second generation debuting in the upcoming S-Class.  ... ' 

Fraunhofer Works Audio Experience

 Emphasizing personal experience, working with Mercedes.

Fraunhofer IDMT’s audio software enables an individual listening experience

News / July 07, 2022  by Frauhofer

Everyone hears differently – this applies inside a vehicle too. That is why Fraunhofer IDMT in Oldenburg has developed a technological concept for fast and individual sound adaptation, which has been integrated into the multimedia system of vehicles from the Mercedes-Benz Group AG. At the heart of the development is an algorithm that easily adjusts the sound of music according to passengers’ wishes. Once set, the sound is optimally adapted to listening preferences.

Fraunhofer IDMT in Oldenburg has developed a technological concept for fast and individual sound adjustment, which has been integrated into vehicles’ multimedia systems.

Important for listening comfort in a vehicle is the quality of the media system’s speech and music reproduction. Pleasant sound and better acoustic intelligibility not only contribute to comfort but can also increase safety, as the driver’s eyes stay focused on the road instead of dwelling on complex audio sub-menus.

»Studies show that people want to perceive sound individually, irrespective of age or hearing ability – inside a vehicle too. Since it’s much more difficult or even impossible to achieve personal feel-good sound with conventional equalisers, we’ve developed new algorithms and an intuitive interface,« explains Dr Jan Rennies-Hochmuth, Group Leader Personalised Hearing Systems at Fraunhofer IDMT in Oldenburg.

Simple instead of complex

Fraunhofer IDMT’s newly developed audio software allows individual sound settings without needing to get to grips with complex sub-menus or parameters. Instead, the user adjusts the sound of individual instruments once only and according to his or her listening preferences by means of an audio example. The result of this personalisation process then serves as the basis for the automatic sound adjustment of all future audio playbacks in the vehicle. Once done, readjusting the sound parameters is no longer necessary. The outcome is a better listening experience at any playback volume.

In addition to infotainment systems, the technology, which Fraunhofer also calls »YourSound«, enables users of other audio devices, such as smartphones or televisions, to adjust the audio playback to their own acoustic preferences in a fun way – without any knowledge of sound levels or frequencies.  ... ' 

Seeing Around the Corner

The general idea has been brought up a number of times.  Bouncing radar and cooperative systems can get more data, and if we interpret it to detect dangers, we can react.   Even to things around the corner. Back to the better sensors and smarter reactions to get better results.   As suggested much work to do to get all the data and reactions  in place

Radar Allows Cars to Spot Hazards Around Corners
Princeton University
John Sullivan
June 25, 2020

Researchers at Princeton University, Germany's Ulm University and University of Kassel, Mercedes-Benz, and Canadian software firm Algolux have developed an automated radar system that will enable cars to look around corners and spot oncoming hazards. The system employs Doppler radar to bounce radio waves off surfaces at an angle to detect occluded objects and determine if they are moving or stationary. Radar's spatial resolution is relatively low, but the researchers think they could design algorithms to read the data to allow the sensors to operate. The team used artificial intelligence techniques to refine processing and interpret the images, focusing on background noise rather than usable information to distinguish objects. Princeton’s Felix Heide said, “In terms of integration and bringing it to market, it requires a lot of engineering. But the technology is there, so there is the potential for seeing this very soon in vehicles.”  .. " 

Predicting Emergence of Self Driving

Was interviewed about my opinion of when self-driving would become common in a recent study.  So now am following these predictions more closely.   Now major tech players are starting to make related announcements.   Autonomous mobility at hand?

In Engadget:

Mercedes and BMW cars will drive themselves on the autobahn by 2024.   The manufacturers agreed to work together on level 4 self driving systems.     By Steve Dent, @stevetdent

" .... BMW and Mercedes started working together on autonomous cars earlier this year, and now they have optimistic plans to deliver them. The automakers announced that they're developing Level 4 self-driving cars that can handle freeway driving chores without human intervention, though a driver will still need to be at the wheel. Such vehicles will include driver assist and automated parking systems and go on sale to the public by 2024. .... " 

Mercedes Wants to Build a Mall

Building the rolling Channel. 

Mercedes wants to turn your car into a comfortable shopping mall on wheels  By Ronan Glon in DigitalTrends

Imagine the time you’d save if you could make dinner reservations for two, buy a new button-up shirt, and order flowers without leaving your car. Mercedes-Benz wants to make that possible by launching an in-car e-commerce platform that promises to take the convenience of online shopping to new heights.  ... "

Mercedes Delivery Research

How can I put packages in a van to optimize delivery based on a given delivery route? 

Mercedes’ AI research could mean faster package delivery
Moving on from failure and exploding milk jugs.
 By Roberto Baldwin, @strngwys   in Engadget

Using a combination of computer vision and AI, Mercedes believes it can help reduce the time needed to load packages onto vehicles and make sure said boxes are in the optimal spot for an AI-created delivery route. More importantly to delivery companies, the system is cost effective .... 

All the hardware is off the shelf and it's the onboard computer and its communication with the backend that does all the hard work. Mercedes says that it has an API that would help a delivery company plug into its system. The team sees this as a solution not so much for FedEx and UPS, but for smaller delivery companies, typically the ones hired by companies like Amazon to deliver our goods. ... " 

Vans and Drones in a Network

This was new to me, quite an interesting case.  Bring on the Drones.

Switzerland’s new autonomous drone network just completed its first delivery Coffee anyone?   by Andrew J. Hawkins  @andyjayhawk  In theVerge

" ... Yesterday, an autonomous drone landed on the roof of a Mercedes-Benz van in Zurich, successfully completing the first delivery of Switzerland’s aerial logistics network. The drone’s package contained some delicious coffee from Swiss e-commerce startup Siroop. The delivery was coordinated by logistics company Matternet, which says it hopes to eventually deliver lab samples like blood tests and other diagnostics flown between hospital facilities, clinics, and labs — all via drone.  ... " 

Bosch and Self Driving Cars

Had already looked at how Bosch was examining technology behind the smart home.  Now in the space of Automotive advances like self driving cars.

Bosch details its work on present and future self-driving cars
Like many companies, Bosch will play a part in our autonomous future.... 

By Jamie Rigg, @jmerigg in Engadget

" ... Bosch has already partnered with NVIDIA to develop an AI brain for self-driving cars, with TomTom on mapping systems that'll help vehicles see the road ahead, and with Mercedes on automated valet and taxi concepts. The showcase in London featured a few more tangible developments. These included various EVs powered by Bosch drivetrains, from e-bikes to existing and pre-market electric scooters and city cars.  ...  "

Mercedes Connecting to Amazon Echo and Google Assistants

The breadth of this is most interesting.  All their new cars can link to both of the most common  assistants.  Seems an indicator of popularity of the assistant idea as yet not seen.   A first true link between Smart Home and Smart Car.    Next steps?  In theVerge: 

Mercedes-Benz is connecting the Amazon Echo and Google Home to all its new cars ...   by Andrew J. Hawkins  @andyjayhawk

Mercedes-Benz announced today that all of its 2016 and 2017 vehicles in the US can now connect with both Amazon and Google’s digital voice assistants.

Starting today, Mercedes owners can instruct their Google Home or Amazon Echo to remotely start or lock their vehicles, as well as send addresses to their in-car navigation system. But a promo video by Mercedes shows a much more frightening use-case: using these digital voice assistants to compensate for incredibly stupid behavior, like leaving the house with both the iron and stovetops on at full blast. ... " 

Related:

Ford is integrating Alexa into its cars.  It was the first to do this.

Hyundai is working with Google Home.

Mercedes Silicon Valley Research Center

Excerpt.  Mercedes is known for interesting work,  see the tag below for more posts on them.   Considering the volume of data involved

Inside Mercedes' Silicon Valley research center
A tour of the automaker’s future, and sometimes weird, innovations.
 by Roberto Baldwin.   Excerpt:

" .... Another important aspect of self-driving cars is that the computers needed to keep them on the road not only have to learn and react but actually see what's going on. Most automakers use Lidar to scan the surrounding world with lasers to create a vast pixel map. The amount of data created by all those pinpoints is staggering. Mercedes thinks it's solved the problem of trying to crunch all that information by joining blocks of pixels to create single objects. So instead of an automobile trying to decipher 500,000 pixels, the car has to figure out the location of only 1,000 object-specific rectangles called "Stixels." Each Stixel can be a person, car or object and is assigned a color based on how close it is to the vehicle.  ... " 

Cars as Moving Networks of Sensors

The article below suggests automobile network use as parking space finders, but think of this more broadly as a network of information gathering sensors and even beacons.  Suppose when you bought a car, or car based system, and it acted as your sensor?    Yes, regarding the privacy implications.    But also as a means to gather useful data that could be used directly or sold.

Mercedes to Transform Cars Into Roving Parking-Space Finders in Bloomberg By Elisabeth Behrmann

Mercedes Self Driving 18 Wheeler

In CWorld:  Concept Vehicle.  Impressive design.  This should have considerable influence on supply chain efficiency. Good detail in the article.

" ... Mercedes-Benz showed off an autonomous semi-trailer truck that will be available in a decade and allow long-haul drivers to relax and tend to paperwork and duties other than driving.
The Mercedes-Benz Future Truck 2025 was displayed at the 2014 International Commercial Vehicle show this month.

"In ten years' time, trucks could be driving autonomously on motorways. Transport efficiency will increase, traffic will be safer for all road users and fuel consumption and CO2 emissions will be further reduced," Mercedes said in a blog post. "Autonomous driving is already possible at realistic speeds and in realistic motorway traffic situations." ... "  

Information Insertion at Point of Need

From the BBC: What a good ridiculously simple idea, a sticker applied to Mercedes vehicles that contains a QR code, which directs first responders to rescue methods to extract people from a specific car model.  They have put the idea into the public domain.

Reminds me of related ideas of tattooing bar codes on people for medical ID .... Not far different from RFID capsule injection, now common in veterinary applications and some human systems ...

Caromatherapy

The Whiff Guys, sensory specialists, report on caromatheraphy experimentation by Mercedes-Benz. Read it as car-aromatherapy. Admittedly only in the luxury limo division, but more about personalizing contexts in which we live. See their site for more advances in sensory marketing. Also see their book: Whiff!: The Revolution of Scent Communications in the Information Age.