What’s next.

Continued progress in reinventing the relationship between people and technology.

×

Beyond the algorithms: Shaping the future of the Automotive Assistant for autonomous cars

Automotive assistants are changing the way people experience the connected car – but when connected cars become autonomous, those assistants must leverage artificial intelligence to not only keep their passengers connected, but also informed and engaged in the event they need to take the wheel. A recent study from Nuance and DFKI takes a look at the most effective ways of engaging drivers as passengers when even just seconds matter.

By
Automobile cockpit, various information monitors and head up displays.

Conducting research on artificial intelligence (AI) and intelligent assistants is often discussed in the context of algorithms and deep learning – and of course data. However, we as researchers must also understand the environment in which this intelligence will operate. Only if you adapt the functionality to the context of use can your system be successful. This is especially true for the automotive assistant as the car industry is experiencing rapid change across everything from fuel sources to software. As cars become connected to the Internet, drivers expect the same experience on their smartphone to be in their dashboard.

This is paving the way for the rapid acceleration of autonomous automotive innovation – the self-driving car, which is changing the roles we as drivers have in the car, to one of passengers. However, this will largely be a transitioning back and forth as needed. Autonomous cars are mastering traffic situations, but not all, and if a hazard appears, drivers need to be engaged if their attention lies elsewhere.

Designing the Automotive Assistant for this autonomous future is the more pressing challenge in the industry, while none of us know exactly how it will look like, the vision is getting clearer with each question answered. We first need to understand what people will do with their time after the switch from driver to passenger; how they will react to requests to take over control, and what is the best way of handling those situations? We rely on surveys, simulations, and usability studies as our makeshift crystal ball.

 

The study

In a user study we just completed in cooperation with DFKI, the world largest AI research institute (where Nuance is a proud shareholder), we investigated specifically the best way to hand over control from the car to the driver, what information the car should provide and what the impact on the user’s trust is. To do this, we put users in a driving simulator (based on the popular OpenDS SW, originally developed under Nuance’s participation and now extended to also cover self-driving tasks) and tried out different ways of notifying the driver: through auditory, visual, and haptic (vibrational) channels, and combinations thereof. We let them try different things during their non-driving times, again engaging their visual, auditory, or haptic capabilities (reading vs. watching videos, playing games, or listening to music, etc.).

We varied the amount of information shown to them on the rationale for why the car was requesting the transfer of control, the current traffic situation and the current plan the car had maintained before the transfer. Then we asked users afterwards about usefulness, convenience, trust, etc. and measured the actual time it took to complete the transfer of control.

 

The results

Drivers don’t like notifications using the same modality as their current activity. Instead they prefer a combination of complementing modalities adapting to their current activity. For example, if someone is reading a book, transferring the control back to the user is best done by combining audio and touch, or “haptic” vibration signals. And, if someone is reading and answering e-mails, audible alerts or cues are the best way to get a passenger’s attention. This highlights the importance of integrated, multimodal user interfaces leveraging voice, touch and displays in an intelligent way.

  • To achieve best results, it is important that the system has context information from the car and the car sensors, including information about the current activity of the driver and the respective sensory modality, to inform him or her about the transfer of control using the optimal modalities. This results in faster reaction and better user experience.
  • Independent of the current driver activity, the auditory channel is considered more pleasant and usable than the visual channel and leads to faster reactions than the haptic channel.
  • Drivers trust auditory and haptic information from the autopilot more than purely visual information.
  • Data indicates that the reaction time is lowest when the driver is engaged in an auditory activity, such as listening to a book or music

multimodal-user-interfaces-car-data

 

The last point fits in nicely with results from a recent complementing survey conducted by Nuance in US and the UK among 400 drivers taking a look at the type of activities that drivers are planning to do as passengers in an autonomous car. If alone, respondents cited their Top five activities in the car would be listening to the radio (64%) relaxing (63%), talk on the phone (42%), browsing the Internet (42%) and messaging (36%). The first three are already “auditory” or at least hands-free in nature, the other two cam be made so via an Automotive Assistant.

 

Continued research

With many other facets to research in this emerging space, studies and simulations enable us to develop an Automotive Assistant today that in the future will assist drivers in various intelligent ways, developing a multi-modal companion relationship with the driver, changing the roles of driver-to-passenger, as well as a spokesperson for the car, and enhancing the experience for other passengers.

 

Read full article

More from the editor

Is your customer service relevant?
Leveraging customer trends to provide relevant customer service
Who needs a car manual with self-aware cars?
Cars of the future, may be able to answer questions about themselves
The perfect technology for insurance claim management
Discover the document capture and workflow advantage
Meet the new generation of virtual assistants: Learn and grow smarter, Part I
A virtual assistant’s educational journey
Innovative uses of OCR technology
Are you using OCR to your full advantage?
Leveraging analytics to ensure superior customer service
Data can help drive improved business performance and results
Want to offer great customer service? Be like Steph and LeBron
Study the NBA greats to offer a great IVR experience
The latest example of successful print security
How the culprit was identified in the latest NSA leak
A battle cry for the healthcare industry: Set radiologists up for success
With mounting pressures, radiologists need better diagnostic solutions to meet their needs
Wonder Woman and customer service
How to create a super hero for your digital engagement on messaging channels
The future is now: preparing for open enrollment 2018
Why now’s the time to adopt virtual assistant technology
One effective way to reduce reliance on paper and improve EMR adoption
A better way to improve critical workflows for capturing and printing information
4 ways to learn more and do more with PDF
Embrace new features to maximize PDF results
Modernizing collections in auto finance
Why lenders should turn to proactive engagement
Beyond the algorithms: Shaping the future of the Automotive Assistant for autonomous cars
New study reveals how drivers want to get notifications in the cars of the future
Don’t throw the baby out with the bath water: Enhancing physician engagement with embedded EHR
Hospitals look to mobile devices, AI, and other tech to solve physicians’ needs
Keeping it personal in customer service
The basics of the personalization spectrum
The future is now: Solving the digital dilemma in healthcare
Companies continue to progress with innovation and time-saving tools for healthcare
How to hit a customer service home run
Businesses can anticipate customer curveballs with the help of a conversational IVR
Nuance wants to hear from nurses as we celebrate National Nurses Week!
As we celebrate National Nurses Week, Nuance surveys nurses on Health IT needs.
How automating document management can be a competitive advantage
Many companies are turning document management into a sustainable competitive edge
Three hot takes: Health plans and member service in 2017
The rise of automation and self-service
2017: The year of biometrics
A look at how banks and customers are benefitting from biometrics
New ways OCR can improve business processes – and results
When it comes to OCR innovations, don’t get left behind
Customer service and the path to digital transformation
Six steps to ensure successful customer communication on digital channels
The transformative impact of improving documentation productivity
Inefficient documentation can have a ripple effect across organizations.
What’s my line?
The changing role of the customer service professional
You won’t need to dial a friend or a thick paper manual with Dragon Drive
How your car just got smarter and won't leave you hangin' with our Smart Car Manual
A better, more efficient way to perform mission-critical legal workflows
Law firms can reduce paper and costs (and more) with better document management practices
AI is spawning new models of care, not just cars
Artificial Intelligence (AI) shows hope for powering new models of care
A guessing game show is great for entertainment, but not the customer experience
Leverage consumer data to provide better and more personalized customer service
Commit on Earth Day to move towards a paperless office
5 Ways your Organization can Become a Paperless Organization
From Spring Equinox to customer experience: how businesses can adapt to a changing landscape
As customer expectations evolve, companies should make intelligent self-service a priority
Banking on better customer service
From virtual assistants to AI, banks are leveraging digital to enhance customer experience
A new and effective way to prevent data loss and improve security
Today’s innovators use optical character recognition to prevent data loss – could you?
trendy young man using live chat and VAs
Is your customer service relevant?
Leveraging customer trends to provide relevant customer service
To meet customer expectations, virtual assistants must be able to learn and grow smarter.
Meet the new generation of virtual assistants: Learn and grow smarter, Part I
A virtual assistant’s educational journey
It’s time for companies to up their IVR game.
Want to offer great customer service? Be like Steph and LeBron
Study the NBA greats to offer a great IVR experience
Make your virtual assistant a super hero for your business.
Wonder Woman and customer service
How to create a super hero for your digital engagement on messaging channels
embrace-more-features-in-PDF-solutions
4 ways to learn more and do more with PDF
Embrace new features to maximize PDF results
Physician adoption of EHRs – don’t throw the baby out with the bath water
Don’t throw the baby out with the bath water: Enhancing physician engagement with embedded EHR
Hospitals look to mobile devices, AI, and other tech to solve physicians’ needs
Businesses can streamline customer service with the help of conversational IVR.
How to hit a customer service home run
Businesses can anticipate customer curveballs with the help of a conversational IVR
Automation and self-service will be key health plan trends to watch in 2017.
Three hot takes: Health plans and member service in 2017
The rise of automation and self-service
Businesses must learn to offer exceptional customer service on digital channels.
Customer service and the path to digital transformation
Six steps to ensure successful customer communication on digital channels
You and your car just got a lot smarter
You won’t need to dial a friend or a thick paper manual with Dragon Drive
How your car just got smarter and won't leave you hangin' with our Smart Car Manual
Businesses can leverage data to provide a more personal customer experience.
A guessing game show is great for entertainment, but not the customer experience
Leverage consumer data to provide better and more personalized customer service
By adopting digital solutions, banks can offer greater and more innovative customer service.
Banking on better customer service
From virtual assistants to AI, banks are leveraging digital to enhance customer experience
Smart car manuals aren't manual
Who needs a car manual with self-aware cars?
Cars of the future, may be able to answer questions about themselves
Do-more-with-OCR-SDKs-and-toolkits
Innovative uses of OCR technology
Are you using OCR to your full advantage?
Secure-print-management-solutions
The latest example of successful print security
How the culprit was identified in the latest NSA leak
Open enrollment 2018 is right around the corner. Health plans should start preparing now by adopting intelligent self-service capabilities.
The future is now: preparing for open enrollment 2018
Why now’s the time to adopt virtual assistant technology
As the number of delinquent auto loans skyrockets, businesses should turn to proactive engagement to improve their collections strategy.
Modernizing collections in auto finance
Why lenders should turn to proactive engagement
As customer expectations rise, it will become increasingly important for businesses to personalize experiences.
Keeping it personal in customer service
The basics of the personalization spectrum
nuance-and-ana-celebrate-nurses-week
Nuance wants to hear from nurses as we celebrate National Nurses Week!
As we celebrate National Nurses Week, Nuance surveys nurses on Health IT needs.
With fraud on the rise, companies are turning to voice biometrics to securely authenticate customers.
2017: The year of biometrics
A look at how banks and customers are benefitting from biometrics
huge-in-tray-of-paperwork
The transformative impact of improving documentation productivity
Inefficient documentation can have a ripple effect across organizations.
Legal-document-solutions-improve-law-practices-and-results
A better, more efficient way to perform mission-critical legal workflows
Law firms can reduce paper and costs (and more) with better document management practices
a child is holding a small plant showing that he is protecting it and going to plant it again so we can lessen global warming and save our planet. this picture was taken on the earth day.
Commit on Earth Day to move towards a paperless office
5 Ways your Organization can Become a Paperless Organization
Improve-data-loss-processes-with-OCR-solutions
A new and effective way to prevent data loss and improve security
Today’s innovators use optical character recognition to prevent data loss – could you?
Document capture solutions in insurance
The perfect technology for insurance claim management
Discover the document capture and workflow advantage
To provide more effective and tailored customer service, businesses should tap into analytics.
Leveraging analytics to ensure superior customer service
Data can help drive improved business performance and results
A battle cry for the healthcare industry to improve diagnostic radiology solutions
A battle cry for the healthcare industry: Set radiologists up for success
With mounting pressures, radiologists need better diagnostic solutions to meet their needs
Nuance-document-management-solutions-improve-printing-and-capture-processes
One effective way to reduce reliance on paper and improve EMR adoption
A better way to improve critical workflows for capturing and printing information
Automobile cockpit, various information monitors and head up displays.
Beyond the algorithms: Shaping the future of the Automotive Assistant for autonomous cars
New study reveals how drivers want to get notifications in the cars of the future
doctor looking toward the future of healthcare without clicks and keyboards
The future is now: Solving the digital dilemma in healthcare
Companies continue to progress with innovation and time-saving tools for healthcare
Document-management-provides-competitive-edge
How automating document management can be a competitive advantage
Many companies are turning document management into a sustainable competitive edge
OCR-use-cases
New ways OCR can improve business processes – and results
When it comes to OCR innovations, don’t get left behind
As technology advances, how will the role of the customer service professional change?
What’s my line?
The changing role of the customer service professional
Piloting new healthcare models with AI
AI is spawning new models of care, not just cars
Artificial Intelligence (AI) shows hope for powering new models of care
Just like the seasons, customer expectations change. Businesses can leverage self-service technologies to improve the customer experience.
From Spring Equinox to customer experience: how businesses can adapt to a changing landscape
As customer expectations evolve, companies should make intelligent self-service a priority
Show more articles

Feeds & threads

 

Loading…