What’s next:
Connected living

×

Affectiva Emotion AI: Detecting driver’s emotions and cognitive states

Recently, Affectiva and Nuance announced a collaboration to bring emotional intelligence to AI-powered mobility assistants by augmenting them with industry-first understanding of cognitive and emotional states. The result of this cooperation can be seen at CES 2019, where we are excited to share a number of new demonstrations integrating Affectiva’s technologies for the next generation of emotion-enabled vehicles.

By
How Nuance and Affectiva are bringing emotional intelligence to the mobility assistant

We’re seeing a significant shift in the way that people today want to interact with technology and devices. As virtual assistants become more popular – in smart speakers, online, and even in our cars – these assistants need to interact with people in the same way that we interact with one other. The transactional, question-and-response dialogue between people and technology will no longer cut it. A key element of human communication is the ability to convey complex emotions and cognitive states through non-verbal expressions from face and voice. So how do we emulate this in technology?

Recently, Affectiva and Nuance announced a collaboration to bring emotional intelligence to AI-powered mobility assistants by augmenting them with industry-first understanding of cognitive and emotional states. The result of this cooperation can be seen  at CES  2019, where we are excited to share a number of new demonstrations integrating Affectiva’s technologies for the next generation of emotion-enabled vehicles.

But first, let’s have a closer look at Affectiva and their emotion AI solution:

 

What does Affectiva’s software do and how does it work?

Using in-cabin cameras and microphones, Affectiva emotion AI can analyze facial and vocal expressions to identify expressions, emotions and reactions of the people in a vehicle. Our algorithms are built using deep learning, computer vision, speech science, and massive amounts of real-world data collected from people driving or riding in cars.

 

What metrics are taken into account and where is the data processed?

Affectiva Automotive AI includes a subset of facial metrics that are relevant for automotive use cases. These metrics are developed to work in in-cabin environments, supporting different camera positions and head angles. We also have vocal metrics.

Deep neural networks analyze the face at a pixel level to classify facial expressions and emotions. They also analyze acoustic-prosodic features (tone, tempo, loudness, pause patterns) to identify speech actions.

All of this is processed locally – we do not send any facial or vocal data to the cloud. As a result, this technology fits perfectly with Nuance’s hybrid approach for mobility assistants.

 

What kind of database is powering this technology?

To develop metrics that provide a deep understanding of the state of occupants in a car, we need large amounts of diverse, real-world data to fuel our deep learning-based algorithms. To date, Affectiva has collected over 7.5 million face videos in 87 different countries. This opt-in dataset of crowdsourced spontaneous emotion gathered in people’s homes, phones and cars represents a broad cross-section of age groups, ethnicities, and genders. Using this foundational dataset and the latest advances in transfer learning, Affectiva Automotive AI learned how to detect facial and vocal expression of emotion in the wild. (Read more about our emotion database.)

 

Which emotional and cognitive states are detected and why?

Affectiva Automotive AI takes driver state monitoring to the next level, analyzing both face and voice for levels of driver impairment caused by physical distraction, mental distraction from cognitive load or anger, drowsiness and more. In addition, we are able to measure the mood and reactions of a vehicle’s occupants so OEMs and Tier 1s can take this data and personalize the in-cabin environment and overall ride. Here are the metrics our technology currently provides, with more to come:

  • Tracking of all in-cabin occupants
  • Three facial emotions: Joy, Anger, and Surprise
  • Facial based valence: overall positivity or negativity
  • Four facial markers for drowsiness: Eye Closure, Yawning, Blink, and Blink Rate
  • Eight facial expressions: Smile, Eye Widen, Brow Raise, Brow Furrow, Cheek Raise, Mouth Open, Upper Lip Raise, and Nose Wrinkle
  • Two vocal Emotions: Anger and Laughter
  • Vocal expression of arousal: the degree of alertness, excitement, or engagement
  • Head pose estimation: Head Pitch, Head Yaw, Head Roll

 

Tell us more about driver monitoring: what does it mean for the car and driver safety?

Every day, over 1,000 injuries and nine fatalities are caused by distracted driving in the US alone – and up to 6,000 fatal crashes each year may be caused by drowsy drivers. This indicates a major need for driver monitoring to help improve road safety. To do this, there must be a deep understanding of driver emotions, cognitive states, and reactions to the driving experience. Additionally, the European New Car Assessment Programme (Euro NCAP) will require the automotive industry to develop next-generation safety features, such as driver monitoring. These systems are quickly becoming a standard safety requirement for regulatory bodies such as Euro NCAP, and will scale with evolving safety standards and future of mobility needs.

Affectiva Automotive AI unobtrusively measures, in real time, complex and nuanced emotional and cognitive states from face and voice. These insights can then be used to implement actions from showing a coffee-cup signal to more sophisticated solutions – for example suggesting safe places to rest or to lower the in-cabin temperature – as realized in Nuance’s mobility assistant.

 

 

 

About Affectiva:

Affectiva envisions a world where technology can understand all things human. An MIT Media Lab spin-off, Affectiva is the pioneer of Human Perception AI – software that can detect nuanced human emotions, complex cognitive states, behaviors, activities, interactions and objects people use. Built on deep learning, computer vision, speech science and massive amounts of real-world data, Affectiva’s patented Human Perception AI is enabling leading automotive OEMs, Tier 1 suppliers, ridesharing providers and fleet management companies to build intelligent vehicles that can perceive all things happening with the people inside of them. Affectiva’s technology is also used by 25 percent of the Fortune Global 500 companies to test consumer engagement with ads, videos and TV programming.

Affectiva created and defined the category of Emotion AI – technology that can detect expressions of emotion from face and voice – which is projected to become a multi-billion dollar industry. With its evolution beyond emotion detection, Affectiva’s Human Perception AI enables more personalized and meaningful interactions between people and their devices, consumers and brands, and ultimately, between humans and the world around us.

Read full article

More from the editor

“Good morning, why so stressed?”
CES 2019: Nuance introduces emotional intelligence to Dragon Drive Innovation Showcase
Contextually aware cars – Advanced sensor fusion in a multimodal world
How Nuance is leveraging sensor data to deliver an immersive user experience
Bringing Deadtime to Life
Advanced, voice-enabled mobility features bring life to our drive
“Clear the road – Emergency vehicle approaching”
Nuance introduces Siren detection for smart mobility assistants
Calm Down! How emotion recognition interactions can improve driving experiences
Nuance DRIVE Lab study explores acceptance of automotive assistants detecting emotions
Six reasons why the car is becoming the ultimate mobile device
Nuance and its “ultimate mobile device” at IFA 2018
MBUX: An OEM-branded experience with Nuance at the core of the conversational features
Looking at the intelligent voice control system in the Mercedes Benz User Experience (MBUX)
“I helped make this car” – Visions of a user experience researcher
Nuance DRIVE Lab: Who knows cars?
“We know that the automotive assistant adds a lot of value to the car sharing experience”
The automotive assistant as key enabler in holistic shared mobility concepts: Part 2
Shared Mobility: Personalizing the in-vehicle user experience without ownership
The automotive assistant as key enabler in holistic shared mobility concepts: Part 1
“We need to think about autonomous vehicles as of a driving living room”
Nils Lenke on the role of voice-enabled smart assistants in a world of autonomous cars
“We give full flexibility to our OEM customers to decide how data is used and which data leaves the car.”
Data protection and GDPR compliance strategies at Nuance Automotive
“We believe that it is essential for car makers to develop their own branded assistant”
Arnd Weil explains the current and future role of voice-enabled automotive assistants
///Humanlike. Innovative. Precise.
what3word 3-word addressing: the only addressing system built for voice
Mobility 2030+: From urban shuttle to car-a-home
Needs-based future mobility concepts in action
Mobility 2030+: A look beyond the technological horizon
Which technologies will impact the future mobility experience?
“Today, people expect voice control to be a fundamental part of their in-vehicle user experience”
Voice control has emerged as a distinguishing factor of the in-vehicle user experience
Assistants here, assistants there, assistants everywhere
Why automotive assistants serve user’s needs better than any other virtual assistant
Human-Machine-Interaction: Making friends with your automotive assistant
Looking behind the scenes of the latest automotive user experience generation in the market
Multimodal interaction – How machines learn to understand pointing
Smart assistants combine speech, gesture and hand writing for human-like user experience
Automotive HMI design: How AI can save the identity of car brands
The end of automotive design?
How artificial intelligence is helping you get closer to owning your dream droid
What it means to understand human language
Car-sharing of tomorrow at IAA 2017
Tomorrow’s concept cars wait where we need them and drive autonomously
The new Audi A8 with Dragon Drive
At IAA 2017, Audi and Nuance demonstrate the new Automotive Assistant in the A8
What does the future automotive assistant look like?
IAA 2017 shows what the automotive assistant is already capable of and how it will develop
Have your people call my people ….or my car
With just one word, cars can know who you are and what you want
For CSPs, sweating the small stuff can pay big dividends
How small changes in subscriber engagement add up to big revenue for CSPs
Your voice is the key to transforming the smart home
Voice biometrics for authentication is the the next frontier of the Intelligent home
Who needs a car manual with self-aware cars?
Cars of the future, may be able to answer questions about themselves
Beyond the algorithms: Shaping the future of the Automotive Assistant for autonomous cars
New study reveals how drivers want to get notifications in the cars of the future
You won’t need to dial a friend or a thick paper manual with Dragon Drive
How your car just got smarter and won't leave you hangin' with our Smart Car Manual
1,000 years of emoji history and what Machine Learning means for its future
A look at emoji: how they’ve changed over time and where they are going
We need an Internet of Things that thinks and shares
Why the IoT needs AI and Interoperability to succeed
Marc Buoniconti: How I achieved independence with assistive technology and speech recognition
Empowering the disabled community through research and innovation by The Miami Project
Part 4: How to avoid 5 common automotive HMI usability pitfalls
Errors will happen – it’s how they’re handled that matters
Addressing privacy concerns with speech recognition
A response to recent media about data privacy
4 pillars of Artificial Intelligence that are building the car of the future
Connected cars are becoming smarter at every turn
No cloud, no data – no problem for cars with embedded dictation
Embedded technology picks up where cloud connectivity leaves off
Unifying the connected smart home through smart TVs
Bringing disparate devices together via a central access point with AI technologies
Part 3: How to avoid 5 common automotive HMI usability pitfalls
Mismatched prompts and dialog: Saying one thing and meaning another
Part 2: How to avoid 5 common automotive HMI usability pitfalls
HMI design is a balancing act of too much and not enough information
Part 1: How to avoid 5 common automotive HMI usability pitfalls
Audio and touch input are at the core of a powerful automotive HMI system
Using my voice to write to turn lemons into lemonade
How injury led to a revitalized blog style
Why personalization is the key to the future of the connected car
New survey results make the case for in-car technology that fits our lifestyles
Mercedes-Benz’s Margarete Wies discusses the future of the connected car
Extending digital living with infotainment systems, autonomous vehicles, and more
In a galaxy (not so) far, far away
Star Wars and the relationship between man and machine
Why navigation systems shouldn’t require more than just simple spoken words
Navigating on-board and off-board content with voice technology
Then and NAO: Bringing conversational robots to homes, hotels, and hospitals
Aldebaran's NAO and Pepper show the power of specialized voice experiences for robotics
Detour ahead: Using futuristic car technology to predict (and avoid) traffic
The benefits of a contextually-aware infotainment system
What’s that on the dash? How an automotive assistant can help alert drivers of maintenance
Cars are becoming both self-aware and better communicators through in-car intelligence
Democratization of voice technology and data in the age of IoT
Why it matters for consumer adoption and monetization
What I’ve seen and learned after 15 years in the mobile tech industry
The smart home of the future is now becoming a reality
KITT – Please open the garage
How talking cars that talk to "things" make life simpler, smarter
Meet Lisa, a world championship robot with a lot to say
How this student-built social robot can lend a helpful hand to our aging society
CES 2016: Where innovation meets intuition for this crazy, connected world
Why we need voice to experience the intelligence in IoT and connected cars
The walls (and appliances) are talking: Building voice interfaces for the IoT
How to simplify the complexity of interacting with billions of connected devices
Tiro is history: Welcome to the new era of the automotive assistant for the connected car
How a virtual personal assistant designed for your car will enhance the driving experience
How this smart car technology can minimize driver distraction and reduce collisions
Could contextually-aware in-vehicle infotainment systems yield safer driving?
Pebble brings Nuance’s voice technology to Pebble devices and developers
Using voice to simplify experiences with smartwatches
IBC 2015: Talking is the new way to engage your TV
Your voice may be the future of home entertainment
Turn that frown upside down: Swype on Android gets new themes, intuitive Emoji support and more
Top requested features are brought to Swype on Android in the keyboard’s latest update
Lost in translation: A solo trip abroad and discovering the art of language
Sunrises in Spain and machines you can talk to
James Bond: an inspiration for health IT and the connected car
Shifting personal health into high gear
Driving to the moon and back in a connected car
Auto infotainment systems are connecting drivers to social media and music
Deep learning, coming to a car near you
Computing systems inspired by the human brain change the way we interact with cars
Form over function? The challenge to designing fashion-forward wearable devices
Technologists and designers team up to deliver wearables that people actually want to wear
From Japan to America: My personal journey with distracted driving
How technology can make for a safer connected car
Meet the virtual assistant who’s cooler than you
She’s smart, organized, and knows all the things you don’t
Lessons from SXSW: How to design the UI for the Internet of Things
Building effective voice interfaces for connected experiences
How to design voice interfaces for today’s connected devices [Webcast Replay]
Designers share their expertise on bringing speech to our devices
The global, cloud-connected rise of voicemail-to-text messaging
Consumers and mobile operators look to the cloud for flexible voice solutions
Your smart phone is the mistress behind your committed relationships
Technology should be complementary, not a replacement, for interpersonal relationships
Why you will no longer be tempted to reach for your phone in the car
Introducing Dragon Drive Daily Update technology for a more convenient in-car experience
5 must-haves for the tech-lovers’ ultimate Super Bowl party
Get ready for kick-off with these gadgets and tips
Reflections from the show floor: Gadgets and trends that dominated CES 2015
Buzz-worthy takeaways from CES in Las Vegas – and a look at what’s to come in 2015
Nuance gets people talking to things, cars and apps at CES 2015
New innovations for the connected home, connected car, wearables, consumer health and more
CES 2015: Turning a techie into a modern-day Odysseus
The benefits of taking the circuitous route around the CES 2015 showroom floor
The essential formula for designing user interfaces for wearable devices
How to optimize usability for a sub-2 inch screen
Voice and IoT by the numbers: We’re talking to more connected devices than ever before
A view from the cloud on the Internet of Things
Top 5 tech predictions for CES 2015
Consumer health, connected cars, televisions and more expected to stand out at CES 2015
Swype presents: Candy-colored themes and a winter wonderland
New themes and languages are here for the Swype keyboard on iOS 8
How close are you with your TV? Mine knows me by voice
Panasonic makes TV more personal with Nuance’s voice biometrics
Dragon Drive and Slacker Radio present a DJ in your dashboard
More music and content continue to drive an innovative in-car infotainment experience
Bringing AneedA to life: How we built the personal assistant for the i.amPULS
Marrying form and function to design a next-generation wearable device
Swype for iOS 8 goes global: Now ft. NEW languages and intuitive Emoji support! :-)
Swype adds global language support with 16 new languages
Live from Samsung Developer Conference 2014: Spotlight on the Gear App Challenge
Developers are innovating for the next wave of wearable devices
How to train your body with smart health-enabled wearables
In the future, we’ll all be wearing our hearts on our sleeves
‘Car’ is to ‘brand’ like ‘rock’ is to ‘roll’
Auto brands thrive on creating powerful personal connections
Voice and the connected lifestyle at Samsung Developer Conference 2014
NDEV Samsung Early Access Program brings the future of voice in IoT to app developers
I’m a millennial, and I won’t listen to your voicemail
We all want options – why should voicemail be any different?
How business intelligence can decrease auto manufacturer costs and customer frustrations
Data drives a more powerful vehicle experience
A new way to “text”: Swype keyboard debuts for iPhone, iPad and iPod touch
Swype, the original continuous touch keyboard, launches on the App Store
How the voice interface will reinvent home entertainment
News from the International Broadcasting Conference 2014, Amsterdam
Nuance-powered S-Voice gets smarter with Samsung Note 4, Note Edge, Gear S
New S-Voice features unveiled at Samsung Unpacked 2014 in Berlin, Germany
Teaching kids to read with the Speaktacular Sight Words reading app
Interactive application assists children with reading development skills
Content: Driving the in-car user experience
The essential formula for searching for content in the car
Swype scores new Major League Soccer keyboard themes, available now for Android
Nuance brings an even higher level of quality personalization to the Swype Keyboard
Who really won the World Cup? (According to Swype fans, that is)
Swype Living Language harnesses the power of real-time trending words and phrases
Dragon Mobile Assistant – your personal virtual assistant is at your service
Use Dragon Mobile Assistant to streamline your life
CES 2019: Nuance introduces emotional intelligence to Dragon Drive Innovation Showcase
“Good morning, why so stressed?”
CES 2019: Nuance introduces emotional intelligence to Dragon Drive Innovation Showcase
Nuance introduces Siren detection feature to smart mobility assistants
“Clear the road – Emergency vehicle approaching”
Nuance introduces Siren detection for smart mobility assistants
MBUX, Mercedes-Benz’ new user experience system with intelligent voice controls powered by Nuance’s hybrid Dragon Drive platform
MBUX: An OEM-branded experience with Nuance at the core of the conversational features
Looking at the intelligent voice control system in the Mercedes Benz User Experience (MBUX)
Digital automotive assistants can play a major role in shared mobility
Shared Mobility: Personalizing the in-vehicle user experience without ownership
The automotive assistant as key enabler in holistic shared mobility concepts: Part 1
Arnd Weil explains the current and future role of voice-enabled automotive assistants
“We believe that it is essential for car makers to develop their own branded assistant”
Arnd Weil explains the current and future role of voice-enabled automotive assistants
A look at the technological changes for future mobility which we can anticipate by 2030
Mobility 2030+: A look beyond the technological horizon
Which technologies will impact the future mobility experience?
Latest advancements in technology assure a great user experience when interacting with the automotive assistant
Human-Machine-Interaction: Making friends with your automotive assistant
Looking behind the scenes of the latest automotive user experience generation in the market
How artificial intelligence is helping you get closer to owning your dream droid
What it means to understand human language
What does the future automotive assistant look like?
IAA 2017 shows what the automotive assistant is already capable of and how it will develop
Voice biometrics is the key to the smart home.
Your voice is the key to transforming the smart home
Voice biometrics for authentication is the the next frontier of the Intelligent home
You won’t need to dial a friend or a thick paper manual with Dragon Drive
How your car just got smarter and won't leave you hangin' with our Smart Car Manual
Father and son Nick and Marc Buoniconti pose in front of a research center for the Miami Project, striving to cure paralysis
Marc Buoniconti: How I achieved independence with assistive technology and speech recognition
Empowering the disabled community through research and innovation by The Miami Project
Today’s connected cars are smarter with artificial intelligence technology
4 pillars of Artificial Intelligence that are building the car of the future
Connected cars are becoming smarter at every turn
Part 3: How to avoid 5 common automotive HMI usability pitfalls
Mismatched prompts and dialog: Saying one thing and meaning another
Public speaking coach and trainer Geoffrey X. Lane uses Dragon to continue working while experiencing a debilitating shoulder injury
Using my voice to write to turn lemons into lemonade
How injury led to a revitalized blog style
Star Wars’ portrayal of relationships between robots and humans is becoming today’s reality with new technological advancements
In a galaxy (not so) far, far away
Star Wars and the relationship between man and machine
Drivers wouldn’t have to spend so much time stuck in traffic jams if they had the right contextually-aware infotainment system
Detour ahead: Using futuristic car technology to predict (and avoid) traffic
The benefits of a contextually-aware infotainment system
IoT connected smart fridge, wearables, and smartphones are today’s reality
What I’ve seen and learned after 15 years in the mobile tech industry
The smart home of the future is now becoming a reality
light bulb illustrates how IoT innovation finally met function at CES 2016
CES 2016: Where innovation meets intuition for this crazy, connected world
Why we need voice to experience the intelligence in IoT and connected cars
Tests show that in-vehicle infotainment and crash avoidance systems – when working in concert – can minimize driver distraction
How this smart car technology can minimize driver distraction and reduce collisions
Could contextually-aware in-vehicle infotainment systems yield safer driving?
The Swype keyboard for Android now features intuitive Emoji support and new downloadable themes
Turn that frown upside down: Swype on Android gets new themes, intuitive Emoji support and more
Top requested features are brought to Swype on Android in the keyboard’s latest update
Auto infotainment systems are connecting drivers to social media and music
Driving to the moon and back in a connected car
Auto infotainment systems are connecting drivers to social media and music
New technologies in the connected car can reduce the surge in distracted driving, something I jarringly noticed after returning to the US from Japan
From Japan to America: My personal journey with distracted driving
How technology can make for a safer connected car
As screen sizes shrink and people continually expect easy, intelligent interactions with their devices, designing a user-friendly voice interface becomes paramount.
How to design voice interfaces for today’s connected devices [Webcast Replay]
Designers share their expertise on bringing speech to our devices
Her car gives her personalized directions, upcoming meetings, news headlines and more - at the sound of her voice.
Why you will no longer be tempted to reach for your phone in the car
Introducing Dragon Drive Daily Update technology for a more convenient in-car experience
i.amPULS creator will.i.am poses with Nuance at CES 2015
Nuance gets people talking to things, cars and apps at CES 2015
New innovations for the connected home, connected car, wearables, consumer health and more
Voice and IoT by the numbers: We’re talking to more connected devices than ever before
A view from the cloud on the Internet of Things
Panasonic TVs with voice biometrics know you by voice to deliver the content you want, faster.
How close are you with your TV? Mine knows me by voice
Panasonic makes TV more personal with Nuance’s voice biometrics
swype-adds-new-languages
Swype for iOS 8 goes global: Now ft. NEW languages and intuitive Emoji support! :-)
Swype adds global language support with 16 new languages
dragon-drive-delivers-consistent-auto-branding
‘Car’ is to ‘brand’ like ‘rock’ is to ‘roll’
Auto brands thrive on creating powerful personal connections
auto-oem-total-cost-of-ownership
How business intelligence can decrease auto manufacturer costs and customer frustrations
Data drives a more powerful vehicle experience
Nuance-powered S-Voice gets smarter with Samsung Note 4, Note Edge, Gear S
New S-Voice features unveiled at Samsung Unpacked 2014 in Berlin, Germany
swype-keyboard-themes-MLS
Swype scores new Major League Soccer keyboard themes, available now for Android
Nuance brings an even higher level of quality personalization to the Swype Keyboard
Advanced sensor fusion in a multi-modal world
Contextually aware cars – Advanced sensor fusion in a multimodal world
How Nuance is leveraging sensor data to deliver an immersive user experience
Nuance DRIVE Lab study explores acceptance of automotive assistants detecting emotions
Calm Down! How emotion recognition interactions can improve driving experiences
Nuance DRIVE Lab study explores acceptance of automotive assistants detecting emotions
The Detroit drivers make cars and the Nuance DRIVE lab is trying to make these cars even better.
“I helped make this car” – Visions of a user experience researcher
Nuance DRIVE Lab: Who knows cars?
Building trust in autonomous cars
“We need to think about autonomous vehicles as of a driving living room”
Nils Lenke on the role of voice-enabled smart assistants in a world of autonomous cars
what3words offers an addressing system built for voice
///Humanlike. Innovative. Precise.
what3word 3-word addressing: the only addressing system built for voice
Voice control has emerged as a distinguishing factor of the in-vehicle user experience
“Today, people expect voice control to be a fundamental part of their in-vehicle user experience”
Voice control has emerged as a distinguishing factor of the in-vehicle user experience
Smart multimodal assistants, such as Nuance Dragon Drive, now also include gaze detection based on eye-tracking
Multimodal interaction – How machines learn to understand pointing
Smart assistants combine speech, gesture and hand writing for human-like user experience
Car-sharing of the future at IAA 2017
Car-sharing of tomorrow at IAA 2017
Tomorrow’s concept cars wait where we need them and drive autonomously
Have your people call my people ….or my car
With just one word, cars can know who you are and what you want
Smart car manuals aren't manual
Who needs a car manual with self-aware cars?
Cars of the future, may be able to answer questions about themselves
The history of emoji and its future with Machine Learning
1,000 years of emoji history and what Machine Learning means for its future
A look at emoji: how they’ve changed over time and where they are going
Part 4: How to avoid 5 common automotive HMI usability pitfalls
Errors will happen – it’s how they’re handled that matters
No cloud, no data – no problem for cars with embedded dictation
Embedded technology picks up where cloud connectivity leaves off
How to avoid driver information overload when using automotive human machine interfaces
Part 2: How to avoid 5 common automotive HMI usability pitfalls
HMI design is a balancing act of too much and not enough information
Image alt-text: UK Germany interview of a driver who wants personalized connected car technology
Why personalization is the key to the future of the connected car
New survey results make the case for in-car technology that fits our lifestyles
Car navigation should work with both on-board and off-board cloud solutions with simple spoken word
Why navigation systems shouldn’t require more than just simple spoken words
Navigating on-board and off-board content with voice technology
A proactive automotive assistant helps tell drivers what’s wrong with their cars and how to maintenance to fix issues
What’s that on the dash? How an automotive assistant can help alert drivers of maintenance
Cars are becoming both self-aware and better communicators through in-car intelligence
Connected cars are becoming more connected to the IoT and more useful, employing ubiquitous personal assistants that exist across devices and experiences
KITT – Please open the garage
How talking cars that talk to "things" make life simpler, smarter
complex devices mean we need good voice experiences for internet of things
The walls (and appliances) are talking: Building voice interfaces for the IoT
How to simplify the complexity of interacting with billions of connected devices
Pebble brings Nuance’s voice technology to Pebble devices, developers
Pebble brings Nuance’s voice technology to Pebble devices and developers
Using voice to simplify experiences with smartwatches
Traveling alone in Spain, I formed a new appreciation for language as an art and the technology we’ve built to interpret and interact with people
Lost in translation: A solo trip abroad and discovering the art of language
Sunrises in Spain and machines you can talk to
deep learning connected car echnology
Deep learning, coming to a car near you
Computing systems inspired by the human brain change the way we interact with cars
Meet the virtual assistant who’s cooler than you
She’s smart, organized, and knows all the things you don’t
With cloud connectivity, voicemail-to-text messaging in emerging global markets provides easy, flexible access to messages
The global, cloud-connected rise of voicemail-to-text messaging
Consumers and mobile operators look to the cloud for flexible voice solutions
Group of friends has all the tech essentials and sits cheering on their team at their Super Bowl party
5 must-haves for the tech-lovers’ ultimate Super Bowl party
Get ready for kick-off with these gadgets and tips
Exploring CES like Odysseus makes way for the Internet of Healthcare Things
CES 2015: Turning a techie into a modern-day Odysseus
The benefits of taking the circuitous route around the CES 2015 showroom floor
Our top predictions for CES 2015 include wearable devices and connected mobile apps made possible by the Internet of Things.
Top 5 tech predictions for CES 2015
Consumer health, connected cars, televisions and more expected to stand out at CES 2015
Having Slacker Radio in your Toyota Entune or Lexus Enform Dragon Drive-equipped car is like having a DJ in your dashboard
Dragon Drive and Slacker Radio present a DJ in your dashboard
More music and content continue to drive an innovative in-car infotainment experience
samsung-gear-developers
Live from Samsung Developer Conference 2014: Spotlight on the Gear App Challenge
Developers are innovating for the next wave of wearable devices
nuance-at-samsung-developer-conference-connected-lifestyle
Voice and the connected lifestyle at Samsung Developer Conference 2014
NDEV Samsung Early Access Program brings the future of voice in IoT to app developers
swype-on-ios-8-for-iphone-ipad
A new way to “text”: Swype keyboard debuts for iPhone, iPad and iPod touch
Swype, the original continuous touch keyboard, launches on the App Store
Speaktacular-Sight-Words-app
Teaching kids to read with the Speaktacular Sight Words reading app
Interactive application assists children with reading development skills
swype-living-language-world-cup-fans
Who really won the World Cup? (According to Swype fans, that is)
Swype Living Language harnesses the power of real-time trending words and phrases
Bringing Deadtime to Life
Bringing Deadtime to Life
Advanced, voice-enabled mobility features bring life to our drive
New features like gaze or gesture detection – as demonstrated in Berlin with our Dragon Drive showcase – allow effortless engagement with the car and the environment outside the car
Six reasons why the car is becoming the ultimate mobile device
Nuance and its “ultimate mobile device” at IFA 2018
Use cases and capabilities of a smart car-sharing application as part of the voice-enabled automotive assistant
“We know that the automotive assistant adds a lot of value to the car sharing experience”
The automotive assistant as key enabler in holistic shared mobility concepts: Part 2
Data security has become an important topic for customers - even long before GDPR
“We give full flexibility to our OEM customers to decide how data is used and which data leaves the car.”
Data protection and GDPR compliance strategies at Nuance Automotive
In the future, mobility hubs will be commonplace in larger cities
Mobility 2030+: From urban shuttle to car-a-home
Needs-based future mobility concepts in action
Automotive assistants support the needs of people on-the-go better than any other virtual assistant possibly can.
Assistants here, assistants there, assistants everywhere
Why automotive assistants serve user’s needs better than any other virtual assistant
The ever-increasing connectivity of the modern cars Artificial Intelligence is shifting the design focus to Human Machine Interfaces (HMI) rather than the bodywork
Automotive HMI design: How AI can save the identity of car brands
The end of automotive design?
The new Audi A8 with Dragon Drive
At IAA 2017, Audi and Nuance demonstrate the new Automotive Assistant in the A8
For CSPs, sweating the small stuff can pay big dividends
How small changes in subscriber engagement add up to big revenue for CSPs
Beyond the algorithms: Shaping the future of the Automotive Assistant for autonomous cars
New study reveals how drivers want to get notifications in the cars of the future
Interoperability calls for sharing data in the Internet of Things
We need an Internet of Things that thinks and shares
Why the IoT needs AI and Interoperability to succeed
Everything is connected in today’s digital world
Addressing privacy concerns with speech recognition
A response to recent media about data privacy
Unifying the connected smart home through smart TVs
Bringing disparate devices together via a central access point with AI technologies
How to get the key foundation right for automotive HMI with audio and touch input
Part 1: How to avoid 5 common automotive HMI usability pitfalls
Audio and touch input are at the core of a powerful automotive HMI system
The Future Mobility vehicle becomes a contextual and highly personalized digital living space.
Mercedes-Benz’s Margarete Wies discusses the future of the connected car
Extending digital living with infotainment systems, autonomous vehicles, and more
Machine Learning, Neural Nets, and advanced voice technology are making the robots for homes, banks, hotels, and more, even smarter
Then and NAO: Bringing conversational robots to homes, hotels, and hospitals
Aldebaran's NAO and Pepper show the power of specialized voice experiences for robotics
Voice technology will be a primary interface for the Internet of Things.
Democratization of voice technology and data in the age of IoT
Why it matters for consumer adoption and monetization
Students from the University of Koblenz-Landau built Lisa, a helpful social robot who can communicate with humans and perform daily tasks.
Meet Lisa, a world championship robot with a lot to say
How this student-built social robot can lend a helpful hand to our aging society
Drivers need a virtual personal assistant for the connected car
Tiro is history: Welcome to the new era of the automotive assistant for the connected car
How a virtual personal assistant designed for your car will enhance the driving experience
Speech recognition is simplifying how people discover and access content on their TVs.
IBC 2015: Talking is the new way to engage your TV
Your voice may be the future of home entertainment
James Bond: an inspiration for health IT and the connected car
Shifting personal health into high gear
A smart watch or other wearable device that people actually want to wear will combine the best of design – usability and fashion
Form over function? The challenge to designing fashion-forward wearable devices
Technologists and designers team up to deliver wearables that people actually want to wear
Mobile UX designer Tim Lynch shares his presentation from SXSW 2015 on how to design user interfaces for the Internet of Things.
Lessons from SXSW: How to design the UI for the Internet of Things
Building effective voice interfaces for connected experiences
Our relationships with connected devices like smart phones are complementary, but not a replacement for, our interpersonal relationships
Your smart phone is the mistress behind your committed relationships
Technology should be complementary, not a replacement, for interpersonal relationships
Samsung's B.K. Yoon talks IoT as one of the top gadgets and tech trends from CES 2015
Reflections from the show floor: Gadgets and trends that dominated CES 2015
Buzz-worthy takeaways from CES in Las Vegas – and a look at what’s to come in 2015
There comes a unique set of challenges when designing a user interface for wearable devices with sub-2 inch screens.
The essential formula for designing user interfaces for wearable devices
How to optimize usability for a sub-2 inch screen
New Swype keyboard themes are available for iOS 8.1 and up, including an animated winter wonderland themed one.
Swype presents: Candy-colored themes and a winter wonderland
New themes and languages are here for the Swype keyboard on iOS 8
the i.am+ PULS wearable device by will.i.am
Bringing AneedA to life: How we built the personal assistant for the i.amPULS
Marrying form and function to design a next-generation wearable device
smart-watch-wearable
How to train your body with smart health-enabled wearables
In the future, we’ll all be wearing our hearts on our sleeves
I’m a millennial, and I won’t listen to your voicemail
We all want options – why should voicemail be any different?
home-automation-Dragon-TV
How the voice interface will reinvent home entertainment
News from the International Broadcasting Conference 2014, Amsterdam
in-car-user-experience
Content: Driving the in-car user experience
The essential formula for searching for content in the car
dragon-mobile-assistant-app
Dragon Mobile Assistant – your personal virtual assistant is at your service
Use Dragon Mobile Assistant to streamline your life
Show more articles