What’s next.

Continued progress in reinventing the relationship between people and technology.

×

From the editor

Can machines think?

With the initial report that a computer modeled after a 13-year-old boy had passed the Turing Test, followed much skepticism and doubt, Nuance announces a new way to measure Artificial Intelligence with the Winograd Schema Challenge. Providing a more accurate reading of true Artificial Intelligence through sets of multiple-choice questions, the Winograd Schema Challenge will be hosted annually by Nuance and Commonsense.org to push the boundaries of Artificial Intelligence.

By
winograd-schema-challenge

In what Winston Churchill called the single biggest contribution to the Allied victory over Nazi Germany during the Second World War, the breaking of the German naval Enigma code was a feat of international importance and technological prowess. The man behind the code breaking, Alan Turing, is now known as one of the most significant mathematicians, logicians, cryptanalysts and computer scientists of modernity, credited with both enabling a defeat of the Nazis and as “The Father of Theoretical Computer Science and Artificial Intelligence.” And while it is undoubtedly true that the former contribution holds a vital significance in our world, it his second role, the Father of theoretical computer science and Artificial Intelligence (AI), that has resurfaced in relevance today.

For many, Turing’s name is now familiar because of the recent flurry of news articles regarding the Turing Test. The Turing Test, proposed in 1950 by Alan Turing, essentially measures an artificially intelligent system by pitting a human against a computer program. In his 1950 paper “Computing Machinery and Intelligence,” Turing invents a sort of game to be played by a human, a machine, and an interrogator to ultimately answer the pivotal question: Can machines think? If the program can convince the interrogator that it is a human, the program has passed the Turing Test and has reached the intellectual capacity of a human.

But among the plethora of articles declaring the passing of the Turing Test and the intellectual supremacy of Eugene Gootsman, the computer modeled after a 13-year-old boy rumored to have passed the test, a similarly loud contingency declares that the test has, in fact, not been passed. The test has been changed too much in order to model an adolescent boy, and it still makes use of much trickery to fool the interlocutor, many argue.

As the voices advocating for the invalidity of Eugene’s achievement get louder and louder, research scientists from Nuance offer a robust and exciting solution: the Winograd Schema test, a test developed by Hector Levesque at the University of Toronto and winner of the 2013 IJCAI Award for research excellence that measures Artificial Intelligence more accurately. While the Turing Test asks for short, free-form conversation, the Winograd Schema approach asks for answers to a set of multiple-choice questions. The answers to these questions may seem easy to a mere human, but for a computer they can be exceedingly difficult. These questions will therefore offer a more accurate measure of genuine machine intelligence.

So, what exactly would this test look like? I’ll give you an example, and you can take the Winograd test yourself.

Question: The beach chair will not fit in the trunk because it was too big. What was too big?

Answer A: The beach chair

Answer B: The trunk

Now for humans, this answer seems obvious: Answer A must be true because the chair must be too big if it doesn’t fit in the trunk. It turns out, however, that most AI systems lack the everyday commonsense knowledge and reasoning to support such simple conclusions. A computer that is truly as smart as a human (or even close to it) must be able to answer questions such as these, and thus pass the Winograd Schema test.

There has been renewed interest in AI and Natural Language Processing (NLP) as a means of humanizing the complex technological landscape that we encounter in our day-to-day lives. The Winograd Schema Challenge provides us with a tool for concretely measuring research progress in commonsense reasoning, an essential element of our intelligent systems. Competitions such as the Winograd Schema Challenge can help guide more systematic research efforts that will, in the process, allow us to realize new systems that push the boundaries of current AI capabilities and lead to smarter personal assistants and intelligent systems.

Nuance is now hosting an annual competition to develop programs that can solve the Winograd Schema Challenge and advance the intelligence and technology of our artificially intelligent systems.

The test will be administered on a yearly basis by CommonsenseReasoning.org. The first submission deadline will be October 1, 2015. The 2015 CommonsenseReasoning Symposium, to be held at the AAAI Spring Symposium at Stanford from March 23-25, 2015, will include a special session for presentations and discussions on progress and issues related to this Winograd Schema Challenge. The winner that meets the baseline for human performance will receive a grand prize of $25,000. With a little more than a year to go, get started now on a new super computer to beat out 13-year-old Eugene and beat this new test of artificial intelligence: the Winograd Schema.

Read full article

More from the editor

Nuance senior research scientist David Martin receives AAAI Senior Member status
Leading Artificial Intelligence industry group recognizes Martin for career achievements
Radiology makes a pledge to pediatric patients
Children's of Alabama joins medical imaging and reporting network to reduce redundant scans
Who really won the World Cup? (According to Swype fans, that is)
Swype Living Language harnesses the power of real-time trending words and phrases
Dragon Mobile Assistant – your personal virtual assistant is at your service
Use Dragon Mobile Assistant to streamline your life
Can machines think?
Nuance to host annual Winograd Schema Challenge, an alternative to the Turing Test
Population health programs need to evolve with consumers
Engage your patients at each stage of care
What to know before talking to physicians about clinical documentation improvement
Physicians don’t act on business motives, they act on patient care motives
How to keep improving in a fast-moving, tech-heavy world? Speak Up
Dragon NaturallySpeaking 13 takes speed, accuracy and productivity to the next level
Technology’s role in caring for thousands of pensioners in Mexico
Voice biometrics allows aging pensioners to comply with “proof of life” requirements
4 productivity tips to take control of your day
Focus on what matters and watch your workplace performance transform
I’m a CEO (but I never learned how to type)
Dragon NaturallySpeaking helps me manage my growing business
It’s time to forget your manners and “Barge-in”
New technologies pave the way for a smoother in-car experience
3 things health IT can learn from the Food Network
Extracting the most important health information so it is at physicians' fingertips
“My account was hacked, it could have been prevented”
It’s time for banks to take increased measures to secure accounts
Humanizing technology through Cognitive Computing and Artificial Intelligence
Nuance furthers AI investment with DFKI research center
Easing the burden of radiation dose reporting
Diagnostic solutions proven for today, powering tomorrow
5 lessons for the Internet of Things from Managed Print Services
What can you do to boost enterprise-wide intelligence and collaboration?
Using the principles of a Venn diagram to prevent the failure of CFO initiatives
CFO-CMO collaboration is critical to successful strategy implementation
App-of-the-month: ScribeIQ
Apps that are shaping the future of healthcare technology
Reflecting on Easter Seals’ Evening of Empowerment, 2014
"Yes you can!"
Why we need to talk about the money
Approaching patient care from both clinical and administrative angles
Domino’s makes a game-changing move to the way you order pizza
The virtual assistant makes ordering Domino’s Pizza a breeze
When excellent doctors are poor documenters
Why accurate clinical documentation is key to successful outcomes
Can using design principles create parsimony in healthcare?
Keeping the end users’ needs in mind as we design health IT
I love biometrics
Why voice biometrics is the most effective authentication method
CNBC shines a spotlight on Nuance and the future of biometrics in mobile banking
Nuance voice biometrics technology featured in CNBC segment “Industrial Revolutions"
Why “innovation” doesn’t always have to be new (or at least on first sight)
Decades old concepts give light to revolutionary innovations
Preserve the HIM workforce during the ICD-10 delay
Staying the course with ICD-10 transition planning
Voice biometrics for the masses
Insights from 2014 Opus Voice Biometrics Conference San Francisco & Enterprise Analyst Day
Becoming more user-centric in health IT
Guidelines to help keep people, processes, and technology aligned
Password inventor, at 87, says passwords are insecure
145 million E-Bay passwords available for 1.45 Bitcoin
Transforming care, breaking down barriers
“The practice of medicine is an art based on science” – Sir William Osler
It took me almost 50 years to understand accessibility
Reflections on Global Accessibility Awareness Day
The “lady with the lamp” still sheds light on healthcare
How Florence Nightingale continues to inspire health IT innovation
Automotive: Now it’s personal
Speaker recognition enables personal and secure interaction with your car
aaai-senior-member-david-martin
Nuance senior research scientist David Martin receives AAAI Senior Member status
Leading Artificial Intelligence industry group recognizes Martin for career achievements
dragon-mobile-assistant-app
Dragon Mobile Assistant – your personal virtual assistant is at your service
Use Dragon Mobile Assistant to streamline your life
Dr. Feghali CMO CQO
What to know before talking to physicians about clinical documentation improvement
Physicians don’t act on business motives, they act on patient care motives
productivity-tips-for-work
4 productivity tips to take control of your day
Focus on what matters and watch your workplace performance transform
What healthIT can learn from Food Network
3 things health IT can learn from the Food Network
Extracting the most important health information so it is at physicians' fingertips
Diagnostic Imaging
Easing the burden of radiation dose reporting
Diagnostic solutions proven for today, powering tomorrow
ScribeIQ
App-of-the-month: ScribeIQ
Apps that are shaping the future of healthcare technology
Dominos Virtual Assistant
Domino’s makes a game-changing move to the way you order pizza
The virtual assistant makes ordering Domino’s Pizza a breeze
Biometrics
I love biometrics
Why voice biometrics is the most effective authentication method
Bonnie Cassidy
Preserve the HIM workforce during the ICD-10 delay
Staying the course with ICD-10 transition planning
Secured Data Transfer
Password inventor, at 87, says passwords are insecure
145 million E-Bay passwords available for 1.45 Bitcoin
lantern
The “lady with the lamp” still sheds light on healthcare
How Florence Nightingale continues to inspire health IT innovation
Medical Imaging
Radiology makes a pledge to pediatric patients
Children's of Alabama joins medical imaging and reporting network to reduce redundant scans
winograd-schema-challenge
Can machines think?
Nuance to host annual Winograd Schema Challenge, an alternative to the Turing Test
dragon-naturallyspeaking-13
How to keep improving in a fast-moving, tech-heavy world? Speak Up
Dragon NaturallySpeaking 13 takes speed, accuracy and productivity to the next level
Dragon-NaturallySpeaking-for-business
I’m a CEO (but I never learned how to type)
Dragon NaturallySpeaking helps me manage my growing business
ATM Keypad
“My account was hacked, it could have been prevented”
It’s time for banks to take increased measures to secure accounts
managed-print-services
5 lessons for the Internet of Things from Managed Print Services
What can you do to boost enterprise-wide intelligence and collaboration?
Easter Seals' Evening of Empowerment 2014
Reflecting on Easter Seals’ Evening of Empowerment, 2014
"Yes you can!"
Numbers And Finance
When excellent doctors are poor documenters
Why accurate clinical documentation is key to successful outcomes
biometric-authentication-CNBC
CNBC shines a spotlight on Nuance and the future of biometrics in mobile banking
Nuance voice biometrics technology featured in CNBC segment “Industrial Revolutions"
Jose Ignacio Zorrilla
Voice biometrics for the masses
Insights from 2014 Opus Voice Biometrics Conference San Francisco & Enterprise Analyst Day
Fuente: COM SALUD
Transforming care, breaking down barriers
“The practice of medicine is an art based on science” – Sir William Osler
connected car
Automotive: Now it’s personal
Speaker recognition enables personal and secure interaction with your car
swype-living-language-world-cup-fans
Who really won the World Cup? (According to Swype fans, that is)
Swype Living Language harnesses the power of real-time trending words and phrases
Automated outreach
Population health programs need to evolve with consumers
Engage your patients at each stage of care
Viva Voz
Technology’s role in caring for thousands of pensioners in Mexico
Voice biometrics allows aging pensioners to comply with “proof of life” requirements
auto-barge-in-wake-up-work
It’s time to forget your manners and “Barge-in”
New technologies pave the way for a smoother in-car experience
artificial-intelligence
Humanizing technology through Cognitive Computing and Artificial Intelligence
Nuance furthers AI investment with DFKI research center
venn
Using the principles of a Venn diagram to prevent the failure of CFO initiatives
CFO-CMO collaboration is critical to successful strategy implementation
Physician-CFO collaboration
Why we need to talk about the money
Approaching patient care from both clinical and administrative angles
Can using design principles create parsimony in healthcare?
Keeping the end users’ needs in mind as we design health IT
nuance-research-conference-2014
Why “innovation” doesn’t always have to be new (or at least on first sight)
Decades old concepts give light to revolutionary innovations
Becoming more user-centric in health IT
Guidelines to help keep people, processes, and technology aligned
Access to assistive technology
It took me almost 50 years to understand accessibility
Reflections on Global Accessibility Awareness Day
Show more articles

Join our team

Don’t just read about the next stage of technology — be a part of driving it.

Find opportunities

Feeds & threads

 

Loading…