“Over” was short for “over to you” indicating that its your turn to talk on a short wave radio or walkie-talkie (or any half duplex comm tech for you nerds out there). Smart speakers are super cool and a step forward in voice – but they’re still half duplex, klunky, unnatural voice interfaces. We’ll all look back one day and remember how quaint today’s smart speakers were - like we remember morse code, tape players, and VCRs. Try turn taking a face-to-face conversation or conference call sometime and you’ll get a feel for what smart speakers, and all voice interfaces for that matter, are missing out on. There’s a whole field of study around the protocols and rules of human conversation called “Pragmatics” that study how humans interact one to one, one to many and many-to-many.
For example – I’ll say, “Alexa, play ‘Fool in the Rain’ by Led Zeppelin on Spotify,” and wait the requisite 3 seconds of silence so Alexa knows I’m done talking (might be easier to just say “over”). Then Alexa says, “I’m sorry, I can’t find ‘Fool in the Rain’ by Led Zeppelin on Spotify.” I’ll remember I cancelled Spotify and try to correct myself by speaking over Alexa “No, play it on Amazon Music.” It’s natural to do this – a person wouldn’t miss a beat having the same conversation.
In addition to the half duplex limitation – Alexa also can’t understand multiple speakers. Even the best user interfaces today employ turn taking to manage the conversations and don’t work at all with more than 2 speakers in a conversation. For example, if my children interrupt Alexa while she’s playing ‘Fool in the Rain’ and ask her to play “Space Unicorn“, a song that can make you insane after hearing it for the 400th time, I typically respond by shouting “Laa Laa Laa Laa!!” to confuse Alexa and keep her playing good music.
Managing the turn taking in a conversation with multiple speakers is no simple task. It requires that you listen while you talk and also respond to visual queues (in a face-to-face conversation). For example, Japanese speakers often produce backchannel expressions such as un or sō while their partner is speaking. They also tend to mark the end of their own utterances with sentence-final particles, and produced vertical head movements near the end of their partner’s utterances. See Turn-taking - Wikipedia for a long description of the complexity. The listen and talk problem gets exponentially worse when you add more speakers. A bot will need to know whether its having a friendly conversation and should wait until the person is done talking or if the bot is arguing and should cut into the rant. For more detail on that complexity read this article.
Recognizing these short-comings is the first step in over-coming them. Nuance R&D is working on these problems and others to transform the way people interface with technology.
Stay tuned for parts 3 and 4 as we catalog the technical problems when telling your customer to “talk to the IVR like you would a human”.
Publish Date: January 3, 2018 5:00 AM
Eastwind sells Oracle, Ribbon, and Dialogic SBC and routing solutions for both premise-based and cloud-based deployments along with Microsoft Teams integration. Eastwind offers managed service offerings and complete 7x24 support.
|2.)||Lieber & Associates|
Call Routing and Contact Center Optimization
L&A provides consulting services to optimize contact centers, including call routing, skills-based routing, and multi-location routing. The firm's senior consultants have several decades of experience each in this area and work with all vendors' systems. L&A's president pioneered skills-based routing.
The SPEED solution solves for service level issues while cost optimizing the environment with automation.
Provides an enhanced way to speed up & optimize invoking temporary agent skills configuration changes into the contact center environment.
Speed allows you to schedule both future changes & temporary changes that auto-revert back to the original state when scheduled time expires.
*Automated / Scheduled Temporary Agent Skills Configuration Management
*Immediate Temporary or Reoccurring Schedule Skills Configuration Changes
*Easy to Use/Operations Administration Focused
*Descriptive Monitoring Activity Dashboard
*Detailed “End to End’ Audit Trail and Performance Monitoring
|Customer Success: 6 steps to make your customer touchpoints count||September 12, 2019 5:00 AM|
|How Apple Business Chat can help enterprises with their call deflection goals||September 10, 2019 5:00 AM|
|Hear the Call for Help! How Siren Detection Can Make Your Car a Force for Good.||September 9, 2019 5:00 AM|
|Nuance IQ is back for the summer||August 26, 2019 5:00 AM|
|Meet your patients where they are with 24/7/365 answers to their portal questions||August 21, 2019 5:00 AM|
|Contact center transformation pitfalls (and how to avoid them)||August 8, 2019 5:00 AM|
|Robots here, there and everywhere, and now in the office||February 14, 2019 5:00 AM|
|3 ways speech recognition helps in police incident reporting||January 22, 2019 5:00 AM|
|Building trust with a virtual assistant voice||January 22, 2019 5:00 AM|
|Television viewing is no longer a one-way street||November 15, 2018 5:00 AM|