“Everything is on a higher level,” Tashev says, “with tougher requirements, with way, way stronger criteria for release and for how the audio, the acoustics, and the entire audio system should work. We had a lot of work to do, and we improved the system a lot.”
Tashev’s contributions are featured in the debut of the new Microsoft Research Luminaries video series on Channel 9, in which he describes what’s new with the Kinect’s audio performance.
But if you don’t have time for the video, here’s the key: new algorithms in the acoustical echo-cancellation block.
“There are improvements in the way we prepare and train the audio pipeline to meet the higher-quality criteria and higher speech-recognition criteria,” Tashev says. “That means software and hardware designed here at Microsoft Research and transferred to the Xbox audio team.”
That team, by the way, has been augmented, enabling even smoother collaboration.
“The Xbox team has added specialists in acoustical design and digital signal processing [DSP],” Tashev observes. “They now have three DSP engineers with Ph.D.s in signal processing. Just speaking the same signal-processing languages meant we were able to collaborate really effectively from the onset.”
In fact, Tashev is essentially an extension of the Xbox audio team, participating in Xbox 360 postmortem meetings and subsequent performance analyses, trying to determine which algorithms were underperforming and where the collaborators could find new optimizations.
“Our close collaboration with Ivan Tashev has been instrumental in building an Xbox team of audio experts and expanding the core audio-pipeline technology,” says Thomas Soemo, principal program manager lead for the Xbox platform, “which have both been essential to driving the new consumer scenarios in Xbox One.”
In a way, Tashev and his Xbox audio colleagues are victims of their own success.“When the audio and speech recognition worked so well with Xbox 360, people got excited,” Tashev says. “With Xbox One, speech is integrated heavily into the platform, making it even more crucial to get right. We are transitioning from a nice, cool feature to an integral, inseparable component of our gaming platform.
“That’s why the bar for reliability rose so much. We’re delivering a tremendously improved audio pipeline and speech recognizer.”
The goal: making voice control better than ever.
“The bottom line,” Tashev says, “was the ability to deliver hands-free sound capturing, with people speaking from a certain distance—one, two, three, four meters—and being able to clean up the signal from noise and reverberation, removing the sound from our own loudspeakers, and delivering it nice and clean to the speech recognizer. At the time of Xbox 360, this was science fiction. Today, it’s a critical part of our human-machine interface.”
Turning science fiction into non-fiction is what drives Tashev.
“During all of my time at Microsoft Research, I absolutely have been.... Read the rest of this post --->
0 comentarii:
Post a Comment