Friday, 02 October 2020 09:40

UNSW leads research into speech recognition systems

By

Engineers from the University of NSW are leading a research project aimed at closing a gap in speech recognition systems that they say have until now performed badly in understanding young users of technology.

The project will see UNSW Sydney researchers sample the voices of Australian kids so that they can be better understood by devices that use voice recognition software.

And the researchers say the benefits could also flow into education and speech therapy where digital devices could provide “immediate and ongoing feedback in speech training and other learning tasks”.

UNSW says that up until now, speech recognition software that powers virtual assistants like Google Assistant, Alexa and Siri has relied on a growing database of adult voices.

But UNSW says all that is about to change with the launch of AusKidTalk, a joint project of five Australian universities that aims to build a database of Australian children’s voices.

Dr Beena Ahmed, a senior lecturer with UNSW’s School of Electrical Engineering and Telecommunications, says while speech recognition technology has made leaps and bounds in the last decade, the technology is still lagging when it comes to understanding and speaking with children.

“There’s been a big improvement in speech recognition to work with different accents and languages,” she says.

“But so far that has just been for adults. There is a definite shortage of data for children – not just in Australia, but all over the world. This is despite children being such an important demographic. Companies like Amazon, Apple and Google are all starting to notice that this is a big market.”

Dr Ahmed and her fellow engineers, linguists, psychologists and speech pathologists are about to start recruiting 750 children between the ages of three and 12 to provide speech samples as part of the AusKidTalk program.

In sound-proof studios located at each of the five campuses, the children will be recorded as they are prompted to repeat words, digits and sentences before engaging in unscripted storytelling exercises.

UNSW says the new database of children’s speech will be used by linguists and psychologists to better understand how children develop their speech and language - and engineers, meanwhile, will be able to use it to develop new speech recognition systems that will interact with younger users much more seamlessly.

Dr Ahmed says the accuracy of speech recognition systems when interacting with children has so far been quite poor.

“The main reason for this is because children’s speech is quite different from adults’ speech.

“Children’s language skills aren’t as sophisticated as adults’. They might mispronounce or leave sounds or words out, or change the expected order of words. Then there are physiological differences – their vocal tract isn’t fully developed, and until they hit puberty, they speak in much higher pitches. All this makes their speech very different from adults and therefore harder for speech recognition systems to process.”

In addition to recording samples of typical speech, the researchers will also be recording samples of disordered speech spoken by children.

Dr Ahmed says the idea behind this is if speech recognition systems could be taught to recognise when children are having problems forming words, they could not only be used to understand voice commands spoken by kids with impaired speech, but could also be used therapeutically to help with speech training using a mobile device.

“Speech therapy is a very costly business,” Dr Ahmed says.

“You’ve got parents spending up to $200 for a session with a clinician, and still having to do a lot of home practice that the clinician can’t monitor.

“Another problem is that parents can also find it hard to provide feedback themselves, because they’re not properly trained or because they’re already tuned to understand their kids in cases where others might not.

“But with an automated speech therapy tool, kids and parents could get instant feedback when they practice what they’ve learned with the clinician.

“It would give children immediate and ongoing access. You can’t expect this level of attention from limited appointments with limited numbers of available pathologists.”

Dr Ahmed says speech recognition systems using a database of children’s voices could also have benefits in education.

“A lot of schools rely on getting parent volunteers to listen to children doing their reading in early education. But in schools that may have trouble getting enough parent volunteers, a child could read to a tablet or computer which could listen and correct them as they went.”

The UNSW researchers say the COVID-19 pandemic has shown just how important remote communication and learning tools are.

“Unfortunately, children have not been able to benefit from these tools as much as adults due to a lack of effective speech-based tools for remote speech therapy and learning – so they likely have not been able to get the same benefit from telehealth and tele-education tools,” Dr Ahmed says.

After the samples of 750 children have been recorded and integrated into a speech recognition system, UNSW says an open source database will be available online for other researchers to work with.

The project is expected to be complete by June 2021.


Subscribe to ITWIRE UPDATE Newsletter here

GRAND OPENING OF THE ITWIRE SHOP

The much awaited iTWire Shop is now open to our readers.

Visit the iTWire Shop, a leading destination for stylish accessories, gear & gadgets, lifestyle products and everyday portable office essentials, drones, zoom lenses for smartphones, software and online training.

PLUS Big Brands include: Apple, Lenovo, LG, Samsung, Sennheiser and many more.

Products available for any country.

We hope you enjoy and find value in the much anticipated iTWire Shop.

ENTER THE SHOP NOW!

INTRODUCING ITWIRE TV

iTWire TV offers a unique value to the Tech Sector by providing a range of video interviews, news, views and reviews, and also provides the opportunity for vendors to promote your company and your marketing messages.

We work with you to develop the message and conduct the interview or product review in a safe and collaborative way. Unlike other Tech YouTube channels, we create a story around your message and post that on the homepage of ITWire, linking to your message.

In addition, your interview post message can be displayed in up to 7 different post displays on our the iTWire.com site to drive traffic and readers to your video content and downloads. This can be a significant Lead Generation opportunity for your business.

We also provide 3 videos in one recording/sitting if you require so that you have a series of videos to promote to your customers. Your sales team can add your emails to sales collateral and to the footer of their sales and marketing emails.

See the latest in Tech News, Views, Interviews, Reviews, Product Promos and Events. Plus funny videos from our readers and customers.

SEE WHAT'S ON ITWIRE TV NOW!

BACK TO HOME PAGE
Share News tips for the iTWire Journalists? Your tip will be anonymous

WEBINARS ONLINE & ON-DEMAND

GUEST ARTICLES

VENDOR NEWS

Guest Opinion

Guest Reviews

Guest Research

Guest Research & Case Studies

Channel News

Comments