A team at UTS has brought direct brain-computer communication an impressive step closer.
Today some pure science fiction to wrap up this scribeâs Back Page contributions for the year.
Donât expect too much in-depth analysis from us though. Itâs hot, things are winding down ahead of the holidays and a very good boy is in the TMR office distracting us â meet Fred Sheppeard:
On top of that, itâs neuroscience.
What we can tell you is that itâs a non-invasive, portable thought decoder â a program that reads words out of your head without having to install anything made by Elon Musk into your brain, or lie in an MRI, with better results than any previous contender. And itâs being developed just down the road from our office.
Three researchers from the University of Technology Sydney â Distinguished Professor CT Lin, director of the GrapheneX-UTS Human-centric Artificial Intelligence Centre, and PhD candidates Yiqun Duan and Jinzhou Zhou from the Engineering and IT faculty â had their work chosen as the spotlight paper for the prestigious NeurIPS conference held in New Orleans this week.
They team built an AI called DeWave that segments EEG patterns into word-level units and decodes them into text tokens, both with and without eye-tracking â the latter is the real breakthrough, or âunprecedented endeavourâ in the teamâs words, and makes the tech much more practical to use.
In this study (of which the BP understands maybe one sentence in 10) 29 subjects wearing an EEG cap silently read passages of text, with sentences ranging from short and simple to long and full of abstract concepts.
Here are two examples, where âbold denotes a correct match between ground truth and our prediction. Underline denotes a fuzzy match with similar semantic meaningsâ.
With eye tracking:
Ground Truth: âThe Kid Stays in the Pictureâ is a great story, terrifically told by the man who wrote it but this Cliff Notes edition is a cheat.
Prediction: The film “says in the Gameâ is a film about but movie was written, the author who wrote it. also its version is a cheat.
Without eye tracking:
Ground Truth: much of this well-acted but dangerously slow thriller feels like a preamble to a bigger, more complicated story,
Model Output: much of this is-being but not over-. like it disaster-ble to a new and more exciting thing,
Itâs a long way from infallible, but it represents a significant improvement on established metrics like the BLEU score. Its BLEU accuracy rating is about 40%, compared with traditional language translation and speech recognition programs, which approach 90%.
You can watch a demonstration, complete with mistakes and lost-in-translation moments, here:
Even at 40% accuracy, this kind of tech offers an extraordinary hope to people who have lost the ability to communicate physically.
Itâs enough to leave you lost for words.
And on that note, since TMR will be largely silent from next week for three weeks, this BP scribbler signs out for 2023 wishing you a happy holiday season â see you in the new year.
Send festive story tips to penny@medicalrepublic.com.au.
