Now the scientists are planning on chatting with games experts to make the new games entertaining and fun.
The Medical Research Council plan to spend £12m on The Auditory Brain Study to try and make things better.
The 'brain hearing' problem is called auditory processing disorder (APD) which means working out what it is you're listening to.
The study will also look at the brain, ways to improve lip reading and helping people with implants in their ears.