It beat old classics like Star Wars which took the number two spot, whilst The Empire Strikes Back was voted fourth greatest.
But the music to Harry Potter and the Philosopher's Stone didn't work its magic, only making it to number 14 on the list.
The US composer who wrote it - John Williams - was the most popular writer on the list though.
Howard Shore who wrote the music to the LOTR fantasy, was very pleased with the result.