Lots of stars and people working on the concert were evacuated from the building.
A number of Lots fire engines rushed into the Palace to try and get the blaze under control.
Royal Family weren't there
The concert is to celebrate the Queen's Golden Jubilee, marking 50 years of being on the thrown.
None of the Royal Family were at the Palace when the fire broke out and there are no reports of anyone being hurt.