"A few months ago Sir John said to me that one of his regrets was that he'd never been married in a church. It will now become a reality."
The 92-year old British film veteran, who won an Oscar for Ryan's Daughter, and 89-year-old Mary wanted to have a church service as they missed out on the full ceremony in 1940.
The couple were married at a Marylebone register office rather than in a church when the actor was on leave from the army during the war.
On Tuesday more than 100 friends, family and well-wishers attended the ceremony at St Mary's Church, in Denham, Buckinghamshire.
Sir John, who is partially blind, and his wife, who suffers from Alzheimer's, were driven 30 yards from their home to the church gates in a Rolls-Royce.
In the service, the Reverend Adrian Hirst compared their marriage to a shining "diamond" and said Mary had been the "linchpin" in her husband's life.
He added: "The marriage of Mary and John has indeed been shining for 60 years and we come and give our thanks today."
The couple's daughter actress Hayley Mills was at the ceremony, but her sister and brother and the Mills' grandchildren could not come due to work commitments.
The Queen Mother sent a message to the pair.
Sir John told the BBC that this telegram was "very, very important and from the most wonderful lady".
He added: "I feel quite honoured and flattered."
'Warmest congratulations'
The Queen Mother wrote: "I offer you my warmest congratulations on your diamond wedding anniversary and I send you both my best wishes."
Sir John was an unknown young actor when he met his bride-to-be, a colonel's daughter.
They went on to become one of the British film industry's greatest celebrities and are one of the industry's closest marriages.
Sir John's manager John Novelli said: "I don't know a couple who are so devoted to each other. They are inseparable.
"A few months ago Sir John said to me that one of his regrets was that he'd never been married in a church. It will now become a reality."
Sir John told the BBC that he made his second proposal to Lady Mary at their home and the couple then exchanged rings.
The service was followed by a reception at the family home, and a honeymoon is planned for April in Gibraltar.
Comedian Jim Davidson sent a congratulatory message to the actor.
He asked jokingly: "Do you think it will last?"
Sir John told the BBC, with a broad smile: "The first 60 years are the worst, so we're hoping to push on from here."