Costello and Krall have twin boys

The babies were born on the couple's third wedding anniversary

Musician Elvis Costello and his jazz singer wife Diana Krall have become the parents of twin boys.

The boys have been named Dexter Henry Lorcan and Frank Harlan James and were born on Wednesday, the couple's third wedding anniversary.

"We are ecstatic," said the couple in a statement from their home in New York, adding that "mother and sons are doing splendidly".

The boys are Krall's first children. Costello already has a child.

Costello and Krall married in December 2003 in a ceremony at Elton John's British mansion. Costello had been married twice before.

Costello received a Grammy nomination this week for best pop album for The River in Reverse, which he wrote with Alain Toussaint.