Jonathon Douglas put Leeds ahead just past the half-hour with a tidy volley only for Don Hutchison to equalise with a long-range volley on 58 minutes.
Robbie Blake fired into the roof of the net to make it 2-1, with Richard Creswell's drilled shot adding a third.
With eight minutes left Gary McSheffrey missed his spotkick after Michael Doyle had been brought down by Paul Butler.
"We believe the character of our squad is the best base we have to work from, and that proved it, coming so soon after their equaliser.
"It is the third time we have been pegged back and gone on to win at home and it was a tough game today.
"I'm pleased with the whole squad, they all played their part."
"It looked as though we dominated. We played terrific football and frustrated Leeds but it's all about scoring.
"We came here full of confidence and it showed. The players have seen enough to realise it was a good display and we have to take that into the Crewe game."
Leeds: Sullivan, Kelly, Butler, Kilgallon, Harding, Douglas, Derry, Lewis, Healy (Richardson 90), Cresswell, Blake (Hulse 81).
Subs Not Used: Bennett, Wright, Pugh.
Booked: Derry, Sullivan, Kilgallon.
Goals: Douglas 34, Blake 61, Cresswell 80.
Coventry: Fulop, Whing, Page, Shaw, Duffy, Morrell (Jorgensen 73), Doyle, Osbourne (Scowcroft 79), McSheffrey, Hutchison, Adebola (Impey 84).
Subs Not Used: Ince, Heath.
Booked: McSheffrey.
Goals: Hutchison 58.
Att: 24,291.
Ref: C Webster (Tyne & Wear).