Willie Gibson's 73rd minute goal denied Gretna their first-ever Scottish Premier League away victory as injury-hit Kilmarnock forced a draw.
Gavin Skelton fired bottom side Gretna ahead after five minutes against opponents two places ahead of them.
Danny Invincibile equalised from close range, but Danny Grainger restored the lead from the spot after the break.
David Fernandez fired Killie level immediately, Evan Horwood curled in Gretna's third then Gibson replied.
Kilmarnock had just three fit defenders available as they looked to halt a five-game losing streak.
The injury-ravaged hosts suffered a pre-match blow when defender Tim Clancy was sent home suffering from 'flu.
MY SPORT: DEBATE
And manager Jim Jefferies was forced to field midfielder James Fowler in central defence alongside 20-year-old Ryan O'Leary.
Kenny Deuchar returned from his successful loan spell with St Johnstone to start up front for Gretna.
But it was Skelton who gave Gretna a surprise lead when his low shot beat goalkeeper Alan Combe.
Killie came close to equalising when both Gary Wales and Fernandez were inches away from Jamie Hamill's drive across the front of Gretna's goal.
Colin Nish also missed an opportunity in front of goal from a pass delivered by Wales.
Fleming did well to block a Fernandez shot at the post, but Gretna came close to doubling their lead after 20 minutes, when Deuchar's lob came back off the face of the crossbar.
Kilmarnock had another escape minutes later, when Grainger's 30-yard free-kick clattered the upright.
But Killie at long last gave their fans something to cheer by equalising in the 27th minute.
Gary Locke's cross found Invincibile, who swept the ball over the line from a couple of yards.
Gretna responded with a run and cross on the right from David Cowan, with O'Leary almost heading an own goal.
Kilmarnock hit back and almost snatched a late first-half goal when Wales connected poorly with a Hamill cross and failed to find the net from four yards.
Henry Makinwa sent a free-kick just wide but won the penalty from which Gretna went ahead five minutes after the break.
The referee pointed to the spot when the forward clashed heads with O'Leary and Grainger fired home from the penalty spot.
But the lead lasted just two minutes, Fernandez firing home from 12 yards.
Gretna restored their lead almost as quickly, Deuchar being allowed too much time to deliver a cross into the box and Horwood curled the ball home.
Nish squandered a chance when he was through on goal, but Fleming did well to block.
The Killie striker looked fortunate to escape calls for a penalty when he appeared to tug Chris Innes' shirt in the Killie penalty box.
And Fleming saved well from an Invincibile drive as the play flowed from end to end.
But Killie equalised when Gibson's cross was missed by Nish but found its way into the net.
Kilmarnock: Combe, Taouil, Fowler, O'Leary, Hay, Invincibile, Locke (Gibson 65), Hamill, Wales, Fernandez (Jarvis 78), Nish.
Subs Not Used: Harpur, Koudou, Bryson, Flannigan, Noble.
Booked: Wales, Combe, O'Leary, Taouil, Hay.
Goals: Invincibile 27, Fernandez 53, Gibson 73.
Gretna: Fleming, Cowan, Innes, Horwood (Deverdics 90), Grainger, Murray, Collin, Jenkins (McGuffie 75), Skelton, Makinwa (McLaren 81), Deuchar.
Subs Not Used: Caig, McGill, Barr, Buscher.
Booked: Horwood, Cowan, Skelton.
Goals: Skelton 5, Grainger 51 pen, Horwood 57.
Att: 5,122
Ref: C Boyle