Ian Hendon's late penalty earned 10-man Barnet a battling draw.
New loan signing Glynn Hurst put Bury ahead after 15 minutes, but Tresor Kendol's cool finish brought Barnet level six minutes later.
Jason Puncheon was sent off for Barnet after 56 minutes following a clash with Paul Scott, before Hurst scored again with another close-range finish.
But after Bury keeper Kasper Schmeichel fouled Ismail Yakubu in the 81st minute, Hendon scored from the spot.
Bury: Schmeichel, Scott, Fitzgerald, Challinor, Kennedy, Taylor (Adams 57), Mattis, Baker, Pugh, Bishop, Hurst.
Subs Not Used: Woodthorpe, Youngs, Barry-Murphy, Buchanan.
Goals: Hurst 15, 74.
Barnet: Harrison, Hendon, King, Yakubu (Charles 82), Gross, Hessenthaler, Sinclair, Bailey, Puncheon, Kandol (Hatch 82), Vieira (Graham 69).
Subs Not Used: Flitney, Grazioli.
Sent Off: Puncheon (56).
Booked: Gross, Hessenthaler.
Goals: Kandol 21, Hendon 81 pen.
Ref: D Foster (Tyne & Wear).