Fans came out to protest against the scrapping of the Reivers
Border Reivers: (6) 9
Pens: Jones 3
Ulster: (13) 33
Tries: Ferris, Maxwell, Cunningham
Cons: Humphreys 3
Pens: Humphreys 4
Border Reivers fans came out in force to protest against the disbandment of the team, but the players could not halt Ulster's progress.
A fourth-minute try by Stephen Ferris put the reigning champions in front before penalty exchanges gave them a 13-6 advantage at half-time.
Steve Jones's second-half penalty reduced the gap to four points.
But 14 stoppage-time points, including tries from Andy Maxwell and Bryn Cunningham, ensured Ulster's victory.
It was a spirited display both on and off the pitch by Reivers.
One of the team's bravest displays of the season was watched by a crowd of more than 3,000 - almost three times the average gate - in response to Scottish Rugby's decision to scrap the side next season.
But second-top Ulster got off to a whirlwind start following a missed tackle by Scotland hooker Ross Ford deep inside the danger zone.
Flanker Steve Ferris then latched on to a pass from Ryan Caldwell to cruise over close to the uprights - giving David Humphreys a formality of a conversion.
Reivers started to dominate, and stand-off Jones stroked over a simple penalty.
But it took Humphreys only a matter of seconds to restore the visitors' advantage with an identical strike at the other end.
There was no way through for a try for the Reivers against Ulster
Jones hit the target again, but Scotland forward Kelly Brown was taken off for several minutes with a head injury and Humphreys replied once more.
The home fans were enraged by the failure of Welsh referee Tim Hayes to take any action during two flashpoint incidents.
Home skipper Chris Cusiter was felled by a dangerous-looking challenge by Caldwell on the touchline.
Then Reivers' Stuart Moffat was the apparent victim of an off-the-ball challenge by former Australia star Justin Harrison.
Jones blasted over a long-range penalty in the 56th minute to reduce the gap to just four points.
However, Humphreys followed suit twice in quick succession to finally snuff out the Reivers resistance.
Maxwell and Cunningham grabbed tries in the dying seconds to give the scoreline a flattering look, with Humphreys converting both.
Border Reivers: Moffatt, Flockhart, MacDougall, De Luca, Law, Jones, C. Cusiter, Kerr, Ford, Douglas, Hamilton, Palepoi, Dalziel, Miller, Brown.
Replacements: Rennie for MacDougall (78), McNeill for Kerr (72), Scott for Ford (68), Grimes for Hamilton (63), Vernon for Palepoi (70). Not Used: Chrystie, Townsend.
Ulster: Cunningham, Bowe, Trimble, Wallace, Maxwell, Humphreys, Boss, B. Young, R. Best, S. Best, Harrison, Caldwell, Ferris, N. Best, Wilson.
Replacements: Cave for Wallace (79), Campbell for Boss (79), Barker for Caldwell (69), Pollock for Wilson (79). Not Used: Shields, J. Fitzpatrick, McKenzie.
Ref: Stephen Hayes (Wales).