Costa Rica coach Alexandre Guimaraes lived up to his promise and gave as many players as possible a run-out in the friendly.
But despite playing more than 30 minutes against 10 men, the home side were unable to bid farewell to their fans with a confidence-boosting win.
Guimaraes made seven substitutions in the second half in a performance he described as an "experiment".
Two goals down at the break, Costa Rica pulled one back early in the second but were unable to get on level terms.
Colombia's Rafael Castillo broke the deadlock from the penalty spot on 39 minutes and added a second from open play three minutes later.
Walter Centeno scored Costa Rica's only goal in the 53rd minute shortly after Colombia's Juan Carlos Ramirez had been dismissed.
Colombia, who failed to qualify for the World Cup, will now play Mexico on Sunday while Costa Rica leave for Japan on Saturday.