Albion confirmed only their first win since September at home and only their third home win of the season thanks to a 2-0 win over 10- man Elgin City.
The first half was poor and the only chance of the opening spell came from the home side when striker John Bradford saw his shot cleared off the line by former Rovers player James McKenzie.
Elgin started to look more threatening after their early scare and went close when an Adam Nelson shot was well saved by Chris Fahey after 27 minutes.
Fahey again was called into action two minutes later when he was forced to scramble across the line to make an excellent save from a Craig Higgins volley.
However Elgin's best chance of the half came from an Andy Roddie free-kick that fell at the feet of William Martin at the back post, but his shot trundled just wide.
Following a few choice words at half-time Albion came out fired up and almost took the lead when Wayne Gordon latched on to a Jered Stirling through ball, but his lob was parried by Kieron Renton.
The home side did eventually take the lead after 62 minutes when Andy Roddie was given his marching orders after he punched the ball off the line, and Bradford snaked home the resulting penalty in off the post.
Albion could have doubled their lead after 72 minutes when a Bradford cross was flicked just past the post by Gordon.
At this point Elgin were going all out for an equaliser and went close through subsitute Matthew Huckins before a volley in the last minute by the big striker was superbly saved by Fahey.
However Albion were exploiting their numerical advantage, and with Marc McKenzie in acres of space he drove a 25-yard shot into the top corner, deep in injury time, to seal victory for the Rovers.