But the visitors levelled nine minutes later, John Ovenstone heading home Kevin Motion's cross.
And Motion secured victory for Stenhousemuir with a 20-yard drive in the 88th minute.
Albion: Ewings, Robert Walker, McGowan, McKeown, Benton, McGoldrick (Crozier 46), Barr, Donnelly, Pollock, Archbeacon (Andreoni 46), Ferry. Subs Not Used: Adam, Fleming, David Scott.
Booked: Ferry, McGowan, Benton, Donnelly.
Goals: Donnelly 27.
Stenhousemuir: Bennett, Reid, McGroarty, McLeod, Ovenstone, Thomson (Dalziel 73), Love, Molloy, Diack (Shirra 83), Brand, Motion. Subs Not Used: Morgan, Stirling, Renton.
Booked: Thomson, Molloy.
Goals: Ovenstone 36, Motion 88.
Att: 335
Ref: S O'Reilly
Source: BBC Sport
Source: BBC Sport