Robbie Winters saw a dipping volley brilliantly tipped on to the post by Albion Rovers keeper Derek Gaston.
Ciaran Donnelly hit the woodwork for the visitors, while late on Kyle Jacobs centred for brother Keaghan to slot the ball home at the second attempt.
Livingston: McKenzie, Brown, Talbot, Sinclair, Griffin, MacDonald, Fox, Keaghan Jacobs, Halliday (Kyle Jacobs 72), Robert Winters (McNulty 88), David Winters. Subs Not Used: Moyes, Husband, McDowall.
Booked: Brown. Goals: Talbot 5, Keaghan Jacobs 85.
Albion Rovers: Gaston, Reid, McGowan, Donnelly, Benton, O'Boyle, Ferry (Stewart 78), Tyrrell, Gormley (McCusker 60), Pollock (Walker 69), Strachaen. Subs Not Used: Dignam, Ewings.
Att: 726
Ref: F McDermott
Source: BBC Sport
Source: BBC Sport