Albion Rovers equalised in the last minute when M Bonnar found space on the left and crossed low for Scott Chaplain to hammer home. Chaplain had also scored a late winner at Shielfield Park last season to break Berwick hearts.
Berwick's young side were given a great boost after six minutes when Robert Horn, who has missed the whole pre-season through injury, chested in a Steven Noble cross.
Rovers' keeper Jamie Ewings had to make two great saves from a Ryan McCallum header and a Robbie Manson drive.
Bryan Felvus caused the Berwick defence plenty of problems, and he twice went close before forcing Gary O'Connor to turn a fierce drive against the crossbar.
Berwick kept running strongly and played some good attacking football. Sean Paliczka almost wrapped it all up with a header which came off a post, while Ewings saved an Iain Thomson header.
Both teams gained considerable credit for the quality of the game. Both were packed with youngsters who will progress rapidly.
Rangers have four key players out through injury and suspension, but they clearly have something on which to build.
New striker Ryan McCallum and Steven Notman, on loan from Hibs, both did well, especially as they met their team-mates for the first time just before the kick-off.