Bush Bucks moved off the foot of the Castle Premiership table after they beat Bloemfontein Celtic at the Seisa Ramabodu Stadium on Sunday.
The victory was the second successive win for new Imbabala coach, Bruce Grobbelaar.
Jonathan Armogam scored the winning goal in the 29th minute after he received a pass from Edmore Mashiri and beat Celtic keeper Simon Gopane with a powerful shot.
Bucks pushed hard for a second goal, but they were denied by a number of excellent saves by the Phunye Sele Sele keeper.
Celtic certainly had their chances to score, but wasteful finishing cost them dearly in the end.
They have now lost their last three matches, and drop down to 15th spot on the log, while the East London side are now in 11th position.