The original unit originated from the old "Rupertswood Battery", in 1889 it was designated the Victorian Horse Artillery. The battery was wholly maintained by Mr. Churnside and the Hon. Sir William Clarke, Bt., until it was disbanded. Uniforms were based on those of the Royal Horse Artillery.