We obtain Bethe vectors for the periodic inhomogeneous $SO(3)$ Heisenberg spin in the form of the action of the creation operators on the highest weight vector. These creation operators take an unusually complicated form, which can be given by a recurrence relation. We find the explicit form of the off-shell action of the transfer matrix on the Bethe vectors, giving the unwanted terms in the closed form.