I've never liked the idea of 'hitting' a hardened steel, bearing component into place. They can (and will) crack, or chip if you get it wrong.
They should be an interference fit, so the size difference is only minimal (0.05mm?).
When we fit bearing components on site work, I warm up the press fit component to about 80oC and just place it into position. When it cools, it is tight.
The last couple of crown races I've put on, it did the same way but tapped them into their home pos. using a steel tube to press against the non bearing surface of the crown ring. (dont strike the crown ring directly with a hammer). I actually used the tube as an anvil and tapped the underside of the steerer tube with a soft face hammer. It worked ok and nothing got damaged.
.....should this be in the Workshop??