I do, but the wheels are all the way down on the ground and if I raise the jack it seems to move things further away.?
Place the jack at the base of the yoke and raise it from there. That will help rotate your axle up and back at the same time.
Yup. That's exactly what I did and everything is good now. My caster is back at about 4.5* and very minimal driveline vibrations. Thanks everyone.
It's almost unnoticeable now.