Pappy - there is indeed less load on the uppers normally so you are probably fine as you note.
Preston - I will need to see what the upper looks like with the BJ out - I want to use a serviceable item and that is the point actually of why I want to get the stockers out of there and use a Howe piece with the upper As. It went in so it should be able to come out

just need to make sure I get adequate support so I don't bend the upper "arm" of the spindle.