Not necessarily. An alignment takes care of that and generally a 2" leveling kit wont throw it off so much to where it cant be properly aligned. When you lift the front of the truck it forces the end of the upper control arm (where the ball joint is) down, because the spindle is still the same size. When it does that, it forces the ball joint to slide further to the edge, limiting it's range of motion. The new control arms have corrected ball joint angles, so that the ball joints natural position is still in the middle of it's available range.
The 4th gens were notorious for having the upper ball joint ripped out of the socket as a result. Some people never had issues, a lot of them did. To me it is worth it for the peace of mind to replace the control arms