WARNING: This page is about a different car, the 2006 Nissan Pathfinder. However, it is still accessible from the selected car via links, so may be relevant.
Measure the clearance between the shift fork and sleeve. If it is out of specification, replace it with a new one.