WARNING: This page is about a different car, the 2006 Nissan Xterra. However, it is still accessible from the selected car via links, so may be relevant.
Check the contact surfaces of the shift rod and bearing for wear and damage. If any is found, replace with a new one.