WARNING: This page is about a different car, the 2013 Nissan Xterra. However, it is still accessible from the selected car via links, so may be relevant.
Check the contact surfaces of the shift rod and bearing for wear and damage. If any is found, replace with a new one.
Fig 1: Locating Wear And Damage On Contact Surfaces Of Shift Rod And Bearing