WARNING: This page is about a different car, the 2005 Saturn L300. However, it is still accessible from the selected car via links, so may be relevant.
Fig 1: Removing & Installing Power Mirror Switch
Courtesy of GENERAL MOTORS CORP.
Using a small blade tool, gently pry on the switch to disengage the clips.
Disconnect the electrical connection and remove the switch.