Let's take it apart!

The top and bottom of the shuffle have white plastic caps held on by mild adhesive. Heat the caps with a hair dryer and gently pry them both up. Make sure you don't pry the metal beneath the caps up at the same time.