This next part is a bit tricky. Notice the slot for the spring arm and the slot for the UMD tray in the the corners.

Turn the PSP upside-down, so that the bottom is now facing up.

First slide the UMD tray into the slots on the UMD cover. Once these are in, align the spring into its slot.