Adaptation or extirpation: will small populations persist in the face of environmental change?