Self-Adaptation to Device Distribution Changes