Call it the cost of staying too long