If your city is under attack, your Wall's Durability will be reduced over time.  Your city will be moved once your durability reaches zero to give your guards a break!  Make sure to repair your Wall once you have moved!