I'm not even saying The Tower gets hit while they are still there. They could abandon the Tower and move to another home but someone (most likely the Mallers) would ransack the Tower looking for supplies left behind. Thus looking like the place was attacked.