The building is still in the same spot, just not a part of the country anymore.

All the people in it are no longer citizens, and your ex-country’s government seems to not want that specific building in their borders again for some reason.