If you can’t remove a removable game object or destroy a building because it’s on the side of the screen, and you can’t press on it — please, grab any of your villagers and drag it to the object that you want to remove. That villager will remove an object for you.