Go to the "Guild" section by tapping the shield icon at the bottom of the main screen, then select the gear icon. In the window that opens, take off the green checkmark next to "Accept invitations from other guild leaders".