Go to the Tower of Guilds and tap a purple button in the bottom left corner of the screen.
And if you are a guildmaster, you need either to delete all members and then the guild itself, or pass your leadership to another player first and then lead the guild.