Remove from On the Agenda

You can do this in one step if you hold the alt/option key when triggering the keyboard shortcut: