Click on the "Reminders" button for the payee you want to stop getting reminders for.  At the bottom of the new box that appears, choose "Stop Reminders".  You can also change reminders on this page.