In order to delete a rule, simply click the X button corresponding to the rule. After you confirmed the action, click Apply to save the changes.