Email Notification Fails if Workflow Email Alert is Disabled

I created a workflow and set up custom notifications for each workflow state. However, if i enable email alert, the default workflow alerts gets sent and if i disable email alert, no mails get sent. How to i set the mail alert to be the custom email alert i created?