I can not find any icon or remove button to remove one Blog post, what I can is un-publish it only!
You must first give delete permission via Setup > Users and Permissions > Role Permission Manager
Yeah thank you rmehta,
after follow your path, I also add myself into User Permissions Manager with DocType: Blog Category - General
Then it work!