Restrict permission for attached document

Is it possible to restrict access to delete attached file, so only user can attach file to ( not delete it ) :
Lead,Customer,Quotation,Contact,Address ,Item,Journal Voucher,Sales invoice , and -----

but they can’t delete file Attached , so we use for archive document ?

Not out of the box at the moment.