Currently the only agents that can't be deleted are those who are the artist for an artwork entry, or if they have an essay attached. Ideally, any agent with references should not be able to be deleted even after accepting the warning pop-up.
As deleting, editing, or merging agents is more common than it is with other records in CAT, this level of security would prevent future accidental deletions.