You cannot delete an encryption key if it there are any orders with credit card information that were encrypted with that key. It's easy to find out if any orders are encrypted with the current key:
> Store Settings > Encryption Keys tab.
> Order Processing > Orders tab.
> Store Settings > Encryption Keys tab. You'll see that the Reference Count for the
encryption key is now 0.