What's public-key encryption? relies on two keys. "Public Key" to encrypt, which you don't keep secret. "Private Key" to decrypt also, you have a "pass-phrase" which can be used to keep the private key secret. This may seem like overkill, but it all makes sense from a security standpoint. Using a pass-phrase, if the Private Key gets loose, you can change it before somebody can crack into it.