The keys symbolize the keys Christ gave to the Church. One key opens the door to heaven for those who repent and believe in Jesus. The other key locks the door to heaven to those who are unrepentant. "I will give you the keys of the kingdom of heaven, and whatever you bind on earth shall be bound in heaven, and whatever you loose on earth shall be loosed in heaven" (Matthew 16:19).