With a few essential tools you can pick up at your local hardware store, plus some pantry staples you already have, you can remove old caulk with ease.