What Is a Solid-State Battery, and How Do They Work?

What makes a solid-state battery different from a “regular” battery, such as the alkaline batteries in a flashlight or the lead-acid batteries in our cars?