A podcast, to me, is a series of audio episodes available over the web. At a technical level, it’s an RSS feed, and the RSS feed has entries for each episode, and each episode has links to the actual audio file (in MP3 or AAC format, but usually MP3) and other metadata.
What isn’t a podcast? A show behind a paywall.