What’s the Difference Between APFS, Mac OS Extended (HFS+), and ExFAT?

So you’re using Disk Utility to partition your new hard drive when you’re presented with a choice of potential file systems. The list is longer than you’d think, with terms like “APFS (Case-sensitive)” and “Mac OS Extended (Journaled, Encrypted)” to choose from.