Early CD-ROM Drives: Why Did They Require a Caddy?

Today if you even have an optical drive, it is likely a tray-loader or a slide-in mechanism. In the early days of computer CD-ROM drives users were often required to place their precious CDs into an awkward little container called a CD Caddy. Why did we use CD Caddies and why did they vanish?