virtualbox.org

Once I've installed an extension pack do I need to keep the older ones on my hard drive? I'd like to free up the space if possible.

No. If you need to downgraded for any reason there is an archive http://download.virtualbox.org/virtualbox/