There were two things I had to do to shave the last few seconds, the most beneficial was disabling all the unnecessary peripherals in the BIOS. When I looked at the Ubuntu boot log it said it spend 1.7 seconds uploading firmware to the bluetooth controller, which at that point was like 95% of the post-POST boot time, and not needing that I just turned it off in the BIOS.