I don't know if this is the answer, but in both cases, the hardware is definitely NOT the same.

Your Windows install may have some driver that is slowing it down that the Ubuntu doesn't have because it's running on virtualized hardware.