OS Mobility Explored

Gateway NV52 (AMD) - Futuremark

Since we were already installing the various operating systems and running battery life tests, we thought it might be interesting to run some of the Futuremark benchmarks (while waiting for the battery to recharge...). Windows XP can't run the latest Vantage versions of PCMark and 3DMark, but we included 3DMark03/05/06 and PCMark05. Here are the results.

The results in the 3DMark tests are very close, with the largest gap coming in 3DMark03. XP leads Vista by 3% in that test, which is hardly noticeable, and the results in the other 3DMark suites are within 1%. PCMark shows a much larger difference, with PCMark05 putting Vista in the lead by 7% over XP and 8% over Windows 7. We'll take a closer look at those results below, as the composite score is very deceiving. PCMark Vantage goes the other way, with Windows 7 beating Windows Vista by almost 20%. Let's look at the individual test results in both PCMark benchmarks to get a better idea of what's going on, beginning with PCMark05.

When you look at the composite score, Windows Vista looks very attractive in PCMark05. The individual results tell a completely different story! (Note that we calculated results for the multitasking tests relative to the XP score, which is why it scores 1000 on all three tests.) The high composite score of Vista is a result of the 2D Transparency test, where it is nearly 13 times as fast as XP and almost 6 times as fast as Windows 7. Exactly how important is 2D transparency? It probably helps in Vista when you're using Aero Glass, but it shouldn't matter much at all in Windows XP.

Obviously 2D transparency is a weak point of XP - or at least the XP drivers - so we went through and calculated the relative performance in the PCMark05 tests with and without 2D Transparency. We used the XP result as the baseline metric. Including 2D Transparency, Vista's average performance is 200% of XP and Windows 7 is 108%. Remove that one result and XP ends up being 8.6% faster than Vista and 3.5% faster than Windows 7. The composite PCMark score is weighted, and we don't have exact details on their formula. It's clear that 2D Transparency does not have the same weight as the other tests, but it's still enough to skew the results.

The results for the individual test suites in PCMark Vantage are a lot closer than the 2D Transparency result from PCMark05, and Windows 7 leads in most of the tests. Gaming performance is essentially a tie, Vista leads by 3% in the HDD test suite, but everything else favors Windows 7 - sometimes by a large margin. We don't know exactly why Windows 7 scores so much higher in the TV and Movies, Music, and Communications test suites. It could be that driver differences play a part, or it may be that Windows 7 is simply better optimized for some of these tests. We do know that most users think Windows 7 performs better than Windows Vista, and the PCMark Vantage results clearly support that impression.