Gateway NV52 (AMD) - Futuremark
Since we were already installing the various operating systems and running battery life tests, we thought it might be interesting to run some of the Futuremark benchmarks (while waiting for the battery to recharge...). Windows XP can't run the latest Vantage versions of PCMark and 3DMark, but we included 3DMark03/05/06 and PCMark05. Here are the results.
The results in the 3DMark tests are very close, with the largest gap coming in 3DMark03. XP leads Vista by 3% in that test, which is hardly noticeable, and the results in the other 3DMark suites are within 1%. PCMark shows a much larger difference, with PCMark05 putting Vista in the lead by 7% over XP and 8% over Windows 7. We'll take a closer look at those results below, as the composite score is very deceiving. PCMark Vantage goes the other way, with Windows 7 beating Windows Vista by almost 20%. Let's look at the individual test results in both PCMark benchmarks to get a better idea of what's going on, beginning with PCMark05.
Gateway NV52 PCMark05 Breakdown | |||
XP SP3 | Vista SP2 | Win7 RTM | |
PCMark05 Score | 3590 | 3875 | 3623 |
HDD XP Startup (MB/s) | 6.664 | 5.948 | 6.168 |
Physics and 3D (FPS) | 111.1 | 97.4 | 103.7 |
2D Transparency (Windows/s) | 214 | 2730 | 478 |
3D Pixel Shaders (FPS) | 55.02 | 54.81 | 52.86 |
Web Page Rendering (Pages/s) | 2.450 | 1.644 | 1.962 |
File Decryption (MB/s) | 35.91 | 34.02 | 36.05 |
2D 64 Line Redraw (FPS) | 331.8 | 362.7 | 392.1 |
HDD General Usage (MB/s) | 4.233 | 4.038 | 3.941 |
Multitasking 1 | 1000 | 930 | 948 |
Audio Compression (KB/s) | 1936 | 1313 | 1163 |
Video Encoding (KB/s) | 310.4 | 366.8 | 402.2 |
Multitasking 2 | 1000 | 889 | 934 |
Text Editing (Pages/s) | 113.0 | 88.4 | 100.7 |
Image Decompression (MPixels/s) | 23.64 | 23.54 | 23.09 |
Multitasking 3 | 1000 | 956 | 1047 |
File Compression (MB/s) | 4.224 | 3.86 | 3.283 |
File Encryption (MB/s) | 21.04 | 20.72 | 29.27 |
HDD Virus Scan (MB/s) | 68.37 | 59.38 | 52.88 |
Memory Latency (MAccesses/s) | 6.73 | 7.103 | 8.382 |
When you look at the composite score, Windows Vista looks very attractive in PCMark05. The individual results tell a completely different story! (Note that we calculated results for the multitasking tests relative to the XP score, which is why it scores 1000 on all three tests.) The high composite score of Vista is a result of the 2D Transparency test, where it is nearly 13 times as fast as XP and almost 6 times as fast as Windows 7. Exactly how important is 2D transparency? It probably helps in Vista when you're using Aero Glass, but it shouldn't matter much at all in Windows XP.
Obviously 2D transparency is a weak point of XP - or at least the XP drivers - so we went through and calculated the relative performance in the PCMark05 tests with and without 2D Transparency. We used the XP result as the baseline metric. Including 2D Transparency, Vista's average performance is 200% of XP and Windows 7 is 108%. Remove that one result and XP ends up being 8.6% faster than Vista and 3.5% faster than Windows 7. The composite PCMark score is weighted, and we don't have exact details on their formula. It's clear that 2D Transparency does not have the same weight as the other tests, but it's still enough to skew the results.
Gateway NV52 PCMark Vantage Breakdown | ||
Vista SP2 | Win7 RTM | |
PCMark Vantage | 2566 | 3055 |
Memory | 1467 | 1529 |
TV and Movies | 1541 | 1835 |
Gaming | 2121 | 2126 |
Music | 2170 | 3347 |
Communications | 2971 | 3652 |
Productivity | 2499 | 2558 |
HDD Test | 2445 | 2372 |
The results for the individual test suites in PCMark Vantage are a lot closer than the 2D Transparency result from PCMark05, and Windows 7 leads in most of the tests. Gaming performance is essentially a tie, Vista leads by 3% in the HDD test suite, but everything else favors Windows 7 - sometimes by a large margin. We don't know exactly why Windows 7 scores so much higher in the TV and Movies, Music, and Communications test suites. It could be that driver differences play a part, or it may be that Windows 7 is simply better optimized for some of these tests. We do know that most users think Windows 7 performs better than Windows Vista, and the PCMark Vantage results clearly support that impression.
106 Comments
View All Comments
Veerappan - Tuesday, September 22, 2009 - link
I'm not sure if it's possible at this point, but if you can, would it be possible to try out a copy of the 9.10 Alphas that are available? They should hopefully fix some of the intel driver regressions.Also, as an FYI/diagnostic, there's a CPU speed applet that is available in Gnome. Right click the top panel, select 'add to panel', and then somewhere there's a cpu speed monitor. That can be used to see if SpeedStep/Cool'n'Quiet are working correctly. You can even take it a step further, and change the permissions of the applet to allow you to change which CPU speed governor is active if you find that the CPU is running at full speed constantly.
lyeoh - Tuesday, September 22, 2009 - link
By the way, you should not use external sites during your test. The fact that you said "perhaps a Flash ad server was temporarily down" means you are doing it wrong.Different flash ads could be very different in CPU usage.
What you should do is snapshot/save the complete pages loaded from the websites you want, put them on a standardized webserver under your control, and then get the browsers to load the pages from that webserver. Disconnect the test network from the internet to prove that the page loads up fine without requiring external connections (css etc). You may need to include a test DNS server that fakes the replies, or stick to using IP addresses to access the test pages e.g. http://10.5.5.1/site1/testpage1.html">http://10.5.5.1/site1/testpage1.html http://10.5.5.1/site2/testpage1.html">http://10.5.5.1/site2/testpage1.html http://10.5.5.1/site3/testpage1.html">http://10.5.5.1/site3/testpage1.html
Once you have standardized on a set of pages, this means you don't have to redo the tests on all computers weeks/months later when you have another laptop to test. You only need to test the new device - since the pages are the same. Don't change the webserver too much either (but given the low loads it's unlikely to affect things much - unless it's really really slow).
JarredWalton - Tuesday, September 22, 2009 - link
Already in progress, after my round two Internet testing still proved too variable. As noted elsewhere, though, I want the content to be as close to realistic as possible. Law of averages says that most of the ads will balance out. It's also possible my home wireless phone knocked out my home WiFi a few times, which would mean several minutes (more?) of non-traffic. Many times I'm not around while letting the battery drain, since that's a bit of a waste of time.I need a new home phone for sure, though. The 2.4GHz model I bought several years back wreaks havoc on my 802.11n network.
strikeback03 - Wednesday, September 23, 2009 - link
You need a home phone at all?JarredWalton - Wednesday, September 23, 2009 - link
Babysitters might need something to call us, yeah. Could leave a cell with them I suppose, but I also use it for business/fax.7Enigma - Wednesday, September 23, 2009 - link
I highly recommend the Uniden DECT6.0 models. The kit I got about 6 months ago to replace crappy old units was ~$110 for 3 units. Additional units (if your manion requires :) can be added easily to the setup for another $30-40. No wireless issues whatsoever. And it's the first phone I've been able to use out to my curb without issues (brick exterior with plaster walls = bad signal). The only gripe I have is there doesn't appear to be a way to change the caller ID name when it comes in. You can program your own numbers in, but when you receive a call it always shows only how caller ID recognizes it.Got mine from the egg.
mschira - Monday, September 21, 2009 - link
on my Atom based laptop. Flash is mostly used for annoying advertising. And it eats CPU, makes the budy slow.Booo to flash...
M.
dnd728 - Tuesday, September 22, 2009 - link
If Adobe merely added a button to freeze all Flash animations or even just freeze all Flash in non-active tabs, then like a hundred power plants could have been scraped…JarredWalton - Tuesday, September 22, 2009 - link
Which is what FlashBlock does. :) Of course, Linux browsers by default don't normally auto-play Flash I don't think. I enabled that with Firefox and then used FlashBlock to stop it, just for an "apples-to-unoptimized-apples" comparison to Vista.bigboxes - Monday, September 21, 2009 - link
Whatever. I use adblock plus and see few ads. Flash, however, is a part of how we view the internet. It's a part of our experience. If you want a text only internet please feel free to step back in the wayback machine to 1988.