Gateway NV52 (AMD) - Futuremark
Since we were already installing the various operating systems and running battery life tests, we thought it might be interesting to run some of the Futuremark benchmarks (while waiting for the battery to recharge...). Windows XP can't run the latest Vantage versions of PCMark and 3DMark, but we included 3DMark03/05/06 and PCMark05. Here are the results.
The results in the 3DMark tests are very close, with the largest gap coming in 3DMark03. XP leads Vista by 3% in that test, which is hardly noticeable, and the results in the other 3DMark suites are within 1%. PCMark shows a much larger difference, with PCMark05 putting Vista in the lead by 7% over XP and 8% over Windows 7. We'll take a closer look at those results below, as the composite score is very deceiving. PCMark Vantage goes the other way, with Windows 7 beating Windows Vista by almost 20%. Let's look at the individual test results in both PCMark benchmarks to get a better idea of what's going on, beginning with PCMark05.
Gateway NV52 PCMark05 Breakdown | |||
XP SP3 | Vista SP2 | Win7 RTM | |
PCMark05 Score | 3590 | 3875 | 3623 |
HDD XP Startup (MB/s) | 6.664 | 5.948 | 6.168 |
Physics and 3D (FPS) | 111.1 | 97.4 | 103.7 |
2D Transparency (Windows/s) | 214 | 2730 | 478 |
3D Pixel Shaders (FPS) | 55.02 | 54.81 | 52.86 |
Web Page Rendering (Pages/s) | 2.450 | 1.644 | 1.962 |
File Decryption (MB/s) | 35.91 | 34.02 | 36.05 |
2D 64 Line Redraw (FPS) | 331.8 | 362.7 | 392.1 |
HDD General Usage (MB/s) | 4.233 | 4.038 | 3.941 |
Multitasking 1 | 1000 | 930 | 948 |
Audio Compression (KB/s) | 1936 | 1313 | 1163 |
Video Encoding (KB/s) | 310.4 | 366.8 | 402.2 |
Multitasking 2 | 1000 | 889 | 934 |
Text Editing (Pages/s) | 113.0 | 88.4 | 100.7 |
Image Decompression (MPixels/s) | 23.64 | 23.54 | 23.09 |
Multitasking 3 | 1000 | 956 | 1047 |
File Compression (MB/s) | 4.224 | 3.86 | 3.283 |
File Encryption (MB/s) | 21.04 | 20.72 | 29.27 |
HDD Virus Scan (MB/s) | 68.37 | 59.38 | 52.88 |
Memory Latency (MAccesses/s) | 6.73 | 7.103 | 8.382 |
When you look at the composite score, Windows Vista looks very attractive in PCMark05. The individual results tell a completely different story! (Note that we calculated results for the multitasking tests relative to the XP score, which is why it scores 1000 on all three tests.) The high composite score of Vista is a result of the 2D Transparency test, where it is nearly 13 times as fast as XP and almost 6 times as fast as Windows 7. Exactly how important is 2D transparency? It probably helps in Vista when you're using Aero Glass, but it shouldn't matter much at all in Windows XP.
Obviously 2D transparency is a weak point of XP - or at least the XP drivers - so we went through and calculated the relative performance in the PCMark05 tests with and without 2D Transparency. We used the XP result as the baseline metric. Including 2D Transparency, Vista's average performance is 200% of XP and Windows 7 is 108%. Remove that one result and XP ends up being 8.6% faster than Vista and 3.5% faster than Windows 7. The composite PCMark score is weighted, and we don't have exact details on their formula. It's clear that 2D Transparency does not have the same weight as the other tests, but it's still enough to skew the results.
Gateway NV52 PCMark Vantage Breakdown | ||
Vista SP2 | Win7 RTM | |
PCMark Vantage | 2566 | 3055 |
Memory | 1467 | 1529 |
TV and Movies | 1541 | 1835 |
Gaming | 2121 | 2126 |
Music | 2170 | 3347 |
Communications | 2971 | 3652 |
Productivity | 2499 | 2558 |
HDD Test | 2445 | 2372 |
The results for the individual test suites in PCMark Vantage are a lot closer than the 2D Transparency result from PCMark05, and Windows 7 leads in most of the tests. Gaming performance is essentially a tie, Vista leads by 3% in the HDD test suite, but everything else favors Windows 7 - sometimes by a large margin. We don't know exactly why Windows 7 scores so much higher in the TV and Movies, Music, and Communications test suites. It could be that driver differences play a part, or it may be that Windows 7 is simply better optimized for some of these tests. We do know that most users think Windows 7 performs better than Windows Vista, and the PCMark Vantage results clearly support that impression.
106 Comments
View All Comments
JarredWalton - Tuesday, September 22, 2009 - link
What I would love is to have a definitive Linux source that I can use that will "just work". But that's probably asking too much. I've now got suggestions to try the Ubuntu Netbook Remix, Moblin on the NV58, and Archlinux.And hey, if anyone lives near Olympia, WA and wants to come give the Linux install some fine luvin' let me know. LOL
stmok - Wednesday, September 23, 2009 - link
quote('What I would love is to have a definitive Linux source that I can use that will "just work".')That isn't going to happen. Simply because Linux isn't Windows or OSX. They approach things with different paradigms.
Per Hansson - Tuesday, September 22, 2009 - link
Hi, something I have noted when installing AMD laptops with a clean RTM WinXP disc and not the bundled one that includes all drivers + lotsa more crap you don't want;In all cases the systems have not been throttling the CPU speed or CPU voltage, I have had to install the AMD PowerNow! driver and then everything has worked (even though both AMD and Microsoft say this is included with XP!)
The difficult part is actually finding the driver, since both AMD and MS feels it is not needed it can be a real pita, please verify with CPU-Z or similar if your systems have this issue
JarredWalton - Tuesday, September 22, 2009 - link
Vista definitely worked properly - I saw CPU speeds of down to 1050MHz (5.25 x 200) on the NV52. Since XP and Win7 both achieve similar results, I think it's working right but would have to check. I'll try to be more careful for the next tests. :)jasperjones - Tuesday, September 22, 2009 - link
I assume you ran Ubuntu with the 32-bit Flash plugin (that's available on x86-64 via nspluginwrapper (Netscape plugin wrapper).I'd be curious to see how results are with the native x86-64 Flash which is available as an alpha on Adobe Labs.
For the last two or three years, I've had nothing but problems with 32-bit Flash on a 64-bit OS and those problems finally somewhat subsided after moving to the 64-bit native alpha build.
clavko - Tuesday, September 22, 2009 - link
Actually, graphics card power management with open source ati drivers (xf86-video-radeon and xf86-video-radeonhd alike) is not up to par with custom power management of fglrx proprietary driver. If tests were made using open source drivers, some of the battery time difference should account for that.However, I find it quite fair comparing Windows to Ubuntu, given that Ubuntu really is considered vanilla, desktop user distro. Obviously, things are not exactly "there" yet, but I'd be interested in power consumption with newer fglrx drivers, perhaps on OpenSUSE.
strikeback03 - Tuesday, September 22, 2009 - link
On my laptop (T40, 1.86GHz Pentium M Sonoma) I primarily use Ubuntu, with XP when I need Photoshop or Lightroom. I never measured the battery life exactly, but never felt it was that different, certainly not by a third. Do you have the scripts to run the internet test I could try and see what my results are?I also never felt Firefox was notably different between XP and Ubuntu, both misbehave in different ways. The notable exception is flash in 64bit Ubuntu on my desktop, which is of course more hit-or-miss.
JarredWalton - Tuesday, September 22, 2009 - link
Send me an email.gwolfman - Tuesday, September 22, 2009 - link
When I originally purchased my Dell Mini 9, it shipped with Ubuntu. Rather than coming with the standard/original kernel, it came with the Low Power Intel Architecture (LPIA) kernel. I'm not sure what optimizations are done with regards to the kernel, but do you think it's worth looking into with regards to the bad numbers you got from the default kernel bundled with your Ubuntu install? Maybe there are some optimizations for battery life in there that are not included in the standard kernel.vol7ron - Tuesday, September 22, 2009 - link
As nice as these tests are, I think the reliability/consistency may be overlooked a little bit. I'm not saying it's not reliable/consistent enough, you've already touched on that in the final paragraph, with regards to the websites themselves. What I'm saying is that there are other factors that may be affecting battery life.Are you using a multimeter to measure the power consumption, or are you just letting the battery drain and measuring time? I'm guessing that if you just let your computer start up and run it's battery drain naturally (no erroneous applications running), the battery life would also vary in minutes.
I also am assuming that these devices aren't cooled to the same temperature, before tests begin. Heat not only dissipates the energy stored in the battery, but it also requires more power to the fans for cooling. As I've touched on in another article, processor speeds vary - that's something that is truly hard to keep consistent, since it is irrelevant to BIOS settings. It'd be interesting to see if a processor running at 2.096 vs one running at 2.104 over an extended period of time has enough impact on battery life.
That being said, it's also known that processors vary in clock speed even after it's started, so I'm not sure if any points I've made can be applied in setting a realistic control at this point.
My last point is about the battery itself. Manufacturers claim the battery is "good for" a certain period of time, but these batteries are often "cheap" in quality. I think a few uses could impact the natural battery life; this goes back into testing regular start-up/shut-downs, w/o running any tests.