Gateway NV58 (Intel) - Futuremark
Performing a few quick system/graphics benchmarks, let's see if there are any major differences between the Windows operating systems. As always, Vantage requires Vista/Win7 so XP gets a "0" on those tests (which is not to say XP fails - it's just the way we have to do things with our graphing engine).
The 3DMark results aren't quite as close this time, other than 3DMark05. XP trails in 3DMark06 by around 19%, and Vista leads in 3DMark03 by about 13%. Unlike the NV52, 3DMark Vantage scores almost twice as high as Vista with Windows 7 on the NV58, so perhaps Intel has invested some extra effort into improving their Windows 7 drivers. Of course, 3DMark Vantage barely worked on the NV58 and Vista, where it failed repeatedly to run anything other than the Entry test suite, so improving on that result shouldn't be too hard. Hopefully it's not simply a case of app detection and driver hacks to improve the score, though it looks rather suspicious. Anyway, we all know 3DMark isn't a game and as such you should take the above results with a grain of salt. PCMark05 also has XP in last place, but the 2D Transparency test again skews the results, so look at the table below. Meanwhile, PCMark Vantage again shows Windows 7 being Windows Vista, this time by 15%.
| Gateway NV58 PCMark05 Breakdown | |||
| XP SP3 | Vista SP2 | Win7 RTM | |
| PCMark05 Score | 4175 | 4671 | 4527 |
| HDD XP Startup (MB/s) | 9.661 | 8.158 | 8.14 |
| Physics and 3D (FPS) | 81.71 | 89.38 | 59.26 |
| 2D Transparency (Windows/s) | 119 | 3864 | 2050 |
| 3D Pixel Shaders (FPS) | 39.58 | 43.34 | 45.29 |
| Web Page Rendering (Pages/s) | 3.028 | 2.272 | 2.366 |
| File Decryption (MB/s) | 57.70 | 56.46 | 55.97 |
| 2D 64 Line Redraw (FPS) | 704.7 | 485.7 | 564.2 |
| HDD General Usage (MB/s) | 5.674 | 4.716 | 4.731 |
| Multitasking 1 | 1000 | 905 | 1015 |
| Audio Compression (KB/s) | 2209 | 1349 | 1248 |
| Video Encoding (KB/s) | 402.4 | 482.6 | 589.3 |
| Multitasking 2 | 1000 | 931 | 941 |
| Text Editing (Pages/s) | 140.9 | 123.1 | 127.5 |
| Image Decompression (MPixels/s) | 29.39 | 29.02 | 28.73 |
| Multitasking 3 | 1000 | 917 | 961 |
| File Compression (MB/s) | 4.951 | 5.005 | 4.36 |
| File Encryption (MB/s) | 27.99 | 25.79 | 33.13 |
| HDD Virus Scan (MB/s) | 72.95 | 54.57 | 58.54 |
| Memory Latency (MAccesses/s) | 8.207 | 8.108 | 8.012 |
As with the NV52, the PCMark05 composite score muddies the waters and makes it look like Vista is superior to XP and Windows 7. This time, 2D Transparency is 32 times faster on Vista than XP and 17 times faster on Windows 7. That score alone is able to drop Windows XP to the back of the pack in overall score, but it leads in virtually every other category. The 3D Pixel Shaders result favors Windows 7 and Vista over XP and Win7 is the fastest, potentially giving support to the idea that Intel has improved their graphics drivers under Win7. On the other hand, Win7 trails in the Physics and 3D test by 38% relative to XP and 51% compared to Vista. Maybe the 3DMark Vantage result is just a case of driver optimizations.
As before, we calculated our own composite score among the operating systems, with and without the 2D Transparency result. We didn't weight any of the tests, and our average of the 11 tests puts Vista at 278% faster than XP and Win7 139% faster. Remove the 2D Transparency score from the average and XP suddenly jumps up to 11% faster than both Vista and 7, which end up in a tie. We're not trying to say that 2D Transparency is worthless, but it does account for deflated PCMark05 scores on Windows XP.
| Gateway NV58 PCMark Vantage Breakdown | ||
| Vista SP2 | Win7 RTM | |
| PCMark Vantage | 3397 | 3911 |
| Memory | 1896 | 2237 |
| TV and Movies | 2482 | 2613 |
| Gaming | 1999 | 1998 |
| Music | 2851 | 4206 |
| Communications | 3774 | 4033 |
| Productivity | 3039 | 3156 |
| HDD Test | 2643 | 2867 |
PCMark Vantage gives the lead to Win7 by 15%, with individual results ranging from a tie in Gaming to a 48% lead in Music. Unlike the NV52, the TV and Movies suite doesn't show a major difference, nor do the Communications and Productivity suites, but HDD and Memory show a larger benefit to Win7 on the NV58. Ultimately, PCMark Vantage still confirms that Windows 7 is faster overall than Vista, even if the only area that appears to benefit by a large amount (i.e. regardless of platform or hardware) is the Music suite.
Facebook
Twitter
RSS
106 Comments
View All Comments
ascl - Tuesday, September 22, 2009 - link
I was reading this thinking that it was an unusually bad review from anand.... then I reached the conclusion 2 + 3 and my complaint was answered! Using randomised web testing is terrible if you want repeatable results. Use an internal server with a fixed set of pages (and ads).Kudos!
vailr - Tuesday, September 22, 2009 - link
Maybe compare battery life on a MacBook Pro running OSX Snow leopard vs. Windows 7 64-bit/Win XP 32-bit (in Boot Camp) vs. Ubuntu(?). Using VLC Media Player sequenced to play a series of several DIVX movies, for finding the running time under each OS.gstrickler - Saturday, September 26, 2009 - link
Anand has already done that with a MBP and OS X vs XP (and maybe Vista). Anyway, it would be good to see it repeated with Win7 in a couple months when they've had time to produce some reasonably power efficient Win7 drivers.In any case, a MBP is a great platform for the task, it will run all those OSs, the Nvidia chipset is well supported in all of them and it's pretty power efficient. Of course, with it's battery life, the tests might take a while.
Gamingphreek - Tuesday, September 22, 2009 - link
Battery life in Linux, as it is a *nix based OS, needs configuring. You claimed that you couldn't find it, but honestly you need to find someone who has *nix experience then because it is honestly the most customizable of the OS's.Additionally, while you did a good job in following that website for advice, staying with the 'Safe' configuration is a grave error. All that merely does is use an old version of MESA (OpenGL driver) and an old Intel driver. I would honestly like to see you try out the 2.6.30.5 or the 2.6.31rc kernel along with the most up to date drivers from the XorgEdgers repository. Performance with those optimizations is honestly quite remarkable.
Furthermore, I would suggest looking over lesswatts.org as well as running the PowerTOP application to see what is unnecessary. For instance, I have a script that disables my PCMCIA slot given that I do not use it. I also have my RJ11 based modem disabled. I have LaptopMode enable automatically when I unplug A/C power and disable when I plug in A/C power.
Additionally, why did you turn off auto dimming?? That is a great feature that severely crippled the performance of Ubuntu yet again.
As for Firefox/Shiretoko (Shiretoko is the codename for Firefox 3.5) that is a known issue with lazy programming. Downloading the Noscript or Adblock extension helps immensely with performance. Additionally Shiretoko/FF3.5 has a vastly improved engine when compared to FF3.0.
Additionally, I don't believe you stated what file system you were using. EXT4 is vastly superior to EXT3 (While it isn't the default, among Linux users, it is rare for someone to choose EXT3 over EXT4) - especially when boot times are involved. Even still, it sounds like there was a broken script or something - Ubuntu 9.04 has the fastest startup/shutdown I have ever experienced.
Honestly, Ubuntu seemed to draw the short end of the stick here. It takes time to configure the OS - I honestly expect more time to be given to configuring it like the other ones.
smitty3268 - Tuesday, September 22, 2009 - link
While I agree with most of your points (you can definitely tweak linux down to the bare bones much more than something like XP to save power), I think it is perfectly acceptable to use a default distro that is commonly used. After all, he didn't go through the Windows registry, disabling services and hacking stuff there either.But in the end, let's face it. Firefox and Flash are horribly optimized for Linux. It's not exactly a surprise that they suck down more juice, given that they usually take about 5 times more CPU power than under windows.
Gamingphreek - Tuesday, September 22, 2009 - link
Well that is the inherent difference between Linux and Windows.Thats like saying you aren't going to download and install drivers for Windows - Linux comes with all of them...
And as a slight correction, Firefox isn't really the problem and Flash is horrible for any/everything BUT Windows.
JarredWalton - Tuesday, September 22, 2009 - link
As stated, it wasn't intended to be a Linux review. This is a well-known Linux distro that is supposed to be "easy". I don't have the time nor inclination -- just like 99.9% of users -- to go into detailed steps for hacking and modding Linux. I fully understand that it is highly customizable, but so is a car if you're inclined to go that route. I drive a stock vehicle, and I use a stock OS.Downloading drivers isn't the same thing as downloading the latest kernels, creating your own conf files, and manually entering all sorts of settings that help enable/disable items to provide better power saving. My conclusion pretty much sums up my feelings: the out-of-box experience for Ubuntu is nothing special for a laptop, and if you are expecting it to "just work" you'll be disappointed.
Given how much is available for tweaking in the Linux community, I'm frankly surprised that no one has apparently spent the time to make the default configuration far more sensible and easier to live with. I know how much fun it is to download and compile programs and edit configuration files, but I'd rather just have an easy interface that works without a ton of effort.
I also fully recognize the inherent problems with Flash, so I put in numbers with Firefox and FlashBlock. It helps, but it doesn't help enough to equal the default Windows setup. There are other browser options of course, and if/when I get time I'll see about looking at some of them.
ekul - Tuesday, September 22, 2009 - link
Ubuntu is a poor distro for battery life out of the box as many of its default settings belong on a desktop or even server system. With a bit of tweaking though it can easily get better battery life then windows. My netbook struggled to get 2 hours in XP, in ubuntu I can easily see 2:45 or more.As has been mentioned by at least one other commenter use the powertop tool (sudo apt-get install powertop && sudo powertop). This was written by intel to help find applications and drivers that were waking up the cpu too much and hurting battery life even if they didn't appear to be using very many system resources. The tool itself looks for many settings that are not optimal for battery life and offers to correct them for you so you don't have to go on a treasure hunt at all. I'd love to see what kind of improvement could be made with that tool alone.
As an aside, a major oversight is idle battery life. All of your tests feature the OS as the minor player in the war against power consumption. In each test you have an application eating the majority of the resources. You should fully charge the battery and let the laptop idle at the desktop until it dies, testing each OS's ability to sleep long running processes and services. Perhaps leave an office suite, browser idling on a page and wifi connected to stop the runtime for taking too long.
Finally using flash heavy websites heavily skews the results for both OS and browser battery life tests since you are sending both into battle missing limbs. It is well known flash is poorly written software at the best of times, causing well over 60% of all firefox and IE crashes. It has rudimentary 64 bit support, doesn't support hardware acceleration on anything but windows and if it isn't playing video (covered by the dvd test) is almost certainly on the page to serve an ad. No browser has any sort of control over flash (though chrome does its best to reign it in) so your browser tests amount to little more then a test of flash. Flash sucks even in windows but in linux it is truly awful (as is almost all closed source code for linux).
JarredWalton - Tuesday, September 22, 2009 - link
The second batch of sites was hardly Flash-heavy. Yahoo and MSN have one Flash ad, YouTube has none, and the Facebook login page is just text and images.FWIW, I did run an "idle at desktop" test on Ubuntu on the NV52 and got a time of 204 minutes. That compares to 242 minutes under Vista, or a 18.6%. There are a LOT of other things I still need to look at, however -- including different power schemes, tweaked profiles, etc.
If I'm going to try to improve the Linux results in every way possible, it's only fair to do the same for Windows.
ekul - Tuesday, September 22, 2009 - link
Because the linux and windows philosophy is so different a different approach has to be taken to setting them up and running them. With windows initial setup is very simple and has vendor support for things like drivers. Over time problems begin to appear and cleanup/formatting becomes necessary. Most linux distros integrate all possible hardware support and target lowest common denominator hardware to ensure broad compatibility at the expensive of performance. Once they have been tweaked they will continue to run indefinitely at that level.With windows you have ease now for pain later. With linux you have pain now for ease later. This means running things like powertop and changing the init options to run in parallel would be the same as cleaning a registry in windows rather than something like disabling services in windows. I spent one afternoon tweaking my netbook and now it runs much smoother and faster then it ever did with windows plus the battery life is longer. Changing config options and customizing for your hardware is the reality with linux the same way random problems cropping over time is the reality with windows. If linux distros are to be punished for ease of setup issues then windows must be punished for altered performance 6 months from now. Linux is getting better however, and different distros ship with very different defaults. Ubuntu is really debian unstable repackaged for the server/desktop which means at its very heart it is a server distro. For future tests opensuse may be the best choice to represent laptop/desktop defaults.
FWIW if you want to find the real options in linux for power management you should look in /sys/devices/system/cpu/cpu0/cpufreq/. The options in the gnome power management panel only really deal with monitors. But again 3 minutes with powertop and I'm certain you will see an improvement.