USA India
Home Articles UserTV Press Releases Dictionary Books Education Careers B-Channels Resources Forums Blogs Classifieds
Sunday 6 Jul, 2008 eNewsletter Register Login
Archives
Articles By Date
Articles By Category
 
 
 Archives >> Details
This is only a test
A little benchmarking can go a long way.
Posted by : Chuck Miller

Benchmarks...what are they good for? Absolutely nothing, say some people. For others, they provide bragging rights. But for a select few, they're a valuable comparative tool and a useful instrument for performance tweaking.

I like to presume that you're in the latter camp, which is why many of my columns include benchmark results. And it's also why I'm taking the time this month to assist you in interpreting those results and to help you employ the benchmark software tools effectively.

Benchmarks serve two purposes: They enable us to objectively compare various computers and components, and they provide a method for tweaking system performance. Whether we're dealing with processors, memory, video cards, hard drives, optical drives, or other related components, benchmarks help us measure performance in a somewhat consistent, reproducible manner.

Two kinds of benchmark software enter into the performance equation: synthetic and application-based or real-world. I use both to provide the best overall performance analysis. I also utilize software that is affordable and readily available. In synthetic benchmarks, there are a slew from which to choose, including 3DMark03, 3DMark2001 SE, Atto Utilities, CDSpeed2000, HD Tach, IOMeter, PCMark2002, PowerStrip, Sisoft Sandra, SysMark2002, WCPUID, Winbench, and Winstone.

In real-world benchmarks (i.e.,. games), the most popular are "Comanche 4," "Dungeon Siege," "Half-Life," "Jedi Knight II," "Quake 3," "Return to Castle Wolfenstein," "Serious Sam SE," "Serious Sam 2," "Tom Clancy's Splinter Cell," and "Unreal Tournament 2003." I've used many of them, but have settled on just a few as the "required" contingent of my default benchmarking suite.

With regard to synthetic benchmarks, 90 percent of my needs are met in three programs: 3DMark03, 3DMark2001 SE, and PCMark2002, all from Futuremark (formerly MadOnion). The first two benchmarks cover 3-D video testing, with 3DMark03 also providing basic CPU marks. The latter offers tests for CPU, memory, and hard drives.

In gaming benchmarks, my current suite consists of "Jedi Knight II," "Return to Castle Wolfenstein," and "Unreal Tournament 2003" (though I expect this list to change in the fall with the release of new cutting-edge titles). These real-world tests focus exclusively on video frame-rate performance.

What do these programs do? For the most part, synthetic benchmarks try to simulate what actually happens in software applications, but in a way that data can be viewed in greater detail. Real-world benchmarks, like games, provide results based on actual workload, but lack the minutia that synthetic benchmarks offer. Both have their place in the framework of performance testing. The bigger question is, what do these tests actually tell us?

Benchmarks like 3DMark03, 3DMark2001 SE, and application-based tests provided by games primarily tell us how well our system performs thanks to the video card stuffed under the hood. They inform us, for instance, whether our game rig runs better with an ATI Radeon 9800 Pro or an NVIDIA GeForce FX 5900 Ultra.

They also serve as a means of objectively tweaking video performance. For example, these tests will let us know if increasing or decreasing AGP aperture settings in the system BIOS or adjusting Direct3D or OpenGL settings in Windows has a positive or negative effect on video performance, and to what extent.

Software that tests CPU, memory, and hard drive performance individually is important, too. That's where programs like PCMark2002 and, to a limited extent, 3DMark03 come into play. They tell us, for instance, if increasing the frontside bus or CPU multiplier settings or if adjusting the memory timing CAS latency and DRAM command rate boost performance and by how large a margin. They also inform us if defragmenting the hard drive, changing Virtual Memory settings (the size and/or location of the Windows page file), or limiting the programs and device drivers that load on boot-up have any beneficial or adverse effects, as well as if drive performance degrades as the drive heats up under sustained operation (an indication additional cooling is necessary).

Once you decide what benchmarks you'll use, what procedure do you follow? If you're starting from scratch with a fresh install of all your software and the operating system (I recommend Windows XP), first configure everything to your liking, then run Scandisk and Disk Defragmenter (or the scanning and defragmenting utilities of your choice) to check drive integrity and optimize your hard drive(s). Then image your system with a program like Drive Image or True Image as a safeguard. (I'll discuss the issue of drive imaging in a future column, but briefly, it's the process of making a compressed copy of a drive, complete with the operating system, and then either transferring it to a new machine or restoring it on an old drive whose data has become damaged.) Next, install the benchmark software and image the drive again. Now you can perform all your benchmarking and tweaking with the peace of mind that should you mess anything up royally on the software side, you can always restore your system to its default installation.

If you're not beginning with a fresh installation of Windows XP (or your preferred OS), you'll want to start by defragmenting your hard drive. Then run your scanning and defragmenting utilities to verify integrity and optimize your hard drive(s), image your system, install the benchmarks, and image again.

A word of caution: When utilizing benchmarks to optimize system performance, it's vitally important not to rush the job. Make incremental changes one at a time and retest. Don't make multiple changes all at once, or drastic ones. That's a sure way to get yourself in trouble and end up with a system that won't run. As for what to tweak first, there's really no prescribed order. However, I suggest starting with the CPU, then the system memory, followed by the hard drive, and finally the video card.

In general, a resolution of 1,024 x 768 is good for general performance testing. You'll want to run higher resolutions when it comes to benchmarking and tweaking your video card, but lower resolutions are fine for all other tests. If you really want to tweak and overclock heavily, I suggest researching the subject at sites like Tweak 3D and Motherboards.org as well as in such books as "The Book Of Overclocking" by No Starch Press.

Finally, while not benchmarking in the strict sense, make sure that your optical drives are operating at their best, too, as well as your modem and Internet connection (for multiplayer fans especially). Every little increase adds to total system performance. Verify, as well, that your case has sufficient airflow. Tweaking your system for utmost speed only to have it slow down due to overheating is a self-defeating process. Of course, you'll want to tweak your OS for best performance. All tweaks combined will bear some effect on benchmark results and the speed at which your games strut their stuff.

 
 
Archives by Date
 
 
 
 
 
Copyright © 2008 ComputerUser Inc.
About us | Terms of use | Privacy Policy | Legal | Trademark/Copyright | Awards | Advertise | Writer guidelines | Sitemap | Contact | FAQ's | Feedback  | Link to us

Here are the topics we cover computer certification computer careers computer training computer games consulting data recovery data security digital entertainment emerging technology gadget reviews handheld computers hardware reviews home automation home networks home office how-to advice internet linux local companies local news local profiles macintosh mp3 players network security online music online security open-source small-business technology soho software reviews technology books technology dictionary vpn web site reviews wi-fi windows wireless technology tech articles tech news press releases tech dictionary education resources career solutions create your personal blog upload your videos become a writer usergroups special interest group SIG 3com cipts adobe adobe certified expert apc ncpi apple achds acpt acsa actc avaya bea 8.1 certified administrator 8.1 certified architect 8.1 certified developer 9 certified administrator bicsi rcdd checkpoint ccmse ccsa ccsa ngx ccse ccse ng plus with ai ccse ngx cisco access routing and lan switching ccda ccdp ccie ccip ccna ccnp ccnp old ccsp ccvp crmam ip communications optical proctored exams for validating knowledge sales specialist storage networking vpn and security wireless lan citrix cca 3.0 cca 4.0 cca 4.5 cca xp ccea 3.0 ccea 4.0 ccea xp ccia ciw ciw associate ciw certified instructor master ciw admin master ciw designer master ciw enterprise developer security analyst comptia a+ network+ security+ server+ computer associates ca cusa cuse cwna cwna cwsp dell eccouncil cea cep certified ethical hacker chfi e-commerce architect emc emc specialist implemenation technology foundations enterasys ese eta exam express exin exin itil extreme networks ena ens filemaker f7cd f8cd fortinet fortigate foundry cne fujitsu fujitsu guidance software ence hdi css hda hdm hdsa hitachi hitachi certified professional hp ais apc app aps ase certified systems developer csa cse master ase huawei hcne hyperion hcp ibm advanced deployment professional advanced technical expert application developer business process analyst certified administrator certified advanced system administrator certified advanced technical expert certified associate developer certified enterprise developer certified solution designer certified specialist certified systems expert database administrator db2 deployment professional enterprise developer eserver certified specialist ibm on demand business solution advisor solution designer solutions developer solutions expert storage administrator system administator iisfa cifi intel isaca cisa isc cissp sscp iseb itil ism cpm juniper jncia jncis legato lcaa lcea lotus clp lpi lpic level 1 lpic level 2 lpic level 3 macromedia mcafee mcdata csnd microsoft crm mbs mcad .net mcdba mcdst mcitp mcp mcpd mcsa longhorn mcsa 2003 mcsa 2008 mcsd .net mcse mcse 2000 security mcse 2000 to mcse 2003 upgrade mcse 2003 mcse 2003 messaging mcse 2003 security mcse 2008 mcts microsoft business solutions microsoft partner competency mile2 cnsa network appliance nac-na nac-nie naca nace nacp network general sniffer certified professional nokia nokia security administrator nortel ncde ncds ncse ncss ncts novell5 cna 5 cne 6 cna 6 cne 6.5 cne cne upgrade omg ocup oracle 10g dba 10g oca 11i 8i dba 9i dba 9i internet application developer oca ocp8 to ocp8i dba upgrade exam pmi project management professional polycom pcve redhat rhce rhct sair sas institute sas scp saas scp snia snia certified architect snia certified professional snia certified systems engineer snia storage networking certification program administrator professional associate symantec scse scsp scta scts teradata tca v2r5 tcad v2r5 tcda v2r5 tcis v2r5 tcm v2r5 tcp v2r5 tia ccnt ctp tibco tcp trusecure ticsa veritas infraguard chamber of commerce vcp vmware certified professional webex linkedin facebook myspace Professional page layout, image editing, vector illustration, and print production Website design, development, prototyping, and blogging Creation of rich interactive content Industry-standard visual effects and motion graphics Video capture, editing, and production; DVD titling; and digital audio, Adobe Photoshop CS3 extended, Adobe illustrator CS3,Adobe indesign CS3,Adobe Acrobat 8 Professional, Adobe Flash CS3 Professional, Adobe Dreamweaver CS3,Adobe Contribute CS3,Adobe Fireworks CS3,Adobe After Effects CS3 Professional, Adobe Premiere Pro CS3,Adobe Soundbooth CS3,Adobe Encore CS3,Adobe OnLocation,Adobe Bridge CS3,Adobe Version Cue CS3,Adobe Device Central CS3,Adobe Stock Photos, Intel Pentium 4 (1.4GHz processor for DV; 3.4GHz processor for HDV), Intel Centrino, Intel Xeon, (dual 2.8GHz processors for HD), or Intel Core, Duo (or compatible) processor; SSE2-enabled processor required for AMD systems Microsoft Windows XP with Service Pack 2 or Microsoft Windows Vista Home Premium, Business, Ultimate, or Enterprise (certified for 32-bit editions) 1GB of RAM for DV; 2GB of RAM for HDV and HD; more RAM recommended when running multiple components 10GB of available hard-disk space (additional free space required during installation) Dedicated 7,200 RPM hard drive for DV and HDV editing; striped disk array storage (RAID 0) for HD; SCSI disk subsystem preferred Microsoft DirectX compatible sound card (multichannel ASIO-compatible sound card recommended),1,280x1,024 monitor resolution with 32-bit color adapter Blu-ray burner required for Blu-ray Disc creation OHCI compatible IEEE 1394 port for DV and HDV capture, export to tape, and transmit to DV device QuickTime 7.1.2 software required to use QuickTime features Broadband Internet connection required for Adobe Stock Photos* and other services