Going to write a Benchmarking FAQ..

No_Style · Jun 25, 2004, 05:00 PM

I'm itching to write a benchmarking FAQ.. going through the forums and stuff, I've noticed some people don't know how to benchmark properly. (Yes, running it once through doesn't cut it in my opinion).. It'll incorporate some questions and answers about how many times to bench..which benchmarks determine what...and some stability checking stuff. Good idea? Bad idea? I don't want to be wasting my time if it isn't going to be used

It'll be great if it was a collaboration as well..get some questions for it and some answers..

UPDATE:

I hope to put this up in HTML format as well.. As you can see it's very rough right now and no where near completion.

If you have any comments on it, or if you'd like to help out with layout or ANYTHING. Don't hesitate to post or PM me. This is just a sample!

Download

riles9262 · Jun 25, 2004, 07:01 PM

It will be used for sure, just make sure to include real world benchies, not just synthetic ones

And yes, you need to run them about 3 times and take the avg.

Rayder · Jun 26, 2004, 06:42 AM

Sounds good to me. I say, Go For IT.

**dj_stick** · Jun 26, 2004, 06:54 AM

go for it

Danhill · Jun 26, 2004, 07:02 AM

Yes go for it my man.

No_Style · Jun 26, 2004, 11:04 AM

I'll be working on it over the next week or so.... Some things came up and need my immediate attention

**dj_stick** · Jun 26, 2004, 11:09 AM

write in when you are ready, i would like to read this

Judas · Jun 26, 2004, 12:47 PM

write it up... there are alot of people that would like to know

Nacht · Jun 26, 2004, 12:57 PM

good idea...i think an OC faq would be more benefitial to some people though...(lol does one already exist?)

@/2ct!< · Jun 27, 2004, 01:22 AM

Quote:

Originally posted by Judas
write it up... there are alot of people that would like to know

And many more that need to know, too many completely amateur reviews of little value out there.

Judas · Jun 27, 2004, 05:17 AM

indeed... i try to be as thorough as possible.. reason it's taking me AGES to get done this bloody major review i've been working on for months.... hours....

No_Style · Jul 3, 2004, 10:04 PM

I'm nearly done a rough draft of my FAQ/Guide..

I'd appreciate some help on it though so.. if anybody wants to proofread, add suggestions, help design or contribute.. I'll accept the first two people to post in this thread with their intention to help.

I want to cover a lot in this and I want it to go right as well. There will be revisions made for sure, and I hope to update it on a regular basis or as needed. So if you're knowledgeable in benchmarking and it's practical uses besides just "measuring performance".. don't hesitate to post

mainman · Jul 3, 2004, 10:06 PM

Its a very good idea bud, go for it!!!

grog · Jul 3, 2004, 11:00 PM

I think you may be going down the right track based on your comments.

The best use for benchmarking a system is to know that something has changed over time.

CPU marks go down could be a sign of services running that you are not aware of, maybe a virus.

Knowing the performace gain when adding a new video card can only be achived by having good data before the upgrade.

There is also the stability factor. If your system is having problems, random crashes etc... Running benchmarks may help to pin-point the problem. OpenGL benchmarks are fine but DirectX benchmarks crash. Since benchmarks stress the system they are a valuable tool beyond my system get 10FPS more than someone else.

Network benchmarks are not covered much in any guide. Using ttcp for example is an easy way to see how well an internal home network is performing.

That kind of information is very useful.

Greg

QUOTE]Originally posted by No_Style
I'm nearly done a rough draft of my FAQ/Guide..

I'd appreciate some help on it though so.. if anybody wants to proofread, add suggestions, help design or contribute.. I'll accept the first two people to post in this thread with their intention to help.

I want to cover a lot in this and I want it to go right as well. There will be revisions made for sure, and I hope to update it on a regular basis or as needed. So if you're knowledgeable in benchmarking and it's practical uses besides just "measuring performance".. don't hesitate to post [/QUOTE]

No_Style · Jul 28, 2004, 11:55 AM

I've got more work to do on it, but I thought I'd post what I have so far for people to see.

I hope to put this up in HTML format as well.. As you can see it's very rough right now and no where near completion.

If you have any comments on it, or if you'd like to help out with layout or ANYTHING. Don't hesitate to post or PM me.

Download

Jun 25, 2004, 05:00 PM	#1
No_Style Styleless Wonder Join Date: Jun 2002 Location: Ottawa, Ontario Posts: 6,049 Rep Power: 0	Going to write a Benchmarking FAQ.. I'm itching to write a benchmarking FAQ.. going through the forums and stuff, I've noticed some people don't know how to benchmark properly. (Yes, running it once through doesn't cut it in my opinion).. It'll incorporate some questions and answers about how many times to bench..which benchmarks determine what...and some stability checking stuff. Good idea? Bad idea? I don't want to be wasting my time if it isn't going to be used It'll be great if it was a collaboration as well..get some questions for it and some answers.. UPDATE: I hope to put this up in HTML format as well.. As you can see it's very rough right now and no where near completion. If you have any comments on it, or if you'd like to help out with layout or ANYTHING. Don't hesitate to post or PM me. This is just a sample! Download __________________ "The Best Style Is No Style" Specifications Here Last edited by No_Style; Jul 28, 2004 at 11:57 AM.

Jun 25, 2004, 07:01 PM	#2
riles9262 Driverheaven brewmaster Join Date: Oct 2002 Location: British Columbia, Canada Posts: 4,839 Rep Power: 55 System Specs	It will be used for sure, just make sure to include real world benchies, not just synthetic ones And yes, you need to run them about 3 times and take the avg. __________________ A beer a day keeps the doctor away.

Jun 26, 2004, 06:42 AM	#3
Rayder Mostly lurking lately.... Join Date: Jun 2002 Location: U.S.A. Posts: 2,043 Rep Power: 51	Sounds good to me. I say, Go For IT. __________________

Jun 26, 2004, 07:02 AM	#5
Danhill DriverHeaven Extreme Member Join Date: May 2003 Location: Sweden Posts: 4,116 Rep Power: 0	Yes go for it my man. __________________ MOBO: [color=white]ASUS A8N-SLI Premium[/color] CPU: AMD 64 3200+ (Venice) @ 2,50 Ghz MEM: 2 x 512 DDR 466, VGA: 2 x 6600 GT in SLI, HDD1: WD Raptor HDD2: Maxtor Diamond Plus 9, Case: Antec Plus View 1080, PSU: ThermalTake PurePower 500W, MX 1000, Dell 2001 FP, Aud. 2 SZ

Jun 26, 2004, 11:04 AM	#6
No_Style Styleless Wonder Join Date: Jun 2002 Location: Ottawa, Ontario Posts: 6,049 Rep Power: 0	Thanks for the vote of confidence I'll be working on it over the next week or so.... Some things came up and need my immediate attention __________________ "The Best Style Is No Style" Specifications Here

Jun 26, 2004, 12:57 PM	#9
Nacht ein Krieger Join Date: Jan 2004 Location: Clemson Uni Posts: 3,127 Rep Power: 0	good idea...i think an OC faq would be more benefitial to some people though...(lol does one already exist?)

Jul 3, 2004, 10:04 PM	#12
No_Style Styleless Wonder Join Date: Jun 2002 Location: Ottawa, Ontario Posts: 6,049 Rep Power: 0	Nearly done a rough draft.. I'm nearly done a rough draft of my FAQ/Guide.. I'd appreciate some help on it though so.. if anybody wants to proofread, add suggestions, help design or contribute.. I'll accept the first two people to post in this thread with their intention to help. I want to cover a lot in this and I want it to go right as well. There will be revisions made for sure, and I hope to update it on a regular basis or as needed. So if you're knowledgeable in benchmarking and it's practical uses besides just "measuring performance".. don't hesitate to post __________________ "The Best Style Is No Style" Specifications Here Last edited by No_Style; Jul 3, 2004 at 10:15 PM.

Jul 3, 2004, 10:06 PM	#13
mainman Mr. Nobody Join Date: Jul 2003 Location: OmniPresent Nightwatcher Posts: 5,939 Rep Power: 53	Its a very good idea bud, go for it!!!

Jul 3, 2004, 11:00 PM	#14
grog Roxy Music Join Date: Jul 2002 Posts: 1,064 Rep Power: 52 System Specs	Re: Nearly done a rough draft.. I think you may be going down the right track based on your comments. The best use for benchmarking a system is to know that something has changed over time. CPU marks go down could be a sign of services running that you are not aware of, maybe a virus. Knowing the performace gain when adding a new video card can only be achived by having good data before the upgrade. There is also the stability factor. If your system is having problems, random crashes etc... Running benchmarks may help to pin-point the problem. OpenGL benchmarks are fine but DirectX benchmarks crash. Since benchmarks stress the system they are a valuable tool beyond my system get 10FPS more than someone else. Network benchmarks are not covered much in any guide. Using ttcp for example is an easy way to see how well an internal home network is performing. That kind of information is very useful. Greg QUOTE]Originally posted by No_Style I'm nearly done a rough draft of my FAQ/Guide.. I'd appreciate some help on it though so.. if anybody wants to proofread, add suggestions, help design or contribute.. I'll accept the first two people to post in this thread with their intention to help. I want to cover a lot in this and I want it to go right as well. There will be revisions made for sure, and I hope to update it on a regular basis or as needed. So if you're knowledgeable in benchmarking and it's practical uses besides just "measuring performance".. don't hesitate to post [/QUOTE] __________________ Dell UltraSharp 2405FPW 24" LCD Philips 47" 1080p 47pfl7422d/37 LCD ASUS M3A32-MVP Deluxe/WiFi BIOS 1406, AMD Phenom 9600 Agena 2.3GHz, G.SKILL 8GB(4 x 2GB) 240-Pin DDR2 (PC2 6400) ASUS EAH4850 TOP/HTDI/512M PCI Express 2.0 Creative Sound Blaster X-Fi Elite Pro Sound Card, 1TB Hard Disk storage Thermaltake Tai-Chi VB5001SNA Black/ Silver Computer Case with liquid cooling AeroCool GateWatch-SV Silver GateWatch with LCD display, PC Power & Cooling 510 SLI-PFC 510W APC Back-UPS XS 1000 UPS, 1000 VA, 600 Watts Microsoft Windows Vista Ultimate SP1 64-bit VM's (Fedora, RHEL4..etc) Klipsch ProMedia Ultra 5.1

Jul 28, 2004, 11:55 AM	#15
No_Style Styleless Wonder Join Date: Jun 2002 Location: Ottawa, Ontario Posts: 6,049 Rep Power: 0	This is a rough, very rough draft. I've got more work to do on it, but I thought I'd post what I have so far for people to see. I hope to put this up in HTML format as well.. As you can see it's very rough right now and no where near completion. If you have any comments on it, or if you'd like to help out with layout or ANYTHING. Don't hesitate to post or PM me. Download __________________ "The Best Style Is No Style" Specifications Here