You are probably not going to like some of the things I'm going to say here, but I feel like being honest this morning...
First, this sort of pissed me off:
Quote:
|
The first point we have to make about the 9800 GTX+ is that the card is not yet available to buy. Our reference sample was delivered direct from Nvidia at short notice and they expect retail availability in the middle of July.
|
So...first of all, the entire comparison is built around looking at an off-the-shelf card which has been shipping for weeks (I have 2x 4850 CFX installed at home) with a reference product sent directly to you by nVidia which is not yet shipping anywhere at the moment and which no one can buy.
Yet, you decide that the unavailable reference card is "best in class" over the off-the-shelf shipping HD 4850. It goes without saying that the pertinent and fair comparison would have been to hold off on making this comparison until the GTX + was actually on store shelves and available for purchase. But to start handing out awards before the product even ships? Suppose the sky fell in and for some mysterious reason nV isn't able to ship too many GTX +'s until much later in the year? Did this occur to you at all? It seems to me that "not available for purchase" merits a big minus on points tallied towards any kind of award, regardless of who makes the gpu.
Next, the title of this comparative review reads:
"HD 4850s V 9800 GTX +"
Yet, from the very first comparison it is obvious that the title should have been entitled "HD 4850s V 9800 GTX + V 9800 GTX OC V 3870x2 V GTX 260 V GTX 280"...man, talk about bait and switch...
Adding insult to this injury, when I examine the "test system" data you published, I find that the only 3d cards tested for *this comparison* were as follows:
Quote:
- 9800 GTX +
- MSI 4850
- Visiontek 4850
- 9800 GTX OC
- 9800 GX2
- Geforce 260 Reference
- Zotac Geforce GTX 280 AMP! Edition
|
So I'm wondering from which test system it was, and which test, that you decided to take the HD 3870 numbers, since apparently the HD 3870 was not included in the test system used to run the tests upon which this article was based.
Also, on a much smaller scale of criticism, while you listed the GTX 260 you used here as also being a *reference card* no doubt supplied to you by nVidia for this test (hard to know where it came from as you don't say), you don't call the 9800 GTX + a reference card in the test system specs you published, although you do reveal it much later on in the review as I've quoted you above, buried in the text.
Next, I have to say that I found the presentation of the bar chart organization very haphazard, confused, and inconsistent. Some examples:
Grid. As it is obvious that neither CFX or SLI drivers support GRID as of the date of your test, what's the point in publishing CFX/SLI frame-rate bar charts for the game at all? Better to say simply that neither IHV driver set supports GRID presently, imo, and leave it at that.
Tiger Woods '08. You say:
Quote:
|
It is also worth noting that the 3870 X2 is outperformed by every other card in this test as ATI have yet to implement a multi-GPU profile in their driver, the X2 is running in single GPU mode giving performance similar to that of a 3870.
|
Why mention only the HD 3870 x2 here?
Couldn't you have also said that people running CFX or SLI systems with TW '08 would also be treated to single-gpu performance in this game? I don't know first hand if that's the case, but since you didn't attempt an SLI/CFX frame-rate chart for this game at all, unlike you did with Grid, the only explanation would seem to be that neither IHV supports TW'08 in its CFX/SLI drivers at present.
Lost planet. Aside from the fact that I'm getting really tired of seeing this terrible game constantly benchmarked all over the 'net, I don't know what you meant here:
Quote:
|
Interestingly when we assemble such a system it is noticeable that the Nvidia scaling is much more impressive than that provided by ATI/AMD which results in the GTX+ SLI being the best performer of the two new products.
|
The numbers you presented for the HD 4850 and the 9800 GTX + present darn near identical "scaling" in this game between single and CFX/SLI operation. Both products scaled to nearly 100% improvement when tested under CFX/SLI conditions.
I'd also like to know why when testing SLI/CFX for this game in particular you decided suddenly that 2560x1600 wasn't worth doing. If you couldn't do it for some other reason aside from the fact that you weren't happy with the way any of the cards performed at that res even under SLI/CFX (although that so far hasn't stopped you before), it would have been nice if you'd explained jumping around here.
When people start playing shell games with testing conditions in a comparative product review it always makes me feel as if the author is trying to manipulate me somehow--but that's just me

, and maybe other people don't feel that way about it.
HL2: E2.
Quote:
|
When playing Half-Life 2 we can again see the benefits extra money can make with the GTX 260 and 280 playable at much higher settings than the more mainstream priced 4850 and 9800 GTX+. With the more reasonably priced cards we are still able to play at 1920x1200 with 8x anti-aliasing and 16x anisotropic filtering which looks lovely.
|
It would be really nice at this point if you might go into a little detail about just how much more money a 260 or a 280 costs above the price of an HD 4850--never mind the fact that this review was *supposed* to be comparing a non-shipping 9800 GTX + with a shipping HD 4850. In fact, the price disparity is so much that there's really no place for those products in a product comparison including an HD 4850. I mean, when you entitled this article you had a good idea--why didn't you stick to it?
I mean, I can get 2x 4850s for significantly less than I can buy 1 GTX 280. And GTX 280 SLI? Aside from the fact I could darn near buy SIX 4850s for the price of TWO GTX 280's, it appears from your presented numbers that GTX 280 SLI would not be a worthwhile purchase at any price...
Quote:
|
When we study SLI and CrossFire performance we see that this is another title where Nvidia’s drivers really do excel and the scaling is much better than that available on the Radeon, particularly when looking at minimum frames per second. The ATI part does have a higher average but this is irrelevant when we experience stutters from the twenty frames per second minimum.
|
It's this kind of talk that really sort of pisses me off. OK, so what's the "average frame-rate" number in your testing actually mean? I mean, clearly, it does *not* mean an average taken between the highest and lowest frame-rate numbers you recorded, so then it *must* mean something like this:
Average Frame Rate = the frame-rate at which the game most often runs.
Now, in this case you have said that even though the 4850s have a higher average frame rate than the GTX + that it is, and I quote, "irrelevant when we experience stutters from the twenty frames per second minimum."
Well, gee, you know, that's the thing about a "minimum" frame-rate number--you have no idea of how *often* it occurs. In fact, it is entirely possible that a minimum frame rate occurs only *once* during testing, and hence is recorded as the absolute minimum frame rate the game ever reached when tested. Clearly, then, the most important number of them all is neither the minimum or the maximum, but it is the "average" frame rate at which the game plays. But you've said it was "irrelevant," which is dead wrong, imo.
Look, let's suppose that the 4850 during the test often hit the minimum frame rate number you've recorded, and let's suppose that this induced constant stutter as you've implied. What do you think constantly hitting the minimum would do to the *average frame rate* you recorded?
Well, gee, it would drop it, wouldn't it? Yet, since the 4850 has a higher average frame rate than the 9800 GTX +, then doesn't that clearly tell us that although the GTX+'s minimum frame rate is higher than that of the HD 4850, that the +'s average frame rate is *lower* than the 4850's simply because the GTX + is hitting its minimum frame rate number a lot more often than the 4850 is hitting its minimum?
I think it does, and I also think it tells us that if we are going to see "stuttering" in either system, then it is more likely that we'll see it running the GTX + because the GTX +'s average frame rate is lower than that of the 4850.
One last little peeve here, even though there were several other things I wanted to mention but won't because I'm tired of sitting here typing this at the moment:
Aside from the fact that you managed to shoehorn lots of other, far more expensive products into a product comparison that was titled as though it was going to review only two products from a comparative standpoint: why didn't you include 9800 GTX OC SLI and GTX 260 SLI results here? What's the point of including these products singly but not in pairs when you've gone to so much trouble to pair up everything else, and even thrown in 3870 x2 results that you picked up from somewhere?
Suffice it to say that I think this product comparison would have been far better if you had restricted it to three products only, the 9800 GTX OC and the +, and the 4850. And of course it goes without saying that a non-shipping reference product should never score higher than a shipping one, for the simple reason that you can't be sure if the reference design will exactly equal the product that finally ships and that people will buy, and you can't even be sure of exactly *when* it will ship, either. That seems like nothing but common sense.
If you can't tell I was disappointed that this comparison wasn't what it should have been. It read far more like a "Let's try and put the best face on nVidia's product line that we can" puff piece as opposed to a sincerely undertaken product comparison between the 9800 GTX and the 4850. I mean, the way the article was written and approached I think the only correct title for it would have to be:
NVIDIA's ENTIRE MID-RANGE AND HIGH-END PRODUCT LINE V AMD's HD 4850
