Hardware Review Sites and Vendor Relationships 155
VL writes "Manufacturers demanding content changes is nothing new in the tech site community. We take a look at this topic, including one very public example that started in the past three weeks."
One of the first cases (Score:5, Informative)
But the damage was already done.
Re:One of the first cases (Score:1)
This is why it's darn rare to find an original 1.13GHz FCPGA chip (that will fit in a Coppermine era motherboard without a converter.
Re:One of the first cases (Score:1, Informative)
Re:One of the first cases (Score:1)
Further more, Riva TNT cards run not so old games pretty well, Max Payne is an example, I want to see a Voodoo card do so.
Are you sure this actually happened? Got any links? Or you are just trolling / karma whoring?
Re:One of the first cases (Score:1)
with a good framerate of course..
Re:One of the first cases (Score:5, Informative)
Here are the reviews from Tom's site:
Comparison of Graphics Cards with NVIDIA's RIVA TNT Chip [tomshardware.com]
Addendum to Banshee, Savage3D and TNT Preview [tomshardware.com]
New 3D Chips - Banshee, G200, RIVA TNT And Savage3D [tomshardware.com]
Preview of 3Dfx Voodoo Banshee, S3 Savage3D and NVIDIA RIVA TNT [tomshardware.com]
I only skimmed the articles, but he doesn't seem to be saying that the TNT is twice as fast. The last article concludes:
"NVIDIA's RIVA TNT is not the new wonder chip as some people may have expected. However it is sticking up very well against its toughest competitors from 3Dfx. 3Dfx has still got an edge in applications that are available in a Glide version and in games that don't strain the CPU as much, thus giving a dual Voodoo2 configuration the chance to show its power. However, there are many occasions where TNT is at least as good as single Voodoo2, dual Voodoo2 and certainly better than Voodoo Banshee."
Seems fairly objective to me. Did I miss something? Maybe the articles have been edited?
Re:One of the first cases (Score:3, Funny)
Reading is fun!
Re:One of the first cases (Score:1)
lol, thanks
Honestly though, the articles are full of benchmarks and graphs. Is the OP suggesting that all these were falsified in the orginal article?
Re:One of the first cases (Score:2, Funny)
Re:One of the first cases (Score:1)
Re:One of the first cases (Score:3, Interesting)
Re:One of the first cases (Score:1)
Re:One of the first cases (Score:1)
Now why would you think they would have to bribe him to accomplish the above.
They talk about journalistic integrity.... (Score:5, Interesting)
They should have picked a more relevant example, like Tom's Hardware and the Intel P3 fiasco where the 1.13's had a critical error in them. It really seems like they were just trying to get mentioned on Slashdot, and seem like a really good review site.
Re:They talk about journalistic integrity.... (Score:1, Informative)
Re:They talk about journalistic integrity.... (Score:2, Informative)
Re:They talk about journalistic integrity.... (Score:2)
Re: (Score:2)
Re:They talk about journalistic integrity.... (Score:1)
Mistakes, damned mistakes and statistics (Score:5, Insightful)
Re:Mistakes, damned mistakes and statistics (Score:2)
What?? Reviews are rigged? (Score:3, Funny)
Hmmm (Score:5, Funny)
That's an odd thing to say before posting to Slashdot.
Re:Hmmm (Score:4, Funny)
For you window's folk out there, lete me translate:
but rather our "My Favorites" and "Carrage Returns and Line Feeds".
As a former sports editor for a newspaper... (Score:5, Interesting)
Now, if there was libel or untruth involved, I'm the first to say they need to be punished... but... don't try to hide your own faults by beating up on a website. Nobody likes a sore loser (or vaporware company).
[cheapplug]For some journalistic goodness, go to oldos.org [oldos.org][/cheapplug]
Re:As a former sports editor for a newspaper... (Score:1)
Sports Editor
Education Reporter
Go-fer for the editor
Re:As a former sports editor for a newspaper... (Score:2)
That's a lot of politicians we're going to have to hang.
Re:As a former sports editor for a newspaper... (Score:2)
This isn't news. (Score:5, Insightful)
The [H] issue has more to do with halting what someone feels is slander, and little to do with the widespread problems with hardware review sites skewing benchmarks to keep a vendor, advertiser, or to get free stuff.
Unique as the issue may be, it's not worthy of multiple
If I wanted a 15 year old's opinion in essay format on the issue, I would have simply gone to [H]'s forum.**
** - Not that a 15 year old is less intelligent than anyone else, just young people tend to not have their heads glued on straight when it comes to business and law. Wisdom takes time to build.
Wisdom takes time to build (Score:4, Funny)
How old was Strom Thurmond when he died?
Re:Wisdom takes time to build (Score:1)
In his case, maybe it needed another 150 years? =P
Infinium a hardware vendor? (Score:5, Funny)
Re:Infinium a hardware vendor? (Score:4, Funny)
If they tried to sue me I'd call their bluff (the "phantom lawsuit") and just put quotation marks around all my stuff to humiliate them:
The ceo of the company making the *yet to be released* "phantom" console has asked us to take down our review of their business. We suggest the best thing they could do would be to give us a "phantom" console to review, but something is really haunting their company - because the "phantom console" has yet to be released to the public. Finding their "phantom offices" is also a difficult task. But perhaps we shouldn't be so hard on the CEO, he could be a visionary - this "phantom of his imagination" could bring the gaming world to it's knees. All they need to do is set a new "phantom release date" and stick to it like the slime the ghosts leave when the pass through walls in Ghost Busters. Then we will all be able to enjoy the phantoms
humiliation complete, lawsuit aborted, insert credit for more life.
Re:Infinium a hardware vendor? (Score:2)
Many Other Riscs for Website Owners (Score:5, Interesting)
not only hardware... (Score:5, Informative)
"Note that Oracle is not included because they asked to be removed. All Oracle benchmarks have to be passed by Oracle! We believe that makes Oracle benchmarks very biased because the above benchmarks are supposed to show what a standard installation can do for a single client."
not only hardware...EULA's. (Score:3, Interesting)
Re:not only hardware... (Score:4, Interesting)
Of course they are very biased. Since it rather hard to find any real-life application of RDBMS serving "sigle client".
And we all know how good MySQL at serving multiple clients with complex queries at once.
Neat quote tho, at least when you understand who is really biased :)
/usd
Yup nobody uses single client. (Score:3, Interesting)
Do you know anything about IT? Or are you one who think IT is only the million dollar projects? A small companie orderbook or a mere webshop don't count?
The stats on mysql showed that for simple setups mysql outperforms the big boys. Factor in price and oracly quickly becomes a terrible product. (A webmonkey can maintain mysql. Oracle needs a dbm)
BUT only on small/medium applications. That is what the benchmark showed. But oracle doesn't like that to be known. It shows peo
Re:Yup nobody uses single client. (Score:2)
Actually, no it isn't against standards, it merely exposes the advetiser to claims of slander. I've seen many the commercial / print ad where the competitor is named, but I have always noticed that the fine print is usually less fine than normal and makes explicit references such as "Data obtained from 2002 annual report to
Re:Yup nobody uses single client. (Score:2)
Ever heard of "threads"? Or of "concurrent" connections?
Even a small web shop may have to serve more than a connection at a time. Ever heard of fluctuations and statistical flukes? Even without getting slashdotted or one day being mentioned in some major magazine, the day _will_ come when 10 users click on the search button at the same time. That's what
Re:not only hardware... (Score:1, Interesting)
Re:not only hardware... (Score:2)
That's not a single client. Unless the message board only has one user on it at a time, it has multiple clients accessing and updating the messageboa
Re:not only hardware... (Score:2)
From the pov of the database, that's a single client application: most low level web apps don't use pooling, so they use a single connection to the database. And most message boards only have one client at a time (not everyone does slashdot's numbers)
Nothing new. (Score:5, Insightful)
In the old days, if you advertise enough the paper would automatically tweek the review. Infoworld had done this with a compiler review. If you read the review, then looked at the score card, you would notice that they did not match.
Re:Nothing new. (Score:2)
Re:Nothing new. (Score:2)
Anyone know of any honest review sites? (Score:3, Interesting)
--
Real-time deal updates [dealsites.net]
Re:Anyone know of any honest review sites? (Score:5, Informative)
Re:Anyone know of any honest review sites? (Score:3, Informative)
Re:Anyone know of any honest review sites? (Score:5, Informative)
Just had to buy some speakers for work, and there was only one site which ignored the manufacturers' claims of power rating, and talked instead about the wattage available from the power supply, the likely efficiency, and the ratings printed on the back of each driver. Most other sites seem to take specifications at face-value.
In fact, Dans Data has been known to:
(-) Tell you a speaker gives 20W output even when it's described as "250W total system power"
(-) Actually test CPU heatsinks with a resistive heater
(-) Relentlessly mock manufacturers who describe 10^9 bytes as a gigabyte
(-) Take everything apart
(-) Know enough about overclocking to laugh at people who do it badly
(-) Pick-up digital camera manufacturers for lying in their "megapixel" ratings (I think some of them count each colour in a pixel as a separate pixel?)
(-) Write reviews in valid HTML that are all on one page, and use the full width of your browser window without Flash animations
(-) Test PC power supplies under load, and compare it with manufacturer specifications
(-) Get out the multimeter for pretty much everything, from LED flashlights to power supplies and batteries
And of course, the famous:
(-) debunking a load of wacko free-energy products and "this'll make your toaster healthier" new-age power connectors.
As Dan would say, "reccommended."
All overpriced. (Score:2)
Re:Anyone know of any honest review sites? (Score:1)
http://www.dansdata.com/raidagain.htm
Re:Anyone know of any honest review sites? (Score:2, Informative)
Re:Anyone know of any honest review sites? (Score:4, Interesting)
1) Most owner reviews suck. There are many sites that will post reviews made by people who recently purchased a product. These reviews are rarely objective. For one thing the author will rarely have anything to compare the new product to. For a second thing, far too often the review is merely an editorial in which the author tries to justify to themselves the purchase of some new, and expensive kit. A classic example (and sterotype) is the audiophile "reviews" extoling the features of insanely expensive hardware. However I do find such reviews of some use. If there are any problems listed, those problems should not be taken lightly. If a product is given a 8 of 10 but has <undesirable feature>, then that feature must be pretty serious to warrant mention at all.
2) Read several sources. Off the top of my head I can think of Tomshardware, Sharkyextreme, Anandtech, Arstechnica, and [H]ardOCP. These sites tend to do decent comparisons. The sites each have different methods, and don't always agree on the results. I prefer Tom's and Anand for reviews (despite Tom's past). Arstechnica tends to have good technical articles which serve as a basis to better understand and critically read the other review sites. Dansdata deserves mention as one of the best cpu cooler review site out there.
3) Trust the numbers more then the comentary. It is harder to be biased with numbers. Think critically about the results. If the review states that "product A is clearly faster then product B," but the difference is only 2%, then that comment is not justified. There is caveat to this. Sometimes the review will contain critical details that can't be expressed very easily as a number. Important information about supported features, or architechture. Such as video card X supports DirectX9 completely, whereas video card Y does not. A good review will explain why these features matter.
4) Think about what is really being tested. Read the test methodology. Look at the combination of hardware and/or software used to test the product. Again Dansdata deserves mention. Dan has built an excellent test rig to test the cpu coolers. There are flaws with the test. He acknowledges those flaws, and dicusses how the flaws, may or may not affect the validity of his tests.
5) When reading the conclusions it is very important to understand what those conclusions were based on. A prime example is ConsumerReports' (CU) review of digital cameras versus DPreview or Stevesdigicams. CU is very independant, but rates the cameras as a whole along with the bundled software, and other touchyfeely, ooh-aah features. The other sites ditch the software, and review the cold hard technical details of the camera with heavy emphasis on the image quality.
Review site tips and Buyer's Remorse (Score:2, Informative)
Bishop, some of your comments ring true and are worth further discussion.
This is exactly the reason why we at Geartest.com [geartest.com] don't bu
best excuse I've ever heard for getting free kit.. (Score:2)
Horseshit.
You just lost all your credibility with me and with any other pro tech journalist who read the crap you just wrote. So you depend exclusively on freebies? What happens if a vendor doesn't like your review? Enough unhappy vendors and you're out of business. Or is it that you never give bad reviews for products?
Do you always return the products you review to the vendors i
Re:best excuse I've ever heard for getting free ki (Score:1)
No credibility? What's your excuse? (Score:1)
Fascinating.
I had no idea that you [50megs.com] were the voice for all professional technology journalists everywhere. I'll have to remind the technology journalists I know (and contact those that I don't, just so they know) that they should stop visiting and writing because a lone voice howling in the Internet wilderness has an axe to grind and went on a rabid rant that we lacked credibility with him. Sure thing. Gotcha.
Thanks for completely ignoring the half-dozen paragraphs of entirely relevant context preceding
Whahaaaahhahahaaahahhaahaaahahhaaaahhhaa!! (Score:2)
Seriously. It is like asking somebody wich series of Star Trek is the best, wich editor they like, wich news source is the most un-biased. Guess what? Everyone is going to give you a different answer and they are all WRONG.
The reason is that it is subjective. Does the review of CPU X favor price over stability? Heat over speed? Linux drivers over optimized for windows?
Intel fans will say that intel is more stable and has better support. AMD fans will say theirs give better performance for less mone
Re:Anyone know of any honest review sites? (Score:3, Interesting)
Re:Anyone know of any honest review sites? (Score:2)
For example, if I'm buying a motherboard t
Re:Anyone know of any honest review sites? (Score:2)
Well you can trust my site, of course it's me telling you this, so I don't know if that invalidates the recommendation.
I created The Jem Report [thejemreport.com] as a safe haven for people who want to learn more about computers. I was so dissatisfied with the crappy reviews I saw on other sites that I felt I could do better writing my own. I also wanted to have forums that weren't regularly trolled and flamed by people who didn't hold themselves accountable for their own words.
I don't know if it's a "success" by any partic
Honest / Fair Reviews (Score:1)
When you say "honest review sites" the only way to truly judge if a site is honest or not is to follow its coverage over an extended period of time and see if the reviews match reality when you go out and buy a particular product.
At the risk of being repetitive, I've made some comments before about so-called "reviews" and so-called "review sites" that are really run by fanboys who spend most of their time trading/posting links to other fanboy sites. I'll leave it to the intelligence of the Slashdot reader
Brilliant! One that works (Score:5, Funny)
2) Post non-story to slashdot
3) PROFIT!!!
Excellent (Score:2, Insightful)
Re:Brilliant! One that works (Score:1, Insightful)
And as most of the people reading this far down haven't read the article yet I would like to say something:
Don't click on any adverts.
Re:Brilliant! One that works (Score:1)
This issue was discussed in another article recently.
Many sites charge by the number of banners shown, rather than the number of banners clicked on.
Abuse of Power Comes as no Surprise (Score:2)
CBS
I am appalled. (Score:5, Funny)
Google not a validation of data (Score:5, Insightful)
Re:Google not a validation of data (Score:5, Interesting)
The problem is that some (many, I think) people look at information found via Google as somehow having been vetted or approved by that organization. How many users even grasp that once they click on a link on a Google results page they are no longer even connected to Google? Google is primarily an index, not a repository (yes, I know they cache pages but they don't create or maintain that information.) The World Wide Web is the repository, and like most public receptacles it is largely full of crap.
Re:Google not a validation of data (Score:3, Insightful)
If the information covered by NDA can be found using google, then it might be safer to assume that writing about it/commenting might be ok. [though IANAL... so....]
Re:Google not a validation of data (Score:1)
A google search for the phrase "google not a validation of data" [google.com] returns Your search - "google not a validation of data" - did not match any documents.
Therefore:
a) It's never been said
which leads to:
b) This thread doesn'
The other way round (Score:3, Interesting)
Now imagine if we asked them to stop lying about SQL being relational...
It is an extrememly widespread practice. (Score:5, Informative)
You also go to parties afterwards and people get very drunk. You learn a lot more there
The things you learn are open secrets, all the vendors know what is going on, and all the writers and reporters do also. Some employees may not know thier bosses are not quite clean, but that is another issue.
I was talking to several DRAM vendors about benchmarking at CES, and was told, by name, and usually by several sources that certain web sites would not review a product without advertising dollars. In fact, advertising dollars could significantly skew the results of a review.
These were not offhand comments like 'we think that they don't like us', it was direct 'If we don't cough up the cash, they won't review us'. Several different sources in the DRAM and other industries told me similar things, and for the most part, 2 or 3 names kept coming up. No, I will not name them.
If you follow the hardware sites, you can pretty much pick up who is 'dirty'. When 5 sites review the same new video card, all with the same *yawn* benchmarks, and 4 get one result, and the 5th gets a different result, and praises the 'loser' in the commentary, what do you think is going on? I mean, it is rather obvious.
The flip side of it is I get accused of bias just about ever day. Other than it getting rather old, it is usually not worth commenting on. I get accused of loving AMD, loving Intel, and being a liberal weenie and a republican nazi over the same article.
The truth of the matter is I get what hardware I can from who I can, and write about it. I bitch out HP all the time for blatant management stupidity, but I can't recall ever reviewing one of their products badly. I buy a lot of them with my own money. Strangely, they won't talk to me.
I also review a lot of AMD gear, and almost no Intel stuff. Why? AMD sends me things when I ask, without any pain or hoops to jump through. Intel won't. I know they can, friends in the industry have intel sending truckloads of chips to them on offhand remarks. I would almost say they don't like me or want me near thier products. If I ever do get one, I will write about it fairly though, I think that is what they are afraid of.
Last but not least, I know at least 3 of The Inq writers, me included, have been offered money to do something, or not do something. All the ones that I have heard of turned them down. At CES in January, a vendor who I know and like tried to hand me a wad of bills. I (politely) turned him down, even though it was probably more money than I had seen in a month, and it would have made the difference between another day of dollar menu items and water, and the not totally cheap buffets in vegas. Others have been offered 6 digits to do things. Personally, I don't know why he turned that one down.
What it all comes down to is ethics. Once yousell out, you are done. How can you trust them ever again? Easy you can't. That is why I turned down the money, and why the site puts reporting first. If it were any other way, I would be gone.
Other sites make other decisions, and they quickly get the reputations that they deserve. The community knows, and if you look closely, you can pick out who is clean fairly easily, it isn't all that hard.
-Charlie
Re:It is an extrememly widespread practice. (Score:2)
Re:It is an extrememly widespread practice. (Score:2)
Are you the one we have to blame for that moronic "Double your hard drive space" story just a short while back?
ATI does the same (Score:2, Informative)
The issue arose when ATI failed to offer support for MS's XP-Media Center Edition (MCE) until more than 2 years after the rest of the tuner vendors did so.
In Oct 2003, ATI announced "support" for MCE in 2 ways: a "hardware encoder" card, the eHomeWonder, and drivers for existing AIW cards, called "Encode", a software MPEG encoder.
A public Beta was started with just 15 members, and the performance of Encode was abyssmal, if it ran at all.
Public discussion ensued at
Tom's Hardware & Deathstars (Score:1, Informative)
IBM's GXP Deathstar hard drives [slashdot.org], as
When the news first broke [techreport.com] on these drives, some [techreport.com] tech sites [storagereview.com] came out [viahardware.com] with the news, and others [tomshardware.com] kept fairly silent. Silence isn't a crime. But continuing to use Deathstars in review gear should be. Why? Because some readers, myself included, u
Re:Pre-emptive anti-slashdotting (Score:4, Informative)
Change your content, or else: Manufacturer's demanding content changes is nothing new in the tech site community. We take a look at this topic, including one very public example that started in the past three weeks.
Date: March 15, 2004
Manufacturer: N/A
Written By: Hubert Wong
Just under a year ago, we provided some insight on the inner workings of running a tech site [slashdot.org]. Yes, there are thousands of sites out there, and despite the diversity, there are several constants in our universe... costs, advertising, readership, and most important of all, integrity.
Running a site, especially a tech site, isn't free and there are plenty of costs involved. Everything from the hardware purchases (not everything is free, which is a general misconception I think), to the server and bandwidth... it all has a price.
This is where advertising comes in. If the site is lucky enough, advertising will net a nice income each month, but for a greater number of owners, they'll be lucky if it helps them break even.
Of course, an advertiser is not going to consider a site that doesn't meet their traffic requirements. Readership is what makes our world go round. Without our loyal readers, VL wouldn't be where it is today, and I would say that the same goes for the majority of sites out there.
Casual readers come and go, but a loyal reader is somebody that means a lot to a site. It's common knowledge that most sites track their traffic. This gives us an idea of trends, and how to cater our content. We're not too concerned about our uniques a day, but rather our bookmarks and returns. People who bookmark and/or return multiple times a day make up a site's readership. Uniques are new visitors who either stop and go, or decide to stay. What turns a unique visitor into a regular reader? Content? Yes. Attention to detail? Sure thing. Integrity? Nobody likes a site that lies about a product just to suck up, right?
Granted, the last point isn't something that is respected by a great number of sites (the actual number is more than you think), but the site's I do frequent on a regular basis (Ed. Note: Including our own :D) do try hard to stick with their journalistic integrity.
There are instances though where manufacturers will try to influence
a site's review. Sadly, this happens quite often, and it becomes
a problem when this influence attempts to change a
writer's perception of the product. This is something site owners
need to deal with constantly, and yes, here at VL we've been asked
to have a change of heart on more than one occasion.
Errors or omissions happen, and we're more than happy to make
amendments, but as a reader, you can rest assured knowing we'll
never mislead you because somebody asked us to so they can improve
sales.
Luckily, most Tier-1 manufacturers; i.e., the ones who have a good amount of exposure within the enthusiast community, do respect a journalist's right for free speech. Sure, even some of the big dogs take issue with what we in the community say, but that's the price of exposing yourself with press releases. Whether a product is released and performs less than expected, or if it
Complete and utter apologist bollocks..... (Score:1)
By definition advertising is the process of trying to convince someone to buy something they neither want nor need, and this becomes ever more true as time passes.
If I want to know about something my first port of call is google or vivissimo, I do not either NEED or WANT some dickless wonder trying to pre-empt this process by trying to influence me with their own horri
Re:Complete and utter apologist bollocks..... (Score:1)
You were going to post out of AC, but you didn't.
You have absolutely ZERO evidence of ANY kind to even HINT that I might be wacko.
So, quite simply, you are an anonymous coward.
nuff sed.