Skip to comments.Why Do You Believe Consumer Reports?
Posted on 04/06/2011 2:41:32 PM PDT by Swordmaker
Just this week, Consumer Reports posted an online review covering the iPad 2, and a small number of also-rans in the tablet PC world. This report was meant as an upgrade to an article that appeared in the May 2011 newsstand issue, which was prepared before the iPad 2 was available to evaluate.
The conclusion was predictable. The iPad 2 gets an excellent rating in nearly every category. Curiously, the original iPad was placed in a tie with the Motorola Xoom, though heaven knows why. Well, at least CR didnt find any bogus antenna issue with which to downgrade Apples iconic gadget, but they arent entitled to much more credit than that, simply because they still havent a clue how to properly review products of this sort.
They have, for example, an ephemeral ease of use category, but they dont really explain the criteria for such ratings. If they were really paying attention, it would seem highly questionable for the Xoom to rate very highly because, if you consider what you can do with this gadget, it barely rates a xero make that a zero.
You see, you can rate CPU and graphics performance, and whether the interface is snappy or not. You can certainly judge the features, such as onboard cameras, or, in the case of the original iPad, the lack thereof. You might also look at accessory ports, such as an SD card slot, or an HDMI port, neither of which Apple incorporates, even though they offer convenient and relatively low-cost adapters for both.
But none of this matters if there are no apps to run. Apple has over 65,000 specifically designed to run on an iPad. In contrast, the Motorola Xoom, which uses Android 3.0, or Honeycomb, has a few dozen.
As a result, the argument is over. Your usability options on a Xoom, or any other Android-based tablet, are extremely limited, unless you want to stick with regular smartphone apps, which look horrible when blown up to the full size of the display.
Other Android tablets, using older versions of the OS, are in worse shape. Those products are dead ends, because they werent designed with tablets in mind, and new apps will never be compatible. Thats their fault for not paying attention to Google. This, along with the growing and irritating fragmentation issue, are the reasons that Google is asserting greater control over the ways licensees can fiddle with the interface and bundled software. Indeed, they are also holding off on releasing the source code, with no definite date as to when it might be available.
Unfortunately, CR doesnt grok any of this. They seem utterly unable to judge these products on the basis of real usability, which means having enough apps to actually afford a choice of what to do beyond email, Internet access, and access to your favorite social network. Indeed, one of the reasons that the Mac was denigrated early on was the myth that very few applications were available for that platform. In that case, it wasnt true for the most part, except for certain vertical applications for business consumers that were only available on Windows.
When it comes to an Android 3.0 tablet, the situation is dreadful, utterly dreadful. Worse, app developers arent going to have much of an incentive to build apps for the Xoom and its ilk, simply because the iPad has swamped the marketplace. Developers who want to make money know which platform is best.
Understand that CRs editors are entitled to their opinions, and they even entitled to publish highly flawed reviews that fail to address the needs of the end user. Rather, Im concerned why the media, tech, mainstream and elsewhere, largely accepts CRs word as gospel. The vast, vast majority of articles about their reviews are not critical. They never consider whether or not the magazine is using poorly conceived testing methods.
I can see where manufacturers might avoid public criticism, simply because it will sound like sour grapes. Indeed, when it comes to auto testing, CR has it right when handling tests revealed certain vehicles nearly tipping over or swerving out of control in extreme handling tests. While CR was once sued by an auto maker over this issue, more recently Toyota promptly responded to a reported handling flaw by rejiggering the onboard software so the electronic stability control would kick in faster. But you wonder why they never noticed during the product design phase.
When it comes to consumer electronics gear, Apple didnt suffer in any noticeable way because the two flavors of the iPhone 4 werent recommended, based on that alleged Death Grip. Certainly, if there was an ounce of evidence that sales might be hurt, Im quite sure Apple would have gotten ahold of CR in order to set them straight. Certainly what CR reports flies in the face of Apples tests, once posted online, and still mirrored all over the globe, not to mention blogs populated with antenna experts, and all those people who posted YouTube videos demonstrating that antenna sensitivity issues can be duplicated on many smartphones. Im most troubled, however, that CR doesnt seem to know about warning labels, and those cautions in user manuals about the unsavory impact of holding a mobile handset the wrong way.
Or maybe their test team doesnt believe in reading manuals. While I realize consumers dont either, a magazine that prides itself on thorough and balanced product testing ought to know better.
I'd love to see how long you can watch a movie that way.
“Not even Mercedes can crack their top 10.”
And they usually rate BMW highly.
My personal experience tracked CR exactly for Mercedes, with an extremely unreliable ML20.
The old iPhones don't have a "little gap on the edge of the phone" that will cause calls to drop. The antenna is inside the phone, behind the plastic back. If this has been going on for longer than two years, it is some other issue that I have never seen reported by anyone else.
2. All of the service would have been on AT&T, which is really crappy in San Antonio
My best guess is that there were a lot of dropped calls because the coverage sucked, and the mythical little gap became a folkloric explanation. Data is not the plural of anecdote.
As far as the all cel phones do this argument - the answer is no they don't.
All cell phones exhibit signal attenuation if you cover the antenna. If the phone is brick-like, you're less likely to see it because your hand simply can't get close to the antenna. On any phone, including the iPhone, the signal attenuation is only noticeable, only results in dropped calls or slow data transfers, if the signal was already marginal.
Not just CR, but almost all car reviewers purposely obscure real safety data, comparing cars to other similar cars instead of to real-life situations.
If CR seems to shill for the Japanese, it sure seems like Motor Trend shills for General Motors. CR lately seems to favor Fords! Probably it reflects the biases of individuals hired rather than editorially.
CR does indeed admit that most cars are very reliable compared to 20 years ago and notes that buyers know this too.
My wish is that Car&Driver, a mag that I trust, would include reliability info in their reviews. The vaunted BWM 7-Series, for example, is a work of art, but the few folks I know who own them are furious at the frequency and expense of unexpected problems. Prospective buyers would want to know that.
Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.