Free Republic
Browse · Search
General/Chat
Topics · Post Article

Skip to comments.

Why Do You Believe Consumer Reports?
Technical NightOwl ^ | April 6th, 2011 | Gene Steinberg

Posted on 04/06/2011 2:41:32 PM PDT by Swordmaker

Just this week, Consumer Reports posted an online review covering the iPad 2, and a small number of also-rans in the tablet PC world. This report was meant as an upgrade to an article that appeared in the May 2011 newsstand issue, which was prepared before the iPad 2 was available to evaluate.

The conclusion was predictable. The iPad 2 gets an “excellent” rating in nearly every category. Curiously, the original iPad was placed in a tie with the Motorola Xoom, though heaven knows why. Well, at least CR didn’t find any bogus antenna issue with which to downgrade Apple’s iconic gadget, but they aren’t entitled to much more credit than that, simply because they still haven’t a clue how to properly review products of this sort.

They have, for example, an ephemeral “ease of use” category, but they don’t really explain the criteria for such ratings. If they were really paying attention, it would seem highly questionable for the Xoom to rate very highly because, if you consider what you can do with this gadget, it barely rates a xero — make that a zero.

You see, you can rate CPU and graphics performance, and whether the interface is snappy or not. You can certainly judge the features, such as onboard cameras, or, in the case of the original iPad, the lack thereof. You might also look at accessory ports, such as an SD card slot, or an HDMI port, neither of which Apple incorporates, even though they offer convenient and relatively low-cost adapters for both.

But none of this matters if there are no apps to run. Apple has over 65,000 specifically designed to run on an iPad. In contrast, the Motorola Xoom, which uses Android 3.0, or Honeycomb, has a few dozen.

As a result, the argument is over. Your usability options on a Xoom, or any other Android-based tablet, are extremely limited, unless you want to stick with regular smartphone apps, which look horrible when blown up to the full size of the display.

Other Android tablets, using older versions of the OS, are in worse shape. Those products are dead ends, because they weren’t designed with tablets in mind, and new apps will never be compatible. That’s their fault for not paying attention to Google. This, along with the growing and irritating fragmentation issue, are the reasons that Google is asserting greater control over the ways licensees can fiddle with the interface and bundled software. Indeed, they are also holding off on releasing the source code, with no definite date as to when it might be available.

Unfortunately, CR doesn’t grok any of this. They seem utterly unable to judge these products on the basis of real usability, which means having enough apps to actually afford a choice of what to do beyond email, Internet access, and access to your favorite social network. Indeed, one of the reasons that the Mac was denigrated early on was the myth that very few applications were available for that platform. In that case, it wasn’t true for the most part, except for certain vertical applications for business consumers that were only available on Windows.

When it comes to an Android 3.0 tablet, the situation is dreadful, utterly dreadful. Worse, app developers aren’t going to have much of an incentive to build apps for the Xoom and its ilk, simply because the iPad has swamped the marketplace. Developers who want to make money know which platform is best.

Understand that CR’s editors are entitled to their opinions, and they even entitled to publish highly flawed reviews that fail to address the needs of the end user. Rather, I’m concerned why the media, tech, mainstream and elsewhere, largely accepts CR’s word as gospel. The vast, vast majority of articles about their reviews are not critical. They never consider whether or not the magazine is using poorly conceived testing methods.

I can see where manufacturers might avoid public criticism, simply because it will sound like sour grapes. Indeed, when it comes to auto testing, CR has it right when handling tests revealed certain vehicles nearly tipping over or swerving out of control in extreme handling tests. While CR was once sued by an auto maker over this issue, more recently Toyota promptly responded to a reported handling flaw by rejiggering the onboard software so the electronic stability control would kick in faster. But you wonder why they never noticed during the product design phase.

When it comes to consumer electronics gear, Apple didn’t suffer in any noticeable way because the two flavors of the iPhone 4 weren’t recommended, based on that alleged “Death Grip.” Certainly, if there was an ounce of evidence that sales might be hurt, I’m quite sure Apple would have gotten ahold of CR in order to set them straight. Certainly what CR reports flies in the face of Apple’s tests, once posted online, and still mirrored all over the globe, not to mention blogs populated with antenna experts, and all those people who posted YouTube videos demonstrating that antenna sensitivity issues can be duplicated on many smartphones. I’m most troubled, however, that CR doesn’t seem to know about warning labels, and those cautions in user manuals about the unsavory impact of holding a mobile handset the wrong way.

Or maybe their test team doesn’t believe in reading manuals. While I realize consumers don’t either, a magazine that prides itself on thorough and balanced product testing ought to know better.


TOPICS: Business/Economy; Computers/Internet
KEYWORDS:
Navigation: use the links below to view more comments.
first previous 1-2021-4041-48 last
To: Echo4C
both are currently accessible using PlayOn thanks to another feature iOS doesn’t support - Flash.

I'd love to see how long you can watch a movie that way.

41 posted on 04/07/2011 3:05:47 PM PDT by antiRepublicrat
[ Post Reply | Private Reply | To 34 | View Replies]

To: I cannot think of a name
As far as the all cel phones do this argument - the answer is no they don’t.

Sigh. Yes, they do. Stop spreading bullsh!t. You look like an idiot.
42 posted on 04/07/2011 6:19:04 PM PDT by Terpfen (Buh-bye, Suntan Charlie.)
[ Post Reply | Private Reply | To 40 | View Replies]

To: truthguy

“Not even Mercedes can crack their top 10.”

And they usually rate BMW highly.

My personal experience tracked CR exactly for Mercedes, with an extremely unreliable ML20.


43 posted on 04/07/2011 6:29:30 PM PDT by truth_seeker
[ Post Reply | Private Reply | To 5 | View Replies]

To: I cannot think of a name
1. This has been going on for at least two years, so it must be a mixture of old and new iPhones. To be honest, neither of us could tell an old iPhone from a new iPhone.

The old iPhones don't have a "little gap on the edge of the phone" that will cause calls to drop. The antenna is inside the phone, behind the plastic back. If this has been going on for longer than two years, it is some other issue that I have never seen reported by anyone else.

2. All of the service would have been on AT&T, which is really crappy in San Antonio

My best guess is that there were a lot of dropped calls because the coverage sucked, and the mythical little gap became a folkloric explanation. Data is not the plural of anecdote.

As far as the all cel phones do this argument - the answer is no they don't.

All cell phones exhibit signal attenuation if you cover the antenna. If the phone is brick-like, you're less likely to see it because your hand simply can't get close to the antenna. On any phone, including the iPhone, the signal attenuation is only noticeable, only results in dropped calls or slow data transfers, if the signal was already marginal.

44 posted on 04/07/2011 7:00:03 PM PDT by ReignOfError
[ Post Reply | Private Reply | To 40 | View Replies]

To: jjotto
Trouble is, very few car review sources take reliability into account other than Consumer Reports.

Yeah, they have something called "predicted reliability". What a FN joke. US cars have been every bit as reliable as imports over the past 10 years or so. Before that maybe not so much. My Dodge Dakota 2001 has 140K miles with no problems. Great reliability.

CRs methodology is crap, plain and simple. There ratings are so different in every category than Motor Trend, Car and Driver, Road and Track, and a bunch of others. Explain to me how and why CR is so different. How can the Japanese have just about every place in the top 10 in every category? Impossible. CR is a shill for them. That's why. Plus CR simply doesn't factor safety into their ratings. US cars are the best for safety except for the very expensive European cars, but they get no credit for this from CR.

Everyone in the auto industry knows about how horrible CR is. They should stick to Refrigerators, Toasters, and the like. But they probably suck at that as well.
45 posted on 04/07/2011 7:12:10 PM PDT by truthguy (Good intentions are not enough.)
[ Post Reply | Private Reply | To 21 | View Replies]

To: jjotto
I could post 50 articles like this about CR if I wanted, but here's a good one.

Don't trust CR
46 posted on 04/07/2011 7:34:27 PM PDT by truthguy (Good intentions are not enough.)
[ Post Reply | Private Reply | To 21 | View Replies]

To: jjotto
I could post 50 articles like this about CR if I wanted, but here's a good one.

Don't trust CR
47 posted on 04/07/2011 7:36:51 PM PDT by truthguy (Good intentions are not enough.)
[ Post Reply | Private Reply | To 21 | View Replies]

To: truthguy

Not just CR, but almost all car reviewers purposely obscure real safety data, comparing cars to other similar cars instead of to real-life situations.

If CR seems to shill for the Japanese, it sure seems like Motor Trend shills for General Motors. CR lately seems to favor Fords! Probably it reflects the biases of individuals hired rather than editorially.

CR does indeed admit that most cars are very reliable compared to 20 years ago and notes that buyers know this too.

My wish is that Car&Driver, a mag that I trust, would include reliability info in their reviews. The vaunted BWM 7-Series, for example, is a work of art, but the few folks I know who own them are furious at the frequency and expense of unexpected problems. Prospective buyers would want to know that.


48 posted on 04/08/2011 1:14:59 PM PDT by jjotto ("Ya could look it up!")
[ Post Reply | Private Reply | To 45 | View Replies]


Navigation: use the links below to view more comments.
first previous 1-2021-4041-48 last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
General/Chat
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson