How do you rate?

5starsbig

The "5 Star" rating system is pretty standard when it comes to rating most products and services on most sites. The sites I frequent the most and look for these ratings are Amazon.com, Apple's App Store/iTunes and Netflix. However, ratings alone don't tell the whole story. 

 

Don't judge an App by its rating alone

I recommended an app to a friend and later found out that he didn't get it because it only had a 3 star rating. After we talked and I explained to him that you can't go by the rating alone. What I told him was that you have to consider the fact that not everyone uses the same criteria when rating something. For example, the App Store's rating system was severely flawed at first because back when it first started you could rate an App that you had never actually installed or tried. In many cases people were rating Apps "1 Star" because they didn't like the price or it wasn't compatible with the touch or for some other reason that really didn't tell you anything about the App itself. Apple did fix that and now you can't rate an App unless you have at least downloaded it. However, the App Store's rating system is still far from perfect. I'd give it a 3 star rating (just kidding). There are a couple of potential problems that still exist. There are ratings and there are reviews and ratings. If you look at an App that you downloaded in the App Store on your iPhone or iPod touch you can "Review it" and of course give it a rating. If you go to your computer and look at that same App in iTunes on the iTunes Store, you can EITHER Rate it or Review and Rate it. So this means that you can give an App a 1 Star rating with no explanation what so ever.

Rate upon deletion

Let's go back to your iPhone or iPod touch for a moment. If you delete an App right on the device itself, a dialog pops up and gives you the chance to rate the App you've just deleted. I'm going to go out on a limb here and guess that Apps that are rated during a delete process probably rarely receive a 5 star rating. How often are you deleting Apps that work perfectly that you absolutely love? So this again only tells one side of the story. Also there is no opportunity here to say why you're giving it the rating you're giving it or why you're deleting it? The people that have apps installed that love them aren't prompted at any point with a "hey we notice that you use this app a lot, would you like to rate it?" message. People that are happy don't tend to seek out a way to tell anyone. However, people that are unhappy tend to want to tell EVERYONE! For this "Rate upon deletion" feature to be fair, their should be a parallel feature that pops up the same dialog box say after you've used an app 25 times. "We noticed that you use this app a lot. Would you like to rate it?" The user of course would have the option to turn the feature off, but turning it off would turn off BOTH popups. No longer would you see the dialog when you delete an app either.

 

Reviews on Amazon.com

Usually before I buy something that I don't know much about, I turn to Amazon.com to see what others are saying about it? Once again the ratings don't tell me everything. I'm more interested in the reviews. Also I usually go for the negative reviews first and here's why: I'm already prepared to like the item. If I've done any research at all, I've usually figured out that this is something that I'm going to want. So I'm really just trying to see if there are any major problems with it. Does it have a high failure rate? Does it not work as advertised? I tend to ignore rants about pricing, delivery times, etc. because again the people that didn't feel like it costs too much or got it in a timely manner aren't usually posting reviews to say that. I look at what people "don't like about it" and decide for myself if those things are of any concern to me or not? So even if something on Amazon has a 2.5" star rating that doesn't necessarily mean that I'm going to not buy it. However, if a ton of people say the same thing about it breaking easily or falling apart or some other bad thing and it seems consistent, then I will really think twice (or three times) before buying.

Unfortunately, people can rate things on Amazon without actually owning them. Even my on iPhone Book 3rd Edition got a 1 star rating a while back from a guy  who admitted that he didn't actually own the book and had not seen a single page of it. He rated the book 1 star solely because he didn't like the sample chapter that is automatically generated for Kindle users to download for free. A sample that the author (me) has no control over. He didn't like it because the sample didn't actually contain any of the content of the book. It was things like the acknowledgements, introduction, etc. However, someone looking to buy the book and judging it by the rating alone might think twice before buying it.

 

Another example here of a 2 star rating and review by someone who did NOT buy Joe McNally's "The Hot Shoe Diaries: Big Light from Small Flashes" because he didn't like the cover. 

hotshowreview

It's OK that he didn't like the cover and therefore exercised his right in not buying it, but to be able to rate and review something that you admittedly don't even own is just not right! By the way, Joe's book has an average rating of 4.5 stars with 110 5 star ratings!

 

Ratings on Netflix

Angels & Demons on Netflix and yes, I'd give it a 4!

In the case of a movie, I'm usually the opposite. That means that I could really care less about the reviews and honestly I take the rating a little more into account. Netflix seems to do a better job in comparing ratings of people with similar movie tastes. So chances are if I see a movie with a 3 star rating or less, I'm not going to like it. Sometimes I've ignored the 3 star rating and added the movie to my queue anyway only to be disappointed and kick myself after watching it. So unless it's something that I KNOW that I'm really going to like, I'll typically avoid movies with low ratings on Netflix.

In case you were wondering, yes I'd give Angels & Demons a 4! 

 

How do you rate?

So that brings me back to the whole star rating thing and I'm curious how do you rate? Before you sound off in the comments below, let me give my formula for each category:

5stars

5 Stars – It's as close to perfect as it can be. Nothing is perfect and no matter how much I love a product, I can usually and pretty easily give you a list of things that I would like to see it do or have or change. But If I give it 5 stars that is the ultimate compliment and I'm quite happy with it. In the case of a movie, it's the kind of movie that I could immediately watch again. I liked it that much! It's also a candidate for one I'd want to buy on Blu-ray.

4stars

4 Stars – It's a really good product and works as advertised (this will be the norm). However, it's missing one or more things that would really take it to the next level. Or perhaps if it had a slight interface tweak it would earn the 5th star.  Nonetheless I like it. In the case of a movie, I really enjoyed it. I was entertained. I'd recommend it to a friend, but it's probably a movie that I won't watch again. I'm good!

3stars

3 Stars – It's OK! It kinda works. There are several things that I would like to see added or changed, but it does work. In the case of a movie, it was barely OK. I'm not going to recommend it again and I wish it had ended sooner.

2stars

2 Stars – This product has several problems. I wouldn't review it here (unless I was asked to by the manufacturer)  because I wouldn't be able to say very many good things about it and I wouldn't want to waste your time. I'm probably looking to return it. The only reason I would keep it is because I need to do what it does and there was no other alternative. In the case of a movie, it sucked! I barely got through it and I was checking my email several times while it was playing. 

1star

1 Star – The product should have never been shipped in its current state. The book should have never been written/printed. It's got MAJOR flaws and bugs and is pretty much unusable. It does NOT work as advertised. I'm demanding my money back. In the case of a movie, I walked out or turned it off. My time was more valuable to me than finishing it. I'm sorry that I paid to watch it or rented it. The Hitchhiker's Guide to the Galaxy comes to mind 🙂 I can probably count on one hand the number of times that I've rated something 1 Star. 

 

The Bottom Line

While I've shared my way of rating with you, the problem is not everyone rates the same way. So you have to go beyond ratings and dig a little deeper. I've seen some of the silliest reasons for giving a product a 1 star or even a 5 star rating. When it comes to the App store, the 3 star rating has become the new 4 star rating as far as I'm concerned. So how do you rate?