Conspiracy and game reviews

What constitutes a fair review?

I don't like negative reviews of things I make. And no matter how far into the fetal position they put me, there's really nothing that can be done except hope that your product or service is good enough that, on the balance, users and reviewers will respond favorably.

The reviews on Galactic Civilizations II have been very positive overall. But we also got our share of reviews that I either wasn't happy with or felt were unfair.  But what can one really do?  In my case, if I felt a review was unfair and was able to document specific examples in the review or put together some other coherent argument as to why the revie was unfair, I'd contact the review site/magazine/whatever.

But one thing that must be done with great care -- don't attack the integrity of the reviewer or magazine publicly, because that's a lose-lose situation.

The average GalCiv II review was roughly a 4.5 out of 5.  But at the outter edges there were two reviews that were under 3.5 out of 5.  Conspiracy? No.  Were they fair reviews? Impossible to say.

Recently there was a hub-bub between the company that makes Sword of the Stars and Tom Chick.  Back in 2005, Tom was contracted for a lump sum to help write the Galactic Civilizations II manual since Tom had spent the last 4,000 years ribbing me for how craptacular our user manuals were.  Roughly a year later, Chick, as one of the best known reviewers in the industry, gave a negative review to Sword of the Stars. Kerebos, the game's developer felt there was a conflict of interest.

Maybe I'm jaded but I just don't see it.  That would be like me saying that because we spent hundreds of thousands of dollars with PC Gamer (or CGW or whatever) in advertising that PC Gamer that they should knock down similar games.

From a purely business point of view, games don't compete in the sense they do in other markets. That is, a person who likes GalCiv II is likely to give Sword of the Stars or Space Empires V a serious look at. Buying GalCiv doesn't preclude a purchase of other games that are in the same remotely similar genre. 

More to the point - when it's time to put a product on retail, the # of units they'll take is largely defined by how well other games that are similar did. 

Ever sell a house? It's a lot like that.  You WANT your neighbors who sell their houses to get as much money as possible because that sets up how much you are likely to make selling yours.  If other houses do poorly on the market, it affects you. 

It's not commonly known but one of the beta testers for Galactic Civilizations II was Soren Johnson (designer of Civilization IV).  Some of the features GalCiv II has in common with Civ IV came form Soren's suggestions.  The point being, game developers usually see themselves on the same team. We want Civ IV to succeed and they wanted GalCiv II to succeed.  Similarly, we want Sword of the Stars to succeed and we want Space Empires V to succeed.

So while it is frustrating when your baby gets a negative review, it's never a good idea to impugne the character or reputation of the person doing the review.  I've written my share of frustrated emails but they've always focused on either the review or that the reviewer's perspective came across as someone who just doesn't normally like the type of game they were reviewing (i.e. a first person shooter guy getting assigned to write a 4X strategy game and saying it's "boring" and giving it a low score).

Sometimes it may not seem this way but we developers are on the same side.  We want other games to succeed.  Moreover, the best known reviewers may not always agree with us on our games but they do have a high degree of integrity in my experience.

51,734 views 34 replies
Reply #1 Top
Hah! I knew Tom Chick couldnt be trusted! No really, I think the whole thing is just silly, but I doubt there is anything anyone can do or say except to just sit tight and ride out the storm. "Can't we all just get along?"
Reply #2 Top
Back in 2005, Tom was contracted for a lump sum to help write the Galactic Civilizations II manual since Tom had spent the last 4,000 years ribbing me for how craptacular our user manuals were. Roughly a year later, Chick, as one of the best known reviewers in the industry, gave a negative review to Sword of the Stars. Kerebos, the game's developer felt there was a conflict of interest.


I don't see there being a conflict of interest here either. If this was a conflict of interest, then the vast majority of people in the business world would be guilty of it.

Tom, avoiding reviewing Stardock products, where there might be a conflict of interests is more than enough.

Kerebos seem to be looking for someone to blame, perhaps a attempt to bash the 'perceived' competetion. Out of 20 reviews the game did not get over 80%, its a promising looking game but needs more work/depth to be a true classic.

The GC2 manual is very good, it gets all the necessary info. across in a easy to read manner and makes good use of tables, lists, screenshots to split the text up. I hope this controversy does not effect u employing him to work for u in the future.

Reply #3 Top
Kerebos seem to be looking for someone to blame, perhaps a attempt to bash the 'perceived' competetion. Out of 20 reviews the game did not get over 80%, its a promising looking game but needs more work/depth to be a true classic.


That's my impression as well (that Kerebos is looking for a scapegoat), which if at all true, would be silly in the extreme. No game has ever been brought down by a single bad review. Most people I know don't judge a game based on just one review--they base it on reading a lot of reviews, including ones by fellow gamers.

Sword of the Stars is no exception to this rule. It's garnered an average rating of around 70%, indicating it's a decent game, but there are definitely things it could do better. In fact, almost every single review of the game (at least that I've read) say something to the effect that SotS is overall quite fun and has great potential, but it has a few major flaws preventing it from becoming a benchmark/marquee title (such as GalCiv 2 or the first two MOO games). Tom Chick--regardless of any past or future work he has or will perform for Stardock--has nothing to do with how well the game turned out.
Reply #4 Top
Sword of the Stars was a great idea let down by a horrible interface. It wasn't awful, but I don't think the developers should go spreading blame for bad reviews on others when they were the ones who made it so clunky.
Reply #5 Top
Kerberos (see the spelling   ) are slightly paranoid. If you've been on their forums at the beginning you'd know what i mean. What's worse, i couldn't mention Sins of a solar empire on their forums...that subject was forbidden! (both teams used to work together before). Now that Stardock is publishing SoaE, They'll even see more conspiracies...

Now...maybe i'll be banned from their forums but i don't really care (not that i won't buy their game).
Reply #6 Top
by the way...said review seems to have been hacked as i cannot have access to it...

 
Reply #7 Top
Kerberos (see the spelling ) are slightly paranoid. If you've been on their forums at the beginning you'd know what i mean. What's worse, i couldn't mention Sins of a solar empire on their forums...that subject was forbidden! (both teams used to work together before). Now that Stardock is publishing SoaE, They'll even see more conspiracies...


So u r not allowed to mention other games on there forum?

Compare this to Stardock who not only allow other games to be discussed but join in the discussion with POSITIVE comments.

I have read Frogboy's and other members of the Stardock team comments on games in general and there have been 100% glowing in there praise of them. I presume if anyone at Stardock does not like a particular game they just avoid saying anything about it.

Well I do not agree with everything Frogboy says about games, I am grateful he steered me towards Dominions 3, which is a fantastic game.
Reply #8 Top
So if Miramax paid a movie reviewer thousands of dollars to write a screenplay, there would be no conflict of interest suspected when he gave the thumbs down to the next Paramount movie coming out opposite a Miramax film?

Buying Civilization IV would have precluded me from buying Galactic Civ, because I only have the time for one. The reviews for GCII were better. Better reviews for your opponent's games may increase the size of your market, but it will always reduce your market share. You might not go as far as to buy bad reviews for your competitors, but you'd be crazy to buy them good ones, right? But if their success really has only a positive effect on you, you wouldn't mind.
Reply #9 Top
Quite a few magazines link their opinions to certain products directly to the amount of advertisment space those companies buy. It is a sad fact, but it does happen. I'm certainly not saying this is what happened here but I can understand people being a little edgy about this whole thing.

Anyway, relying on a single review is not the best way to proceed and I found that out the hard way. The review said that the game was good although it suffered from a few minour bugs. The game was so rife with bugs, glitches and unimplemented features (for which they still advertised, though) that a few weeks after the game was released, major outlets set a precedent by offering a refund or a trade-in. By my knowledge no game was ever treated in such a fashion with stores using the 'you opened it, you bought it'-principle. It goes to show that a single reviewer can be way off course.
Reply #10 Top

So if Miramax paid a movie reviewer thousands of dollars to write a screenplay, there would be no conflict of interest suspected when he gave the thumbs down to the next Paramount movie coming out opposite a Miramax film?

Rogert Ebert wrote screenplays that became movies while also reviewing other movies.

Reply #11 Top
Media = propaganda.

Propaganda is the message of those who pay.
To those who will buy it.
So to say that those who will rate it.
Don't tell the message of those who sell it.
Is wrong.

I'm very sorry. About this.
It's the hype who kills the game.

And the saddest thing about it is, they can sell shit.
And sell it for plated gold. And it will be bought.
It's sad.
Reply #12 Top
Sounds like the makers of Sword of the Stars want some free publicity to me, and what better way to do that by getting the attention of all your customers. Sad.
Reply #13 Top
http://www.gamespot.com/pc/strategy/galacticcivilizations2/review.html?mode=web

You can see all the reviews there, it does seem like those two UK mags are much, much lower than everything else.
Reply #14 Top
Heh, according to Wikipedia Ebert's two film credits are Beyond the Valley of the Dolls (1970) and Beneath the Valley of the Ultra-Vixens, "a sexploitation satirical film starring Uschi Digart and Kitten Natividad written and directed by breast fetishist Russ Meyer." Valley of the Dolls was written very shortly after he started reviewing movies in 1967, but I hope Ebert included a disclaimer when reviewing any other breast fetish movies released in 1979!
Reply #15 Top
Hey, no one ever claimed he wrote GOOD movies!
Reply #16 Top
You know...quite frankly this doesn't surprise me at all. I didn't buy SOTS for one main reason: the devs were really, really unprofessional. They were mean and nasty to anyone who voiced any kind of negative opinion about their game on their forums. It disgusted me and I simply turned away. So to see this very visible "hub bub" to me isn't surprising--Kerberos lacks social skills and it's just hilarious that they screwed with Tom Chick.
Reply #17 Top
I BSed my way through enough papers in school on material I didn't read to recognize a faker. If you look hard at the reviewers in this industry you'll find that a good portion of them only haphazardly play the game before reviewing it, and most openly admit they don't play the game extensively first. Such folks are as of much value as movie reviewers that only watch a few minutes and then just rely on a synopsis of the plot to review it. It's a shame when games don't get the lauding they deserve because reviewers refuse to put in the 40 hours it takes to complete many of them.

Maybe that's why the graphics-fetishist ideal of game fandom has not been defeated. It's easy to review graphics. The meat of the game, the playability, the story, the game mechanics, all have to be played through to really understand. I would think someone who wrote the manual would be MORE qualified to write a review, because God knows most of the reviewers don't bother even reading the manual.

Reply #18 Top
To me the only reviews that count are ign and gamespot. Sometimes I've looked into a game solely because of their good grade and that I sort of might like the game.
Reply #19 Top
i can see the potential for a conflict of interest there. some people don't have the cash to buy multiple games. maybe someone can only buy 1 game a year or so,,,and they will probably go with the better reviewed game. to some hobbyists, or those with high levels of disposable income and time, maybe "trying out" a bunch of sim. games may be in the cards, but i don't think most people are that rich or "into it.." the real estate analogy really doesn't work for me. you may root for another house selling for a high dollar if you are not selling your house at the time, but if you are, that other house is competition. in your scenario, i see it as more of the same or sim. time, thus , it is competition. and every good marketer knows that most people's entertainment budgets are limited, so they want to position their entertainment product as "the purchase that has to be made 1st" because the consumer might not have the scratch to make it their second purchase.
Reply #20 Top
Agree with Sean's point that people tend to purchase the perceived #1 on the list, IMHO.

I worked part-time with a software developer focusing on a niche market, and we face a similar situation - even though we believe we have made the best product available on the planet, most consumers still go for the biggest brand's perceived #1, much inferior product.

Having said that, I think kerberos' reponse is pathetic. It makes them look immature and unprofessional. OTOH, I feel for them as I can imagine what kind of pressure (both financial and emotional) they must be facing with their not-so-good product.
Reply #21 Top
That would be like me saying that because we spent hundreds of thousands of dollars with PC Gamer (or CGW or whatever) in advertising that PC Gamer that they should knock down similar games.

by the way,,,this is the reason "consumer reports" magazine exists. because people see that conflict of interest between an advertiser and a product. i'm not saying that's right, wrong, good or bad, it just is.
Reply #22 Top
I have been on the SOTS forums a lot. I didn't find the Devs to be mean and nasty at all. Basically you got what you gave. I have seen TONS of posts that constructively criticized the game and the Devs answered with either a) Why they did what they did, or b) Said it was an interesting idea.

On the other hand if you went on and ranted about how the game was crap, and how the devs didn't know what they were doing etc, etc - then yeah - you got it with both barrels from the devs - and deservedly so. Same thing should happen on this board.

I have found the devs on the SOTS forums to be as active and honest in the forums as the devs here.

Dano

PS - I really like SOTS, and I agree with Frogboy that there is plenty of room for both games (they each approach the genre differently)
Reply #23 Top
was about to say the same dano, but you've put it in better words, so i'll just second you here   
Reply #24 Top
beg your pardon?
Reply #25 Top
Please ignore the spambot behind the curtain