Draginol Draginol

Conspiracy and game reviews

Conspiracy and game reviews

What constitutes a fair review?

I don't like negative reviews of things I make. And no matter how far into the fetal position they put me, there's really nothing that can be done except hope that your product or service is good enough that, on the balance, users and reviewers will respond favorably.

The reviews on Galactic Civilizations II have been very positive overall. But we also got our share of reviews that I either wasn't happy with or felt were unfair.  But what can one really do?  In my case, if I felt a review was unfair and was able to document specific examples in the review or put together some other coherent argument as to why the revie was unfair, I'd contact the review site/magazine/whatever.

But one thing that must be done with great care -- don't attack the integrity of the reviewer or magazine publicly, because that's a lose-lose situation.

The average GalCiv II review was roughly a 4.5 out of 5.  But at the outter edges there were two reviews that were under 3.5 out of 5.  Conspiracy? No.  Were they fair reviews? Impossible to say.

Recently there was a hub-bub between the company that makes Sword of the Stars and Tom Chick.  Back in 2005, Tom was contracted for a lump sum to help write the Galactic Civilizations II manual since Tom had spent the last 4,000 years ribbing me for how craptacular our user manuals were.  Roughly a year later, Chick, as one of the best known reviewers in the industry, gave a negative review to Sword of the Stars. Kerebos, the game's developer felt there was a conflict of interest.

Maybe I'm jaded but I just don't see it.  That would be like me saying that because we spent hundreds of thousands of dollars with PC Gamer (or CGW or whatever) in advertising that PC Gamer that they should knock down similar games.

From a purely business point of view, games don't compete in the sense they do in other markets. That is, a person who likes GalCiv II is likely to give Sword of the Stars or Space Empires V a serious look at. Buying GalCiv doesn't preclude a purchase of other games that are in the same remotely similar genre. 

More to the point - when it's time to put a product on retail, the # of units they'll take is largely defined by how well other games that are similar did. 

Ever sell a house? It's a lot like that.  You WANT your neighbors who sell their houses to get as much money as possible because that sets up how much you are likely to make selling yours.  If other houses do poorly on the market, it affects you. 

It's not commonly known but one of the beta testers for Galactic Civilizations II was Soren Johnson (designer of Civilization IV).  Some of the features GalCiv II has in common with Civ IV came form Soren's suggestions.  The point being, game developers usually see themselves on the same team. We want Civ IV to succeed and they wanted GalCiv II to succeed.  Similarly, we want Sword of the Stars to succeed and we want Space Empires V to succeed.

So while it is frustrating when your baby gets a negative review, it's never a good idea to impugne the character or reputation of the person doing the review.  I've written my share of frustrated emails but they've always focused on either the review or that the reviewer's perspective came across as someone who just doesn't normally like the type of game they were reviewing (i.e. a first person shooter guy getting assigned to write a 4X strategy game and saying it's "boring" and giving it a low score).

Sometimes it may not seem this way but we developers are on the same side.  We want other games to succeed.  Moreover, the best known reviewers may not always agree with us on our games but they do have a high degree of integrity in my experience.

51,735 views 34 replies
Reply #26 Top
Weatehr there was a conflict or not is not up to me. I cannot know a person's true motives. However, I do feel the review was rubbish. I could not agree with it and reading it made me angry. I got a feeling he didn't play the game enough. But whatever, that's old news now.
Reply #27 Top
Maybe I'm late to the game on this topic, but I just read all the reviews, the comments on the CGW boards, etc., and came away with the following impressions:

1. Sure it's a potential conflict. Games in general -- but strategy games in particular demand a great deal of our time, and we make choices about which ones to play. I'm playing GalCiv2 and not SotS, in part because of reviews.

I work in the publishing industry, and we deal with the appearance of conflict through the use of a disclaimer, disclosing the potential conflict, which must have been anticipated given the degree of discussion that Chick implies went on prior to the review. In this case, a disclaimer might have followed the review, and been worded as follows:

"Reviewer Tom Chick is a freelance writer credited with authorship of the manual for Galactic Civilizations II, a competing title. There is no link between his compensation and the success or failure of any reveiwed title."

2. Even given the potential conflict, I trust Tom Chick's reviews as much as ever, and when I'm making decisions about which games to play, I always look for his reviews for their insight and the quality of his writing.

I'll go so far as to say that I'd love to read Tom Chick review of GalCiv2 -- I still believe he could offer an honest opinion on what they got right and what they got wrong. Just lay it all on the table, and your integrity will never be questioned, particularly when you're as good at what you do as Tom is.
Reply #28 Top
Just lay it all on the table, and your integrity will never be questioned

unless he posts on joeuser, then that's all people will do, lol

Reply #29 Top
I agree with Dano. the Kerberos crew are extremely nice. I have read several of the SotS reviews and i find most of them to be total crap. Most of the "flaws" they found came from not spending time to learn the game. I admit the first time i played the game I was rather put off. But over a little time it did grow on me and now I love it. also the few things that are wrong with it should be fixed in the upcoming patch, and future expansion. Frogboy, I truly appreciate how civil you are about this.

The lead designer for SotS is nice, if a bit..... outspoken. Yes the first few posts of his i read he came off as a jerk, i almost didnt buy the game because of that. After sticking around the forums for a bit I learned that he didnt mean to come off as a jerk he just didnt put up with a bunch of people telling him that his game was total crap. he may not be as polite as Frogboy, but he is just as devoted to the game and its community.
Reply #30 Top
Ever sell a house? It's a lot like that. You WANT your neighbors who sell their houses to get as much money as possible because that sets up how much you are likely to make selling yours. If other houses do poorly on the market, it affects you.


I suppose that a lot of the time the industry works that way, but there are certainly exceptions. For example, Galciv was definitely able to capitalize on MoO3's shortcomings.
Reply #31 Top

I suppose that a lot of the time the industry works that way, but there are certainly exceptions. For example, Galciv was definitely able to capitalize on MoO3's shortcomings.

Certainly but on the other hand, MOO 3 came with GalCiv flyers in them which we got in exchange for delaying our release to help them.

Reply #32 Top
Ever sell a house? It's a lot like that. You WANT your neighbors who sell their houses to get as much money as possible because that sets up how much you are likely to make selling yours. If other houses do poorly on the market, it affects you.


I suppose that a lot of the time the industry works that way, but there are certainly exceptions. For example, Galciv was definitely able to capitalize on MoO3's shortcomings.


Moo3 actually sold alot of copies (unless my memory really has had it). There was alot of slow building hype and expectation, loads of pre-orders. You could argue that Moo3 shifting all those copies generating interest in the genre. Once people actually played it we were (nearly) all disapointed and wanted to play the game that Moo3 failed to deliver.

And whats this in the box? An advert for GC1. Maybe this is the one...

So by virtue of Moo3 selling copies interest in galciv went up. Much like the housing analogy. The fact we were all giving up and moving on from Moo3 early also put us in the market to buy another title - and why not be GalCiv?

Of course alot of people returned Moo3 for refunds, but it did sell the copies in the first place.
Reply #33 Top
I can honestly say that I would be VERY happy to see Sword of the Stars and Space Empires V be HUUUGE hits. I'd love to see them sell a million copies. Because if they do, it makes it much easier to get shelf space for the next strategy game.
Reply #34 Top
I support you guys on this one. The charge that Tom Chick is part of a conspiracy against Sword of the Stars is laughable - I can easily see how the market would reinforce itself based on the success of other games. After buying Galactic Civilizations II, I became interested in other strategy games, which led me to purchase Civilization 4 and Railroad Tycoon - games I never would have considered if I hadn't already seen how great the genre was.

And, by the way, you have an estimate as to how large the market is for space-based strategy games? (for instance, what percentage of the total gaming market it comprises, or how many copies of all the games in the genre are sold each year) I'd be interested to know, if you have such figures on-hand.