Okay, as someone who’s going to have a game reviewed soon I’m going to do something really stupid: I’m going to post in this thread.
In my experience, game reviewers were pretty awful when I first started to experience game reviews first hand.
The game that led to me becoming friends with Tom Chick was Entrepreneur. He gave it a negative review but he was, as far as I could tell, one of the very few reviewers who had clearly PLAYED the game.
After that, I used to insist to the magazines that Tom Chick be the reviewer even though the PR guy/gal (usually gal) would try to warn me that Tom Chick was harsh and tough on games. But back then, our options were: Bad Ass Tom Chick OR random dude who might not even play the game before putting up their “safe” 80.
So from our vantage point, the game review system has gotten better in the sense that reviewers seem to actually play our games now. But that might only be because they’ve heard of us.
The problem now is that the number of experienced reviewers is dwindling due to “budget cuts”.
This has been a real problem on the PC side. Again, making a note that it’s stupid of me to be participating in this thread a week before our big game release is going out to reviewers but…
The PC is strong in some particular genres. Once the editors finally deemed that our games could be reviewed by people who actually played games, we found just how outstanding many of the reviewers were:
Besides Tom Chick who might be harsh but at least you can bet your ass that he’s played the game. You also had Bruce Geryk who not only knows strategy games but could probably design better strategy games than I could. There is also Jeff Lackey who has been playing PC games forever. And Allen Rausch at GameSpy knows these games incredibly well - insanely well. I’m just scratching the surface.
And here’s where we get to the negative part: Most of the reviewers now seem more like console gamers or, at best, fans of ONE genre:
As someone who isn’t a huge fan of first person shooters (and incidentally, if retail sales are any indication, neither are a lot of PC gamers), I’m particularly sensitive to seeing such ridiculous levels of attention and coverage given to them at the expense of everything else. Not saying that every article should be The Sims or WoW but sheesh, the last year of Games for Windows might as well been Games for First Person Shooters. There was ONE first person shooter in the top 10 PC game sellers last year. ONE. And given the massive coverage FPS’s get, you’d think they were the most common PC game sold. In 2007 there was ONE FPS there too. Strategy games, which generally outsell FPS’s at retail, don’t just get less coverage but the game journalists who are specialized in those types of games tend to have to fight to get published which is crazy.
The reason this matters is because pre-coverage can affect reviews which in turn massively affect retail sales.
I had a reviewer tell our PR person (and I was CC’d on the email) stating that if our game was good they would have heard of it BEFORE release therefore, they didn’t really need to spend that much time checking it out. This was, btw, for Sins of a Solar Empire.
Another thing that drives me crazy is seeing reviewers complain about meta scores (like metacritic). Well, here’s a dirty secret that no one likes to talk about:
If game has metascore < 85, retail reorders go down tubes. The retail buyers look at Metacritic (and GameStats). So those reviewers, especially the early reviewers, have immense power over the economic fate of a game. Think of the conflict that puts at the business vs. marketing side: Review scores are basically 7 to 9 most of the time. Many reviewers will just give a game an 8 if the game looks “slick” and they don’t have time to review it. But an 8 is still economic death for a game.
So for indie developers, you end up with this situation: If the game isn’t well known before it comes out, a reviewer might just give it an 8 if the game looks slick and they don’t feel like spending much time on it. This is bad in both ways: If it’s a crappy (but slick) game it gets too high a review. But if it’s a real gem, it just got creamed. And if the game doesn’t look slick (like a hard core strategy games) it could really get ripped even if the game itself is awesome.
Anyway, getting back to the point: There are a lot of really good gaming journalists out there. I know, at least over the past few years, the quality has gone way up (in my opinion) and I say that because I find myself enjoying the articles more and more.
Here’s an example: PC Gamer. I used to be so annoyed with PC Gamer some years ago that I wouldn’t send them preview or review copies (that’s the kind of bad business idiocy you can get away with when you own the company). It’s probably worth noting that Stardock is a mutant company in the sense that’s it’s made up largely of game enthusiasts who learned how to code in order to make games and release them so that we could put our money where our mouth was in terms of our forum opinions. :)
Anyway, looking back over issues of PC Gamer, you can see how it’s gotten better and better. Before someone beats me up, I’m very serious. Go and look back at the quality of the articles and reviews and compare them to today or even a couple years ago. I actually found myself re-reading an article on Turtling by Dan Stapleton from years ago to remember why people like turtling (I hate turtling) to design things for Elemental.
My point is, even with PC Gamer, it went from a magazine that used to try to turn the editors into a kind of cult of personality to being a magazine that was good enough where readers are going back and using its articles as reference material.
Now, in the past few months though, things have gotten…odd. At the last QuarterToThree dinner we noticed how many old faces were gone. Scattered to the wind due to budget cuts and such. I’m not sure what’s going to happen.
I have this recurring nightmare that I’ll be talking to someone reviewing Demigod and I’ll make a reference to Kohan or Total Annihilation and they’ll say “What is that?”. Whereas, I have no doubt that when talking about Demigod I could say to Tom, Bruce, Jeff, and others here how Demigod reminds me a bit of Mail Order Monsters.
Sorry to ramble. Just taking a brief respite from crunch. :)