Bias and Objectivity

There's been a lot of talk about the objective review of games, as Gamergate (yes, we're still talking about them. God, I wish we weren't.) have decided to paint having opinions as an example of journalistic bias. Now, before we go any further, let's talk about bias. Bias is where you claim to hold a certain position and have something to gain from making people think you hold that position. When oil companies claim that climate change isn't a thing, that's bias, because they have something to gain from making sure that people continue to consume what they're selling.

Simply having an opinion and expressing it is not bias. Yes, even if it is an opinion you personally do not share. It is ok to like or dislike a thing, and even valuable to tell other people that you like or dislike it, in order to either recommend it or warn people away. And yes, as a reader of reviews, you might dislike something someone else likes, or like something that someone else dislikes, and that review might not be 'correct' for you. But the alternative is to buy the game anyway and then decide whether or not you like it, which hardly puts you in a better consumer position than having read someone else's opinions. What this self-styled consumer revolt is actually doing is advocating a situation where the consumer takes on more, not less, risk of going out of pocket on something shitty. But hopefully we're past the point now where I need to explain to anyone that Gamergate's pro-consumer stance is nothing more than a smokescreen for misogyny. I think most sensible people get that.

But bias isn't really the subject today. I don't even really want to talk about the impossibility of objective reviews, as other people have done that beautifully. I just want to pick up on one point where something can seem to be objective, but actually isn't.

TotalBiscuit, before he decided to put his considerable YouTube celebrity behind a misogynistic hate group and spout transphobic gibberish, made a video where he said that someone's opinion on a game is mostly subjective (and how that's reconciled with his supporting Gamergate is anyone's guess). But he did say that we can be objective about certain things, like optimisation. If a game is poorly optimised, he says, it's poorly optimised and that's that. Anyone who knows half a fraction of a thing about software development knows that this simply isn't true.

When you optimise a piece of software, three things happen. Firstly, the program runs faster. That's the point. Secondly, it becomes harder to make changes in the code. Thirdly, it becomes harder to extend the code. The more you optimise, the more costly and difficult it becomes to patch bugs. The more you optimise, the less extensibility you give to your program.

Would Skyrim have been a better game if it ran faster? Undoubtedly, but that's not the question. The question is, would Skyrim have been a better game if it ran faster at the cost of the bugfixes it received post-launch and the power of its modding interface? Whether that cost would have been worth it is a judgement call that depends on which factor you think is the more important. And the relative importance of those factors can only ever be subjective. You can disagree with the decision Bethesda made on this relative importance, but you cannot say it was objectively wrong.

Gaming is both one of the most hardware-intensive and one of the most performance-critical applications of computers. All games do need to be optimised to some extent. But precisely what extent that is depends on a whole load of other factors, many of which are subjective. The idea that more optimisation is always better is sophomoric and naive, and has no place in real-world software development.

The larger point here is that things in games are rarely simply "done well". They're very often done well at the expense of some other factor. Even with the inconceivably large budgets the top-end AAA games have, spending money on one thing means not spending money on another. Part of the art of game development is striking the right balance, but critics and consumers alike have differing views on what "the right balance" is, because they have different subjective priorities.