The Nadu Situation
This has become a big topic in the community this week, so I wanted to add my thoughts to the discussion. My focus isnāt on the banning, but on the behind-the-scenes processes that led to it. Iām Head Designer, so I want to focus on the design elements of the situation.
When we make Magic there are a few things we do to try and make it the best it can be. First, we design in what we call an iterative loop. That is, we make something, we playtest it, we get feedback, we make changes on that feedback, and begin the next iteration of the loop. We try to get as many iterative loops in as we can before the set is locked (aka āno more changesā).
No matter where we set that line, thereās a last day to make changes. Moving that line earlier doesnāt change anything other than giving us less iterative loops to improve things. Also, we make lots and lots of last minute changes. The vast majority of them make the game better. I understand thereās more focus on the times we make a mistake, but it represents a truly small percentage of the changes.
Also, whenever we design a card, we ask ourselves, who is this card for? If weāre trying to make game play the best it can be, it helps to understand who will use the card, where they will use it, and what they will do with it. Obviously, in a game as modular as Magic, the players can often zig when we expect them to zag, but in general, this process leads to the best design.
We have two play design teams, one focused on competitive play and one focused on casual play. The competitive play design teams determines which cards they think have a shot at competitive play (remember weāre making predictions as where we think the environment might go,we donāt definitively know; we need to make an environment complex enough as to entertain tens of millions of players). The casual play design team then looks as the cards that donāt play a competitive role to see what casual role they can play.
With that said, let me respond to a few popular lines this week:
āStop designing for Commanderā - The nature of competitive formats is that only so many cards can be relevant. As you start making more competitive relevant cards, they displace the weakest of the existing relevant cards. Thatās how a trading card game works. That means that not every card in a set (or even just the rares and mythic rares as the commons and uncommons have a big role making the limited environment work) has a competitive role. As such, we examine how they will play in more casual settings. Thereās no reason not to do that. And when you think of casual settings, you are remiss if you donāt consider Commander. Itās the 800-pound gorilla of tabletop play (aka the most played, heavily dominant format). Us considering the casual ramifications of a card that we didnāt feel was competitively viable is not what broke the card. Us missing the interaction with a component of the game we consider broken and have stopped doing (0 cost activations), but still lives on in older formats is the cause.
āStop making late changesā - Whenever you see an airplane on the news, something bad has happened. It crashed, or caught on fire, or had an emergency landing, or a door fell off. Why do we still make planes? Because planes are pretty useful and whatās being highlighted is the worst element. That focus can lead people to false assumptions. Magic would not be better if we stopped making last changes. A lot more broken things would get through (things we caught and changed), and many more cards just wouldnāt be playable. Our process of fixing things up to the last minute does lots and lots of good. Maybe it doesnāt get the focus of the screw ups, but it leads to better design.
āEverything needs to get playtestedā - My, and my teamās, job is to take a blank piece of paper and make something that doesnāt exist exist. Thatās not an easy thing to do. I believe play designās job is even harder. Theyāre trying to make a balanced environment with thousands of moving pieces a year in the future. And if weāre able to solve it on our end, that means the playerbase will crack it in minute one of playing with it. One minute, by the way, is the time it takes the Magic playerbase to play with a set as much as we can. There are tens of millions of you and a handful of us. There simply isnāt time in the day to test everything, so the play design team tests what they think has the highest chance of mattering. They take calculated gambles (based on years of experience) and test the things most likely to cause problems. Will things slip through? Thereās no way they canāt. The system is too complex to not miss things.That doesnāt mean we donāt continually improve our processes to lower the chances of mistakes, but nothing weāre going to do can completely eliminate them.
Designing Magic is difficult. Next year is my thirtieth year working on the game, and I think we have the most talented team weāve ever had. Plus, just as we iterate on the designs in a set, we iterate on design processes of making Magic. How we make Magic today is light years different, and I believe better, than how we made Magic when I started. (āIf I have seen further, itās because I stand on the shoulder of giants.ā)
One final thing. Iāve always pushed for transparency in Magic design. No one on the planet has written/spoken about it more than me. I truly believe Magic is better as a game because its players have the insight to understand what we, the people making it, are doing. We do ask for one thing in exchange. Please treat the designers who take the time to share with you the behind-the-scenes workings of Magic design with kindness. We are all human beings with feelings. Thereās nothing wrong with feedback, but it can be delivered with common courtesy.
I admire the restraint it took to write calmly about a subject that must be pretty personal for Mark.
I think Mark is misunderstanding what āstop designing for Commanderā means. His response here would be more appropriate if fans were saying āstop balancing for Commanderā ā which of course nobody is. I donāt know about anyone else, but speaking for myself, when I say āstop designing for Commanderā I mean āstop printing undercosted legends with as many abilities as you can jam into a text boxā. It is okay ā preferable, even ā if one card canāt do everything by itself.
I think Mark is probably right about playtesting, in that no amount of additional resources would be enough to guarantee theyād catch every mistake. But I still donāt love the āeh, what can you doā attitude. I keep thinking, maybe they could hire a consultant with experience in an industry where rigorous testing is the norm. Thereās got to be room to improve their processes.
Youāre absolutely right and Markās straw man arguments like that are pretty frustrating. I have the same meaning as you when I say stop designing for Commander as Iām sure the vast majority of others do. I donāt know if heās being intentionally dishonest or if he just doesnāt get it still but it is 100% stop printing overstatted Commander cards that warp eternal formats and these ability soup engines-and-payoffs.
Re: playtesting I wish they would come out and say what their playtesting process is. How many people are in each group, how long do cards get active testing, etc. Barring those details I kind of disagree that they canāt do more and while they definitely cannot catch everything, their process should be sufficient to not let a Nadu get by.
@andrew @Evu any process will have changes that occur without testing. Unless the process is willing to miss shipping dates.
I think the design crime with Nadu was the fear of shipping a bad card after nerfing the card. Not realising the modification was risky is something professionals should know: novel abilities are risky.
the design crime with Nadu was the fear of shipping a bad card after nerfing the card.
Thatās an excellent point. Because, put that way, whatās so bad about shipping a bad card? People will read it once and never look at it again. Like most cards in a set. So what? On the other hand, making it too strong has grave consequences.
I think the feature creep is caused mostly by greed on both sides; company and players. Company wants to make more money, so needs incentive for players to keep buying. Players want ever stronger cards, and company delivers. Like you canāt make the new set weaker than the previous, because of sales.
@Spzi opperating in fear of a too strong card leads to boring sets. But it is the right way to do the changes that donāt get tested.
āstop printing undercosted legends with as many abilities as you can jam into a text boxā
So much this. So often I come across a card. Start to read. Nice! Continue reading. Whoa, nice! And then Iām only half through.
I then like to ask myself if this card would still be nice if it had less/weaker features. And then Iām shaking my head again, going AngryVideoGameNerd āWhat were they thinking!?ā.
Examples:
- [The End]. Exiling any number of copies is strong on itās own, doesnāt have to become cheaper at low life.
- [Ocelot Pride]. Not sure if it needs first strike. It definitely does not need the extra with the Cityās Blessing.
I feel there are much better examples, but I wanted to stop thinking about it.
I feel there are much better examples, but I wanted to stop thinking about it.
A relatable sentiment.
I think this is just all a bad take from Mark. I understand his position and that this blog is mostly a defense for WoTCās decisions, but this just misses every one of the complaints for me. Heās basically saying āthis is hard, Iāve been doing this for 30 years, trust usā while not addressing the actual complaints.
To me these are arguments why Maro, Michael Majors, and the entire FIRE team should be let go and new people brought in. Doing this for 30 years and still making these mistakes means that someone else is making the decisions and those decisions are not and wonāt be in the best interest of the game.
this just misses every one of the complaints for me. Heās basically saying āthis is hard, Iāve been doing this for 30 years, trust usā
I donāt know what exactly these complaints are, but I also stumbled over this passage. Sure, making magic is hard and you cannot test everything in such a complex system.
Itās also clear that there has to be a last day for the changes, and thus some changes will be late. Although, I argue, if you keep making changes in the last 5 minutes, that probably hints at your testing period being too short.
Itās not a given that āwe only have so much timeā. Itās an economic decision made by management; how much they value testing. They surely try to strike a balance between testing enough and making the most profit. Which is the whole point of this comment.
Despite him claiming otherwise, of course a different, more qualtiy-focussed approach is possible. For example, one rather extreme version would be āwe only release a set after we found nothing worth changing for 3 consecutive months in testingā, just to illustrate the range of possibilities. One can move fast and break things, or be very cautios but move slower.
Though Iād rather have a profit-oriented MTG with too little testing than a bankrupt; or no MTG at all, although thatās probably a false dichotomy.