BrainFinch
Articles

Wisconsin Card Sorting Test explained, with a game

The Wisconsin Card Sorting Test is a task in which you match cards to four reference cards without being told the rule. The rule is color, shape or number, and the only feedback is right or wrong. After a run of correct matches the rule changes with no announcement, and you have to notice and find the new one.

Card Sort, the game above, uses the same idea in a 45 second round. This article describes the task and our game as a puzzle. It has nothing to say about testing people.

What is the Wisconsin Card Sorting Test?

It is a rule discovery task played with cards that vary in three ways. Each card shows symbols in one of four colors (red, green, yellow or blue), one of four shapes (circle, triangle, cross or star) and one of four quantities (one to four).

Four reference cards stay in view. In the standard set they are one red triangle, two green stars, three yellow crosses and four blue circles. No two of them share a color, a shape or a number.

A trial goes like this:

  1. You are handed a card from the deck.
  2. You place it under the reference card you think it matches.
  3. You are told “right” or “wrong”, and nothing else.

You are not told what the rules are or which one applies. You work it out from the feedback. Then, once you have the rule and have matched a set number of cards in a row correctly, it changes. The versions in use today make the change after ten correct matches in a row.

Who created it, and when?

David A. Grant and Esta A. Berg published the task in 1948, from the University of Wisconsin, which is where the name comes from.

Their paper in the Journal of Experimental Psychology has a long title: “A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem”. The title tells you two things. The study was about how easily people shift to a new way of responding after an old one has been rewarded. And the authors saw their task as one of a type that already existed, since sorting tasks had been used in psychology before them.

Berg published a second paper the same year in the Journal of General Psychology, called “A simple objective technique for measuring flexibility in thinking”.

How many different cards are there, and why does it matter?

There are 64 possible cards, because four colors times four shapes times four numbers is 64. How a card relates to the four reference cards decides how much a single match can tell you.

Each feature of a card points at one reference card. A card with two red crosses points at the red triangle by color, at the three yellow crosses by shape, and at the two green stars by number. Those are three different reference cards, so wherever you place it, your choice names a single rule.

Other cards are less clear. One red star points at the red triangle by color and by number at once. If you place it there and hear “right”, you cannot tell which of the two rules earned it.

We counted all 64 cards with a short program:

Kind of card How many of the 64 Example
Points at three different reference cards 24 Two red crosses
Points at the same reference card by two features 36 One red star
Identical to a reference card 4 One red triangle

So with the standard reference cards, 24 of the 64 possible cards give a clean reading. Our game deals only that kind.

How does Card Sort hide its rule?

Card Sort picks a rule in code and never draws it on the screen. All you see is whether the card you tapped gets a color tint for right or a red cross for wrong.

The reference cards, which the game calls key cards, are built fresh each round. The game shuffles six colors (blue, red, green, yellow, purple and black) and six shapes (circle, square, triangle, diamond, star and cross) and gives the first four of each to the four key cards. Counts of one to four are shuffled and handed out the same way. As in the original, no two key cards share a color, a shape or a count.

Every card you are asked to sort takes its color from one key card, its shape from a second and its count from a third. The three are always different. That is the 24 clean cards from the table above: four choices for the color match, three left for the shape, two left for the count. We generated 2,000 rounds to confirm it and found all 24 combinations and no card outside them. The same card is never dealt twice in a row.

Two consequences follow. One key card in four matches the top card on nothing, so tapping it is always wrong. And each of the other three taps tests exactly one rule.

The first rule of a round is picked at random from the three. Over 3,000 generated rounds it was color 1,007 times, shape 988 times and count 1,005 times.

When does Card Sort change the rule?

The rule changes as soon as you reach a set number of right answers in a row, and that number depends on your level and on how many rules you have already cleared in the round. The new rule is never the same as the one it replaces. A wrong answer sets your run back to zero.

This table is read from the function in the game’s code that sets the run length:

Level 1st and 2nd rule 3rd and 4th rule 5th rule onward
0 to 1 5 in a row 4 in a row 3 in a row
2 to 5 4 in a row 3 in a row 3 in a row
6 and up 3 in a row 3 in a row 3 in a row

Your level starts at 0. It goes up after two rounds in a row with at least 80 percent accuracy and comes down after a round under 50 percent. Level changes nothing else in this game: the cards and key cards are built the same way at every level.

Compared with the ten in a row of the standard task, the runs are short. A 45 second round would not fit many rule changes otherwise.

A right answer holds the board for 240 milliseconds and a wrong one for 520 milliseconds. Each right match is one point.

How many taps does it take to find the rule?

Because every tap tests one rule, the worst case is short. These counts follow from the mechanics.

At the start of a round there are three candidate rules. Test one. If it is wrong, test a second. If that is wrong too, the third must be right. That is two wrong taps at most and one on average.

After a change there are two candidates, since the new rule is never the old one. What it costs depends on whether you saw the change coming:

Situation Wrong taps, average Wrong taps, worst case
Start of round, three candidate rules 1 2
After a change you did not expect 1.5 2
After a change you counted 0.5 1

The difference between the last two rows is one tap per rule change. If you do not count, your first match after the change uses the old rule and is wrong. If you count your run and know the fifth right answer has just landed, you can skip the old rule and choose between the other two straight away.

What does that mean in play?

  1. Count your streak. At level 0 the rule changes after the fifth right answer in a row for the first two rules, then the fourth, then the third.
  2. After a counted change, do not tap the match for the old rule. Pick one of the other two.
  3. When a tap is wrong, remember which rule it tested. With two candidates left, one wrong tap settles it.
  4. Find the key card that matches on nothing and leave it alone. It shares no color, shape or count with the top card.
  5. Restart your count after any wrong tap, because the game does.

Card Sort has no cue to read. Our games that do show the rule are Rule Flip, which names color or shape on a chip, and Task Shuffle, which switches between two questions about a digit. The research behind those is in task switching and switch cost. Logic Gate is another game where the answer has to be worked out from a rule.

A Card Sort score is the number of right matches in 45 seconds. It is a game result and says nothing about a person’s health or ability. On what practice at games like this does and does not show, see what the research shows about brain training games.

Common questions

What is the Wisconsin Card Sorting Test?

It is a card task in which you match cards to four reference cards by a rule you are not told: color, shape or number. You only hear if each match was right or wrong, and the rule changes without notice after a run of correct matches.

Who created the Wisconsin Card Sorting Test?

David A. Grant and Esta A. Berg, at the University of Wisconsin. Their paper appeared in the Journal of Experimental Psychology in 1948, and Berg published a companion paper in the Journal of General Psychology the same year.

What are the sorting rules in the Wisconsin Card Sorting Test?

There are three: match by the color of the symbols, by their shape, or by how many there are. Only one rule is in force at a time and the person has to work out which from the feedback.

Sources

  1. Grant, D. A., & Berg, E. A. (1948). A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. Journal of Experimental Psychology, 38(4), 404-411.
  2. Berg, E. A. (1948). A simple objective technique for measuring flexibility in thinking. Journal of General Psychology, 39, 15-22.
  3. Lancaster University, Department of Psychology glossary: Wisconsin Card Sorting Test (WCST)
  4. Millisecond test library: Wisconsin Card Sort Test manual (stimulus cards and default rule change)
  5. PsyToolkit experiment library: Wisconsin Card Sorting Test (history of card sorting tasks)

Games in this article

Take all 62 games with you

The BrainFinch app plays offline, keeps your streak and reminds you when the daily challenge is ready.

Get it on Google Play