According to the NASA usability toolkit, retrieved 12:36, 18 March 2011 (CET), A cognitive walkthroug, is a “process of going step by step through a product or system design and getting reactions from key team players and typical users. One or two members of the design team can guide the walk through while one or more users will comment as the walk through proceeds.”
The Fluid project, retrieved 12:36, 18 March 2011 (CET), provides the following definition: “A cognitive walkthrough is a step-by-step exploration of a service to see how well a particular type of user, usually represented by a persona, is able to accomplish a particular objective or set of objectives. The objectives selected for testing are dictated by the persona that is chosen.”
James Hom defines cognitive walthrough as “review technique where expert evaluators construct task scenarios from a specification or early prototype and then role play the part of a user working with that interface--"walking through" the interface. They act as if the interface was actually built and they (in the role of a typical user) was working through the tasks. Each step the user would take is scrutinized: impasses where the interface blocks the "user" from completing the task indicate that the interface is missing something. Convoluted, circuitous paths through function sequences indicate that the interface needs a new function that simplifies the task and collapses the function sequence.”
In a recent state of the art study, Thomas Mahatody et al. (2010) identify eleven significant extensions of Cognitive Walkthrough (CW): Heuristic Walkthrough, The Norman Cognitive Walkthrough Method, Streamlined Cognitive Walkthrough, Cognitive Walkthrough for the Web, Groupware Walkthrough, Activity Walkthrough, Interaction Walkthrough, Cognitive Walkthrough with Users, Extended Cognitive Walkthrough, Distributed Cognitive Walkthrough and Enhanced Cognitive Walkthrough.
According to Mahatody et al, “at the beginning, CW was a method for assessing usability problems in "walk-up-and-use" systems (i.e., systems that can be used with little or no training). Due to its success, practitioners and researchers interested in this method tried to improve it or to adapt it for other specific types of application. In most cases, the modifications and extensions concern theoretical or conceptual aspects; however, some concern methodological aspects.”
The Fluid project roughly suggest the following procedure.
(1) Choose a user from whose perspective the walkthrough will be done. You may choose a persona for that.
(2) Define what the person wants to achieve
(3) Define the steps that this person should do in order to achive her/his goals
(4) Perform the task and take notes about the following kind of issues for each step:
This project also defines a much more elaborated UX Walkthrough Process. In particular, it suggests to formalize the inspection process along three axis:
Look at their Generic UX Walkthrough Report Template if you need an example
According to Mahatody et al. (2010), this variant which they labelled "CW3" works like this: “the evaluator is invited to imagine a specific and credible scenario for each action that users must run to accomplish their task. To make the scenario credible, the evaluator must justify each action with respect to the user's background and knowledge and the feedback from the interface. To assess each action in the task, the evaluator must answer four questions related to various user thoughts and actions:”
1) What is the user thinking at the beginning of the action
2) Is the user able to locate the command
3) Is the user able to identify the command
4) Is the user able to interpret the feedback
Mahatody et al. then report that “most of the reviewing authors agreed that CW is tedious, despite being easy to learn and use.”
Spencer (2000), presents the following model for a streamlined Cognitive Walkthrough process, adapted directly from Wharton, et al. (1994). Spencer argued that implementing a cognitive walkthrough procedure is not obvious and suggest that in many situations a stream-lined version would be more successful. He suggests to adopt the following ground rules for two reasons: (1) Ensure that developers will not consider the procedure as "lost time" and (2) make sure that they don't become defensive:
Second, he argues in favor of simplication, in particular with respect to Warton:
According to results of a study he conducted, {{quotation|Streamlining the walkthrough may trade-off granularity for coverage, but without that trade off, program managers and developers may perceive the walkthrough as being an inefficient use of time. Performing a streamlined CW is a good way to profile a user interface for potential problem areas, identify many steps that may be problematic for users, and accurately predict many usability problems. However the method will probably result in a few false positives.
Summary of the streamline cognitive walkthrough:
According to Mahatody (2010),
The questions for CWW evaluation are as follows: Q1: Will the correct action be made sufficiently evident to the user?
Q2: Will the user connect the correct subregion of the page with the goal using heading information and her understanding of the sites page layout conventions?
Q3: Will the user connect the goal with the correct widget in the attended to subregion of the page using link ,labels and other kinds of descriptive information ?
Q4: Will the user interpret the system's response to the chosen action correctly?" (Blackmon et al., 2002)