Foreword |
|
xvii | |
Acknowledgments |
|
xix | |
About the author |
|
xxi | |
Image credits and permissions |
|
xxiii | |
Introduction: Getting started guide |
|
1 | (8) |
|
|
1 | (1) |
|
Users don't tolerate a bad user experience |
|
|
2 | (1) |
|
|
3 | (1) |
|
|
3 | (5) |
|
A lot can happen in a decade |
|
|
4 | (1) |
|
What's new in the 2nd edition |
|
|
4 | (1) |
|
How the chapters are organized |
|
|
5 | (1) |
|
Special features you can use or skip |
|
|
6 | (1) |
|
|
7 | (1) |
|
Check out the companion website |
|
|
8 | (1) |
1 Establishing the essentials |
|
9 | (26) |
|
Focus on the user, not the product |
|
|
10 | (1) |
|
Start with some essential definitions |
|
|
11 | (8) |
|
|
11 | (4) |
|
Sidebar: ISO 9241-11:2018 expanded definition of usability |
|
|
13 | (2) |
|
What is usability testing? |
|
|
15 | (3) |
|
Sidebar: Take a peek at a brief history of usability testing-then and now |
|
|
16 | (2) |
|
What is UX (user experience)? |
|
|
18 | (1) |
|
What is UCD (user-centered design)? |
|
|
18 | (1) |
|
Know how and why to conduct small usability studies |
|
|
19 | (3) |
|
Establish the user profile |
|
|
20 | (1) |
|
Create task-based scenarios |
|
|
20 | (1) |
|
Use a think-aloud process |
|
|
20 | (1) |
|
Make changes and test again |
|
|
21 | (1) |
|
Know how and why to conduct large studies |
|
|
22 | (2) |
|
Use the same tasks or different ones |
|
|
23 | (1) |
|
Gather metrics to quantify results-with or without a think-aloud process |
|
|
23 | (1) |
|
Choose a method or combination of methods |
|
|
24 | (1) |
|
Balance your goals and your budget |
|
|
24 | (1) |
|
Get buy-in for usability testing |
|
|
25 | (6) |
|
Get to know your stakeholders |
|
|
25 | (1) |
|
Engage your stakeholders in your research from start to finish |
|
|
25 | (1) |
|
Advocate for more (and earlier) usability testing throughout product development |
|
|
26 | (1) |
|
Make the case for cost-justifying usability testing |
|
|
26 | (3) |
|
Sidebar: Making usability a priority-advocating for the value of user research |
|
|
27 | (2) |
|
|
29 | (1) |
|
Agile development is fast and focused |
|
|
29 | (1) |
|
The current approach to design thinking focuses on a 5-day sprint |
|
|
30 | (1) |
|
|
31 | (4) |
2 Exploring the usability and UX toolkit |
|
35 | (34) |
|
Opening the toolkit and seeing what's there |
|
|
37 | (6) |
|
Analysis tools lay the foundation |
|
|
37 | (3) |
|
Design/implementation tools build user research into development |
|
|
40 | (2) |
|
Deployment tools provide feedback on actual use |
|
|
42 | (1) |
|
Understanding which tool is the right one for the job |
|
|
43 | (3) |
|
Choosing heuristic evaluation from the toolkit |
|
|
46 | (6) |
|
Heuristic evaluation is review by experts |
|
|
46 | (3) |
|
Heuristic evaluation has a clearly defined methodology |
|
|
49 | (1) |
|
Expert review can mean different things to different people |
|
|
50 | (1) |
|
An informal review may have no rules |
|
|
50 | (2) |
|
Sidebar: Five steps to a (user-centered) expert review |
|
|
51 | (1) |
|
Comparing the results from heuristic evaluation and usability testing |
|
|
52 | (7) |
|
Sidebar: What the CUE-4 study tells us about both methods |
|
|
53 | (3) |
|
Using a storytelling approach for heuristic evaluation |
|
|
56 | (1) |
|
Putting both methods together: The 1-2 punch |
|
|
57 | (1) |
|
Adopting a user-centered design process |
|
|
58 | (1) |
|
|
59 | (2) |
|
Sample report: Heuristic evaluation report using storytelling approach |
|
|
61 | (8) |
3 Testing here, there, everywhere |
|
69 | (30) |
|
Acquiring the basic equipment for usability testing |
|
|
70 | (2) |
|
Extending your capabilities with specialized equipment and software |
|
|
72 | (6) |
|
Mobile device testing uses specialized equipment and software |
|
|
72 | (2) |
|
Eye-tracking equipment shows you where users look |
|
|
74 | (4) |
|
Using a conference room or office |
|
|
78 | (1) |
|
Investing in a dedicated lab |
|
|
78 | (4) |
|
Evaluating the disadvantages of lab testing |
|
|
82 | (1) |
|
Getting into the user's world with field testing |
|
|
83 | (3) |
|
Advantages of field testing |
|
|
84 | (1) |
|
Disadvantages of field testing |
|
|
85 | (1) |
|
Reaching users anywhere and everywhere with remote testing |
|
|
86 | (5) |
|
Moderated remote testing is synchronous |
|
|
86 | (2) |
|
Unmoderated remote testing is asynchronous |
|
|
88 | (3) |
|
Using other online tools to expand the scope of remote unmoderated testing |
|
|
91 | (3) |
|
Choosing the right method |
|
|
94 | (1) |
|
|
95 | (4) |
4 Understanding users and their goals |
|
99 | (36) |
|
|
100 | (2) |
|
Sidebar: The psychologist's view of UX design: 10 insights |
|
|
101 | (1) |
|
When people use the web, they bring their experience and expectations |
|
|
102 | (6) |
|
People expect web objects to be in specific places |
|
|
105 | (1) |
|
Make a good first impression. You may not get a second chance. |
|
|
106 | (1) |
|
Users decide right away if a website can be trusted |
|
|
106 | (2) |
|
People don't want to read. They want to act. |
|
|
108 | (1) |
|
Generational differences matter when it comes to technology usage |
|
|
108 | (8) |
|
Three-quarters of American adults go online daily |
|
|
110 | (1) |
|
What we know about older users online |
|
|
111 | (2) |
|
What we know about Millennials online |
|
|
113 | (1) |
|
What we know about teens online |
|
|
114 | (2) |
|
What we know about children online |
|
|
116 | (1) |
|
Gender differences matter when it comes to Internet and social media usage |
|
|
116 | (4) |
|
Gender affects website design |
|
|
117 | (1) |
|
Gender affects technology and social media usage |
|
|
117 | (2) |
|
Gender affects communication styles on social media |
|
|
119 | (1) |
|
Generational and gender research sheds light on your users |
|
|
120 | (1) |
|
Personas help you get to know your users |
|
|
120 | (5) |
|
Personas are based on real information about real users |
|
|
121 | (2) |
|
Personas are a creative activity, but don't get carried away |
|
|
123 | (1) |
|
Personas should be a manageable number |
|
|
123 | (1) |
|
Personas should be visible |
|
|
124 | (1) |
|
Scenarios tell the story of your users' goals |
|
|
125 | (7) |
|
Know the difference between a task and a goal |
|
|
125 | (1) |
|
Know the difference between a use case and a scenario |
|
|
125 | (3) |
|
Sidebar: Use case example |
|
|
126 | (2) |
|
Know the difference between a user story and a scenario |
|
|
128 | (1) |
|
Tell stories about your personas in a compelling way |
|
|
129 | (3) |
|
|
132 | (3) |
5 Planning for usability testing |
|
135 | (62) |
|
Scheduling the planning meeting |
|
|
136 | (51) |
|
|
136 | (7) |
|
Sidebar: Accessibility goals are in everyone's interest |
|
|
140 | (3) |
|
Determine how to test the product |
|
|
143 | (7) |
|
Sidebar: Getting early feedback on paper prototypes using "The Wizard of Oz" technique |
|
|
146 | (2) |
|
Sidebar: Testing faster, cheaper |
|
|
148 | (2) |
|
|
150 | (1) |
|
Define the characteristics of a subgroup |
|
|
151 | (2) |
|
|
153 | (1) |
|
Mix some characteristics within a subgroup |
|
|
153 | (3) |
|
Sidebar: How to ask inclusive gender questions |
|
|
154 | (2) |
|
Combine characteristics in a user profile |
|
|
156 | (2) |
|
Determine participant incentives |
|
|
158 | (2) |
|
Draft the screener for recruiting participants |
|
|
160 | (11) |
|
Create scenarios based on tasks that match test goals |
|
|
171 | (10) |
|
Sidebar: Comparative/competitive testing requires special considerations |
|
|
176 | (5) |
|
Determine quantitative and qualitative feedback methods |
|
|
181 | (2) |
|
Set dates for testing and deliverables |
|
|
183 | (4) |
|
Sidebar: How many one-hour sessions are optimal for a day? |
|
|
184 | (3) |
|
|
187 | (8) |
|
Writing an informal test plan |
|
|
188 | (1) |
|
Using other informal ways to document test plans |
|
|
188 | (5) |
|
Writing a formal test plan |
|
|
193 | (2) |
|
|
195 | (2) |
6 Preparing for usability testing |
|
197 | (52) |
|
|
198 | (7) |
|
How to do the recruiting yourself |
|
|
199 | (3) |
|
Sidebar: Guerilla recruiting using the intercept technique |
|
|
200 | (2) |
|
How to recruit through a recruiting company |
|
|
202 | (1) |
|
How to recruit through an online recruiting company |
|
|
203 | (1) |
|
How to recruit through an online testing platform |
|
|
203 | (1) |
|
|
204 | (1) |
|
Assigning team roles and responsibilities |
|
|
205 | (2) |
|
Developing team checklists |
|
|
207 | (3) |
|
Writing the moderator's script |
|
|
210 | (7) |
|
Writing the moderator's script for in-person testing |
|
|
212 | (5) |
|
Writing the moderator's script for remote testing |
|
|
217 | (2) |
|
Sidebar: The effect of thinking out loud on timed tasks and other considerations |
|
|
215 | (2) |
|
Writing the moderator's script for remote testing |
|
|
217 | (2) |
|
Preparing or using other forms |
|
|
219 | (3) |
|
Preparing a video consent form |
|
|
219 | (1) |
|
Preparing a special consent form for testing with minors |
|
|
220 | (1) |
|
Using a nondisclosure agreement |
|
|
220 | (1) |
|
Preparing an observer form |
|
|
221 | (1) |
|
|
222 | (10) |
|
Creating a pretest questionnaire |
|
|
222 | (4) |
|
Creating posttask questionnaires |
|
|
226 | (1) |
|
Creating a posttest questionnaire |
|
|
227 | (5) |
|
Sidebar: Writing good questions |
|
|
230 | (2) |
|
Using standard posttest questionnaires |
|
|
232 | (5) |
|
Using the SUS (System Usability Scale) |
|
|
233 | (2) |
|
|
235 | (1) |
|
Using the NPS (Net Promoter Score) |
|
|
236 | (1) |
|
Creating or using qualitative feedback methods |
|
|
237 | (4) |
|
Using product reaction cards |
|
|
238 | (1) |
|
|
239 | (2) |
|
Sidebar: Retrospective recall is an in-depth review of the testing session |
|
|
240 | (1) |
|
|
241 | (3) |
|
Conducting the walkthrough |
|
|
241 | (1) |
|
|
242 | (2) |
|
Managing all this test preparation |
|
|
244 | (1) |
|
|
244 | (2) |
|
Sample report: Moderator's script for usability study of betterworldbooks.com |
|
|
246 | (3) |
7 Conducting a usability test |
|
249 | (38) |
|
|
250 | (1) |
|
Being an effective and unbiased moderator |
|
|
250 | (15) |
|
Sidebar: What makes a good moderator |
|
|
251 | (3) |
|
Monitor your body language |
|
|
254 | (1) |
|
|
255 | (1) |
|
|
255 | (5) |
|
Sidebar: Methods for successful engagement with participants |
|
|
257 | (3) |
|
Avoid asking "bad" questions |
|
|
260 | (1) |
|
Know how and when to intervene |
|
|
261 | (2) |
|
Administer posttest feedback mechanisms |
|
|
263 | (2) |
|
Managing variations on the theme of testing |
|
|
265 | (5) |
|
Testing with two or more participants |
|
|
265 | (3) |
|
Sidebar: Partial script for co-discovery usability test |
|
|
267 | (1) |
|
Testing with two or more moderators |
|
|
268 | (1) |
|
Testing remotely with a moderator |
|
|
269 | (1) |
|
|
270 | (6) |
|
Observers with you and the participant |
|
|
271 | (3) |
|
Sidebar: Understanding the impact of the observer effect |
|
|
273 | (1) |
|
Observers in the executive viewing room |
|
|
274 | (2) |
|
|
276 | (1) |
|
Providing help or customer support |
|
|
276 | (2) |
|
|
278 | (1) |
|
|
278 | (1) |
|
|
279 | (2) |
|
Sample log: Log from cruise website usability study |
|
|
281 | (6) |
8 Analyzing the findings |
|
287 | (34) |
|
|
288 | (8) |
|
Gather input from everyone |
|
|
289 | (1) |
|
Collect the top findings and surprises |
|
|
289 | (1) |
|
Choose your organizational method |
|
|
290 | (6) |
|
Sidebar: Affinity matching tips and tricks |
|
|
293 | (3) |
|
|
296 | (10) |
|
Determine who should do the analysis |
|
|
296 | (1) |
|
|
296 | (2) |
|
Present quantitative data |
|
|
298 | (1) |
|
Know how and when to work with statistics |
|
|
299 | (3) |
|
Analyze the questionnaires |
|
|
302 | (2) |
|
Use qualitative feedback from the think-aloud process |
|
|
304 | (1) |
|
Collate responses from product reaction cards |
|
|
305 | (1) |
|
What should we do about it? |
|
|
306 | (7) |
|
Triangulate the data from findings |
|
|
306 | (1) |
|
Characterize findings by severity |
|
|
307 | (2) |
|
Determine global and local findings |
|
|
309 | (1) |
|
|
310 | (3) |
|
|
313 | (2) |
|
Sample findings: Partial findings from Holiday Inn China website study |
|
|
315 | (6) |
9 Reporting the findings |
|
321 | (46) |
|
Following Aristotle's advice |
|
|
323 | (1) |
|
Preparing the message for the medium |
|
|
324 | (1) |
|
Writing an informal report |
|
|
324 | (4) |
|
Preparing a formal report |
|
|
328 | (11) |
|
Sidebar: CUE-10 Ryanair.com website study-review of reports |
|
|
328 | (2) |
|
Planning for a document-style report |
|
|
330 | (2) |
|
Writing the executive summary |
|
|
332 | (1) |
|
Organizing the rest of the report to match your audience needs |
|
|
333 | (4) |
|
Sidebar: Development of the Common Industry Format |
|
|
336 | (1) |
|
Planning for a presentation-style report |
|
|
337 | (2) |
|
|
339 | (12) |
|
|
340 | (3) |
|
|
343 | (2) |
|
|
345 | (3) |
|
|
348 | (1) |
|
|
349 | (2) |
|
Presenting posttask and posttest results |
|
|
351 | (3) |
|
Presenting survey responses |
|
|
351 | (2) |
|
|
353 | (1) |
|
Presenting qualitative responses |
|
|
353 | (1) |
|
|
354 | (5) |
|
Delivering an oral report |
|
|
359 | (4) |
|
Planning your presentation |
|
|
360 | (1) |
|
|
360 | (1) |
|
Practicing your presentation |
|
|
361 | (1) |
|
Delivering your presentation |
|
|
362 | (1) |
|
Knowing how and when to ask for questions |
|
|
362 | (1) |
|
|
363 | (2) |
|
|
365 | (2) |
10 International usability testing |
|
367 | (44) |
|
Learning about your international users |
|
|
368 | (1) |
|
Some international users are here |
|
|
368 | (1) |
|
Other international users are "there" |
|
|
369 | (1) |
|
Understanding cultural differences |
|
|
369 | (10) |
|
|
369 | (1) |
|
|
370 | (9) |
|
Applying the work of Hall and Hofstede to your understanding of international users |
|
|
379 | (4) |
|
Hall's concept of high-context and low-context cultures |
|
|
380 | (1) |
|
Hofstede's concept of cultural dimensions |
|
|
380 | (3) |
|
Creating personas of your users |
|
|
383 | (6) |
|
Focus on specific cultural characteristics |
|
|
383 | (1) |
|
Keep other considerations in mind |
|
|
384 | (2) |
|
|
386 | (3) |
|
Sidebar: Creating Chinese personas for a study of China's Holiday Inn website |
|
|
387 | (2) |
|
Planning for international testing |
|
|
389 | (7) |
|
|
389 | (6) |
|
Sidebar: Working with an interpreter |
|
|
394 | (1) |
|
|
395 | (1) |
|
Structuring the test protocol |
|
|
396 | (6) |
|
|
397 | (1) |
|
Localizing the questionnaires |
|
|
398 | (3) |
|
Scheduling single sessions or co-discovery sessions |
|
|
401 | (1) |
|
Choosing think-aloud or retrospective recall |
|
|
402 | (1) |
|
|
402 | (2) |
|
Anticipating other aspects of international testing |
|
|
404 | (3) |
|
What if the participant arrives with someone else? |
|
|
404 | (1) |
|
Should more time be set aside for meeting and greeting? |
|
|
405 | (1) |
|
Should breaks be longer between sessions? |
|
|
406 | (1) |
|
Can you interpret nonverbal communication cues? |
|
|
406 | (1) |
|
|
407 | (2) |
|
Sample report: Analysis of the UPS Costa Rica website |
|
|
409 | (2) |
References |
|
411 | (22) |
Index |
|
433 | |