Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without the fee, provided that copies are not made or distributed for profit or commercial advantage, and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on services or to redistribute to lists, requires prior specific permission and/or a fee. © ACM 1072-5220/08/0900 $5.00

September + October 2008

is known to many for its beautiful graphing capabilities, I find the text-visualization tools most valuable for analyzing qualitative data. Data visualization has been promoted as an effective means of presenting data, but its enormous value in analyzing data has been largely overlooked. In particular, the Word Tree that “lets you pick a word or phrase and shows you all the different contexts in which it appears. The contexts are arranged in a tree-like branching structure to reveal recurrent themes and phrases.”

When applied to qualitative data (e.g., interview transcripts, free-text survey comments), the Word Tree allows a researcher to quickly scan through text-based content by searching via keyword or phrase. For example to see what a group of users said about a particular product feature, the researcher can create a word tree around the feature (e.g. “registration” or “ installation”) or around particular terms that are likely to indicate problems (e.g. “difficult to”, “but”). Visually structuring the data around critical terms provides a starting point for reviewing and understanding qualitative data in an efficient manner. It is not a substitute for thoughtful analysis, but a head start. One significant caveat in the case of Many Eyes is that all submitted data is publicly viewable, so it’s not always suitable for proprietary data analysis. But it is free.

trends across an organization, a user research database can grow into a valuable corporate asset. But collecting and organizing research across projects is rarely done efficiently, if at all.

There is a need for techniques and tools that support better research-data management and communication. New specialized software tools are providing a platform for accomplishing this. For example, QSR International’s recently launched NVivo 8 (http://www.qsrinternational. com/ default.aspx) provides a framework for entering, tagging, and querying various forms of qualitative data (including audio and video) across multiple projects. HTML output can be produced to readily communicate and present research findings. These types of tools will enable more effective collaboration among both localized and geographically distributed researchers and can provide a centralized repository for observational data.

The value of well-conducted research is extremely limited if it is not organized for effective communication. Arguably, providing a system for documenting and sharing research data will likely have a greater organizational benefit than any other research-related technology.

measurement, efficiency, and enhancement can assist practitioners in focusing on the relevant characteristics to support their needs.

The technology examples discussed here touch multiple phases of the research process, from data collection through analysis and organization. When used appropriately, these tools contribute to improved efficiency, detail, or information sharing. Ultimately, high-definition research is achieved when the researcher can focus on the meaning and patterns of the findings, rather than the clarity and organization of data.

 

For more information about characteristics of user research technology, you can download the slides from an overview presentation on the topic that I gave to the New York City chapter of the Usability Professional’s Association (UPA) “Technologies for User Research ( TURe)” on October 17, 2006; http://www.nycupa.org/ pastevent_06_1017.html

interactions

Research Management Tools On a broader scope, the greatest challenge in design research may be data management. From managing information within a project to sharing research

Researcher-Centered Tools Until recently, the availability of technology to support user research has not kept up with the overall pace of technology development. Now that there are a range of tools available, it is time to provide guidance on which technologies are appropriate for the varied contexts of research applications. The four attributes: documentation,

ABOUT THE AUTHOR
Rob Tannen is director of
research at Bresslergroup
( www.bresslergroup.com),
an award-winning product
design and development
firm. Rob provides expertise and training in
design research, human factors, and
usability to support product/interface defi-
nition and refinement. He is creator and
editor of DesigningforHumans (www.
designingforhumans.com), the IDSA’s blog
for design research and human factors.
Rob is a Certified Professional Ergonomist
(CPE). He earned a B. A. in cognitive sci-
ence from Vassar College and M.A. and
Ph.D. degrees in human factors/experimen-
tal psychology from the University of
Cincinnati.