Data Visualizations

As discussed in the methodology section of this document, a new instrument that could quickly, easily and accurately communicate the results of a large-scale usability study required creation. The result is the PUT-Q2 Data Package. This package includes two unique sections, the subject and population matrices. These matrices are the two core

components in the PUT-Q2 Data package. Their corresponding elements are discussed in detail below.

PUT-Q2 Subject Matrix

The PUT-Q2 Subject & Sample Matrices were generated to allow an immediate

understanding of each subjects’ testing results as well as the sample results with regard to all data streams. These multi-page documents include information visualizations

(information graphics) on the following streams of data: eye-scan paths, information absorption, key areas of eye focus, time on task, cardinal order of tasks, qualitative data correlated with quantitative statistics, sample size geometric means as compared across task completion times, and other complimentary statistical and qualitative data.

The Subject Matrix is a two-page form. The first page contains several

information modules (See Figure 12). Module 1 displays the subjects time to complete each task, cardinal sort order, Task mean as compared to the total population, and

qualitative selections derived from reports generated from Atlas.ti. Module 2 displays the standard descriptive statistics for the sample population that successfully completed the indicated Task. Module 3 presents the verbal description of each Task, while Module 4 displays the quantitative and qualitative results of the post user test. The final Module displays additional qualitative information selected during the sort and testing phases.

Upon completion of qualitative and quantitative data analysis, the process turned to information visualization. When completed, the PUT-Q2 Subject & Sample Matrices package presents a holistic picture of each subjects’ interaction during the usability test as well as the sample population trends and results. Comparisons can be made by immediate

visualizations between the subject and the population. Additional conclusions can be drawn based on subjective analysis of qualitative data.

The most important aspect of the PUT-Q2 data package is the addition of

qualitative data to standard descriptive statistics currently being used in usability testing, in addition to providing a quick-look visual representation of usability study data. For example, a simple eye-tracking analysis of a scan path as related to a five second exposure to the BestBuy.com home page reveals what designers would predict: the eye moves from large to small items as it scans a page, resting longer at larger images to increase the angle of focus, and in turn cognitively process the image (See Figure 13).

This phenomenon is used in visual communication design to control the hierarchy of information presented. However, when qualitative data is added to the information graphic a new contextual conclusion can be drawn. This resulting conclusion can better assist and reveal the true usability of a website from a testing subjects point-of-view.

Figure 12: PUT-Q2 Subject Matrix (Side 1)

Figure 13: PUT-Q2 Subject Matrix (Side 2)

PUT-Q2 Sample Population Matrices

The PUT-Q2 Sample Population Matrices were generated to allow an immediate understanding of the overall state of the usability study by presenting all test subjects.

testing results as well as the sample results with regard to all data streams.

The Sample Population Matrix is a two-page form. The first page contains several information modules (See Figure 13). Module 1 displays the subjects time to complete each task, cardinal sort order, Task mean as compared to the total population, and

qualitative selections derived from reports generated from Atlas.ti. Module 2 displays the standard descriptive statistics for the sample population that successfully completed the

indicated Task. Module 3 presents the verbal description of each Task, while Module 4 displays the quantitative and qualitative results of the post user test. The final Module displays additional qualitative information selected during the sort and testing phases.

Figure 14: Sample Population Matrix (Side 1)

Figure 15: Sample Population Matrix (Side 2)

Upon completion of qualitative and quantitative data analysis, the process turned to information visualization. When completed, the PUT-Q2 Subject & Sample Matrices package presents a holistic picture of each subjects’ interaction during the usability test as well as the sample population trends and results. Comparisons can be made by immediate visualizations between the subject and the population. Additional conclusions can be drawn based on subjective analysis of qualitative data.

The most important aspect of the PUT-Q2 data package is the addition of

qualitative data to standard descriptive statistics currently being used in usability testing, in addition to providing a quick-look visual representation of usability study data. For example, a simple eye-tracking analysis of a scan path as related to a five second exposure to the BestBuy.com home page reveals what designers would predict: the eye

moves from large to small items as it scans a page, resting longer at larger images to increase the angle of focus, and in turn cognitively process the image. This phenomenon is used in visual communication design to control the hierarchy of information presented.

However, when qualitative data is added to the information graphic a new contextual conclusion can be drawn. This resulting conclusion can better assist and reveal the true usability of a website from a testing subjects point-of-view.