Critique of Research Methods

The specifications and limitations of the observation method in general and participant observer method in specific were briefly discussed in section 5.3.1.

The role of participant observer in the Design Bugs Out study was realised through formation and introduction of a supplementary ‘research team’ alongside the core design team. This in itself could be interpreted as introducing an additional element to the common design process in the real-world practice and thus result in changing the typical dynamics of the design process. The fact that in a real-world situation a ‘research team’ largely does not exist to support people information needs of designers, may distinguish the Design Bugs Out from a typical real-world design process. Furthermore, being a design project with a specifically user-centric angle, it could be argued that overall, there was more emphasis on and support for people information, its supply and its use compared to a typical design project. The role of the ‘client’ and the ‘research team’ was of particular importance here in encouraging and facilitating wider uptake of people information.

The level and frequency of observer’s involvement with and access to the design team and the project in general, did vary throughout various stages of the design process and was not the same in all stages. This was due to various reasons including the different levels of focus on end-user and people information throughout the process, the working culture of design consultancy and the

150

manufacturer, and the vibrant - divergent and convergent - nature of the design process. This could introduce some limitations in terms of rigour and consistency of data collection throughout the study. In particular, there was gradual decrease in involvement and limited access to the design team in later stages of the design process. However, this was to a certain extent inevitable as the role of the participant observer, as a member of the research team was to provide people information to design team, and as the design process proceeded, this need seemed to lessen therefore less involvement and input was needed. This expected lack of direct involvement was compensated to certain extent in the Develop and Deliver stages of design process through weekly meetings and team updates from both the design consultancy and the manufacturer.

The role of the research team by default, could have a considerable impact on

‘format’ dimension as they were the collectors and presenters of people information as specified by designers. Among all dimensions of information behaviour observed, it could be argued that the ‘format’ dimension was potentially most influenced by the behaviour of the research team as opposed to the behaviour of the core design team themselves. Although designers were quite specific in terms of what ‘type’ and ‘source’ of people information they required, they were not necessarily as specific regarding the ‘format’ they wanted the information presented to them. This was mainly due to the fact that in most cases the research team collected the information and decisions regarding how to present it depended on them in the first place. This in turn, helped identify relevant factors influencing the choice of information format, such as ‘familiarity’.

However, this could at the same time introduce some complications regarding analysis of results on ‘format’ and clarifying to what extent it was determined by the designers as opposed to the researchers.

151

5.6 Refining, Evaluating and Detailing the framework

Use of six dimensions of information framework helped create a holistic yet comprehensive and detailed picture of information behaviour in the Design Bugs Out project and facilitated investigation, analysis and reflection on designers’

approach towards people information throughout the Design Bugs out project.

The replacement of ‘use’ dimension with ‘intensity’ and breaking it down to three aspects i.e. Range, Depth and Frequency proved useful.

Also, inclusion of ‘Purpose’ as the new dimension proved to cover one important aspect of designers’ information behaviour and was considered as successful. A seventh ‘Stage’ dimension was recommended to be included to the framework explicitly addressing ‘when’ and ‘at what stage’ designers sought and used information. The ‘stage’ dimension was to cover the design process and its phases. Design process was primarily addressed as a contextual constituent to the information behaviour framework. ‘Purpose’, ‘source’, ‘type’, ‘format’,

‘attributes’ and ‘intensity’ dimensions were detailed and populated by findings.

Figure 5.3 and Table 5.12 present an overview of the transformations to the information framework and specify the changes made. The detailed dimensions are presented alongside refinements and changes suggested to certain dimensions.

Initial Information Framework Refined Information Framework (Interview Study) (Observational Study I)

Figure 5.5 The initial Information Framework based on Interview Study and the refined framework based on the findings from the Observational Study I

Included Attributes

Source Use

Type

Purpose Format

Intensity Source

Purpose Type

Attributes Format

Stage

Refined (from Use)

152

Table 5.12 Changes made to framework dimensions based on Observational Study I findings

Dimension Changes Result

Purpose Detailed Stage:

Discover

Insight & understanding, Inspiration & ideation, Information & specification

Define

Information & specification, Communication &

discussion Develop

Evaluation & refinement, Information & specification, Empathy

Deliver

Communication & discussion, Confirmation & support

Source Detailed Stage:

Discover

User research, Previous experience, Internet, Books Define

User research, Previous stage, Intuition Develop

Other projects, Previous stages, Specialists Deliver

Previous stages, Other projects, Intuition

Type Detailed Stage:

Discover

Experience & context of use, Needs, Problems Define

Qualitative, Info-graphics, Video, Quotes & anecdote Define

Accessibility, Right level of detail, Value, Presentation Define

153 Use

 Intensity

Refined + Detailed

Stage:

Discover

Range 3.65 (on a scale of 1 to 7) Depth 2.65 (on a scale of 1 to 7) Frequency 4.65 (on a scale of 1 to 7)

Define

Range 4.50 (on a scale of 1 to 7) Depth 4.95 (on a scale of 1 to 7) Frequency 4.40 (on a scale of 1 to 7)

Develop

Range 3.30 (on a scale of 1 to 7) Depth 5.10 (on a scale of 1 to 7) Frequency 4.10 (on a scale of 1 to 7)

Deliver

Range 3.65 (on a scale of 1 to 7) Depth 2.40 (on a scale of 1 to 7) Frequency 3.90 (on a scale of 1 to 7) Stage Included Discover, Define, Develop, Deliver

154

5.7 Summary

5.7.1 Key insights

Findings confirmed both conflicts and interrelations between various dimensions of the information sought and used by designers throughout the design process.

There was conflict of demands in regard to some aspects of information, specifically there was some divergence between ‘format’, ‘type’ and ‘attributes’ of people information designers sought. Some significant interrelations were also observed between various dimensions of framework in particular ‘purpose’ with

‘source’ and ‘type’, also ‘type’ with ‘format’ and ‘qualities’. Discover and Define stages of the design process were when the people information was most heavily sourced and used, this suggests more focus is needed on designers’ information behaviour (explicitly people information) at the front-end of the design process.

5.7.2 Study implications

This study was the first of two observational studies planned to refine, evaluate and detail the information framework. Through observing a team of designers responding to a real-world design challenge, the refined information framework from the Interview Study in Chapter Four was further studied and investigated.

This resulted in detailing of six dimensions and suggesting one new dimension to be included. ‘Stage’ as the new dimension suggested for inclusion, will be further studied in the next chapter. The next chapter will present the second observational study and its findings. Also, in order to complement the observational study in this chapter, the next chapter will focus on three groups of designers with a ‘recognised outsider’ role. The refined framework will be used in the next chapter for another iterative cycle of refinement, evaluation and detailing.

155