OTHER KNOWLEDGE
CAPTURE TECHNIQUES
CHAPTER 6
Chapter 6: Other Knowledge Capture Techniques
On-site observation
Consensus methodologies
Brainstorming Consensus decision Repertory grid Nominal group Delphi method Blackboarding
3
On-Site Observation
Process of observing, interpreting, and recording
problem-solving behavior while it takes place
More listening than talking
During the process, the knowledge developer is able to ask
questions but does not correct or modify, in any way, what the expert is doing.
Some experts do not like to be observed
Fear of ‘giving away’ expertise is a concern by the one
observed
Process can be distracting to others in the setting
Continuous shuttle process important
Possible problem with the accuracy or completeness with which the knowledge captured is recorded, since there exists a gap from when the knowledge is observed and when it is documented.
Chapter 6: Other Knowledge Capture Techniques
Brainstorming
Unstructured approach to generating ideas
about a problem
All possible solutions considered equally
Emphasis is on frequency of responses
during the session
Idea generation, followed by idea
5
Brainstorming Procedure
Introduce brainstorming session
Give experts a problem to consider
Prompt experts to generate ideas
Watch for signs of convergence
Call for a vote or a consensus to reach
agreement
Chapter 6: Other Knowledge Capture Techniques
Protocol Analysis
Think-aloud method
Expert keeps talking, speaking out loud while
solving a problem
Effective source of information on cognitive
processes
Makes expert cognizant of the processes being
described
Provides wealth of information toward knowledge
representation
7
Consensus Decision Making
Consensus decision-making follows
brainstorming in two ways:
Each method allows all experts to present their
views or ideas, but discussions invariably proceed before consensus.
The knowledge developer tries to rally the
group in each method towards one final decision that will hopefully lead to a consensus.
Chapter 6: Other Knowledge Capture Techniques
Consensus Decision Making
Clear agreement regarding the best solution to a
problem
As a tool, it follows brainstorming
Procedure ensures fairness and standardization in
the way experts arrive at a consensus
A bit tedious and can take hours
The rigidity of the consensus method can be a
9
Brainstorming v.s. Consensus
Decision Making
Brainstorming is idea generation of multiple
solutions to a problem, is unstructured, and results in a wide variety of creative ideas.
Consensus decision making involves a controlled
exercise in which the knowledge developer focuses the group on one or two of the solutions from the brainstorming exercise. It follows brainstorming. The goal is to arrive at a clear agreement regarding the best solution to a problem.
Chapter 6: Other Knowledge Capture Techniques
The Repertory Grid
Domain expert viewed as a scientist who
categorizes a problem domain using his or her own model
Grid used to capture and evaluate the expert’s
model
Experts see problems based on reasoning that has
stood test of time
A representation of the experts’ way of looking at
a particular problem
A grid is a scale or a bipolar construct on which
11
The Repertory Grid (cont’d)
Benefit: May prompt the expert to think
more seriously about the problem and how
to solve it.
Drawback: Difficult to manage when large
grids are accompanied by complex details
Because of difficulty in simplicity and
manageability, the tool is normally used in
the early stages of knowledge capture
Chapter 6: Other Knowledge Capture Techniques
NGT Procedure
KD explain procedure
Each expert lists the pros and cons of the problem
or the alternative solutions
Complies a list of pros and cons
Each expert rank the compiled pros and cons
KD conducts a discussion about the pros and cons
and the respective rank
KD compiles the alternative solution followed by
13
NGT (cont’d)
Technique can be time consuming
Has been known to promote impatience
among experts who must listen to
discussions with other experts
With experts sharing expertise, things can
jell in adopting the best solution
NGT is ideal in situations of uncertainty
regarding the nature of the problem
Chapter 6: Other Knowledge Capture Techniques
NGT (cont’d)
Effective in multiple expert knowledge capture,
especially when minimizing differences in status among experts is important
In NGT, each expert has an equal chance to
express ideas in parallel with other experts in the group
With discussion accommodated in sequential
order, NGT can be a more efficient and productive approach than brainstorming
15
Delphi Method
A panel of experts prepare an anonymous opinion
about the focused problem.
In the second round, each expert is given a
summary of the first round and asked to make addition estimate based on the addition
information.
Repeat step 2 until all of the extreme estimates are
deleted, and the answers are converge to a narrow range.
Chapter 6: Other Knowledge Capture Techniques
Delphi Method
A survey of experts
A series of questionnaires used to pool experts’
responses in order to solve a difficult problem
Each expert’s contributions shared with rest of
experts by using results of one questionnaire to construct the next questionnaire
17
Delphi Method (cont’d)
Controlled feedback
Statistical group response
Experts often lack necessary knowledge on
which to base final judgment
Poorly designed questionnaire could cause
all kinds of problems
Chapter 6: Other Knowledge Capture Techniques
Concept Mapping
A network of concepts, consisting of nodes
and links
A node represents a concept and a link
represents the relationship between
concepts. See Fig. 6.5
An effective way for a group to function
19
Figure 6.5 Conceptual Map—An
Example
helper of Bear d Santa Clause White horse Birthday At chimneys On roofs Spain climbs listens lives in brings gives not same as has has lives in rides SAINT NICOLAS BLACK PETER PresentsChapter 6: Other Knowledge Capture Techniques
Figure 6.6 Steps in Concept Mapping
STEPS IN CONCEPT MAPPING 1 Preparation of Project
Participants, focus, schedule
2 Idea Generation (focus for brainstorming) 3 Idea Structuring (sorting/rating statements) 4 Statement Representation 5 Interpretation (cluster analysis) 6 Utilization
21
Blackboarding
Assumes all participants are experts with
unique experience
Initial data are written on the blackboard
Each expert has equal chance to contribute
to the solution via the blackboard
Process continues until the problem has
been solved
Diverse approaches to problem solving
Chapter 6: Other Knowledge Capture Techniques
Blackboarding (cont’d)
Participants share a common language for
interaction
Flexible representation of information
Efficient storage and location of
information
