Establishing Context in Task Oriented Dialogs

American Jamal

of

Computational linguistics

A r t i f i c i a l I n t e l l i g e n c e C e n t e r S t a n f o r d R e s e a r c h I n s t i t u t e Menlo P a r k , C a l i f o r n i a 9 4 0 2 5

ABSTRACT

T h l 8 p a p e r d t r c r l b r s part b t t h e d l 8 e ~ u t ~ e easpanant a t a

c p ~ e c h underrfrnding S Y S t l a f a r tark=0ri@ntad d i a l o g r l

~ p ~ c i t l ~ ~ l l y ~

r

esehinlrm

f a r

t o r i d

In

b u i l d i n g a teprrrentatlon o f t h e d l r l o g context, the dlscourre ptocssro? trkrs advantage

of

have a

structure

rtructure

trsk, The irm@ntlc

nctrork

toeur rprcrr w i t h

rrch foeur apace

p e t t i n ~ n t t o t h a a i r l o g relating t o r r u b t r r k . The f a c u r a p r c e r

r r c link@b t a t h e i r QarraSpan4ing r u b t r r k r and a r d @ t * d In r

hterarchy dotrrnlnad b y t h ~ relatianr &Rang r u b t r t k o .

T b i #

rrrarrch

&anouror

cormunlcrtgon

rntai11

trrnrairslon

from t h e # p ~ . k e r @ @ aodal o f t h e w o r l d t o t h r 1 i 8 t a n e r ~ s . I f i s

erueirl

comaunicrte

concepts

in

r

6uf the relevant r e t a t a d concept

kn

In

caaaUniert$on

i s

n o t

in

s

c o o p l e f a t y

unrwbt$uour

~ a n t e % t u r ~

# L t u r t f & a and t

r u r r s u n d i n u

a n

dfrrmbiqurte, Ths

listenet@s

Is

ura

c o n t e x t

h*%P gn h f r gbenttftcrtgm o f t h e c a n c r p t b e i n g c o m u n ~ c l t c d , A s

r

con@lder

n$

U'r)nt?hr"8 Lt ~ t g h t aecut

in

canverratlon

b e t w e e n

r

~y be knern t o b o t h t h e sp*&krr and the

listrncrt

t h e

Iistener

r

~ e r t t c ~ l a r

wrench

sakar

the

noun

Ranrlhartt

Ln

pronouns

i n t a d 8 d getetantt @ i t R

can

Or *vente

k W@bjN@ a r i s e s wt.th @111$tlcrl @ u p r l r s $ a n r , O f t a n

t h e

rurroondino

rnouoh i n f o r m a t i o n

word

er

camnunlert@

an

~a B o l t t h e pump t o t h e p t r t t o r m ,

A a 0 . K .

E1 wnrt t a a l r a r e you using [ t o b o l t t h e pump

t o t h e ~ L a t f o r m l .

A # M y f i n g e r s f a t e t h e t o o l s I

rm

T h e *xp?e%sien8 in b w 3 k t t S i n d i c a t e t h e f u l l utterance t h a t war

meant b y t h e p a r t i a l utterance, T h e l l r t a n e r m u 8 t f l l l in t h i s

infatrnrtion f r o m t h e s u r r o u n d t n g d i a l o g Q

T h i r p a p e r eonridera ruch phrnamma as t h e y occur In trrklerisntrd d i J ! k l ~ g # , B Y t r # k = O t l @ n t e d d i r t o g w t msrn

conversation d l r e c t r d t o w a r d t h e cornplation o f soma t a r k , Xn

partieulart wa w g l I b e eonearnad w i t h

r

t a s k in which an a p p r e n t i c e t ~ c h n i c l s n c o m m u n l c a t a a w i t h a

c o m p u t e r rystsm about t b r r s p r i r of! d L e c t r o m e c h a n l e a L d e v i c a r ,

The U n d c r S t r n d l n g r y r t e m ~ u r t maintain rWdbi& o f t h e w o r l d and ~f

t h e Qialos t o 6 1 s a ~ b l ~ U a t e r e f a r a n e r a In t h u agprantlca's r p c e e h ,

D I G C O U R s E Z N SPEECH UNDERSTANDING

fn r $paeCh u n d a r s t a n d f n g r y r t r ~ , t h e d i r e o u r s t component i s one a t r e v s r r l sources o f k n o w l e d g e t h a t m u s t intctact In

i n t e r p t e t l n g an u t t e r a n c e ( m e ? a x t a n and A , Robinson, 1 9 9 5 1 JI R a b i n S a n , 1 9 7 9 1 r B e c a u r e aL t h e U n c r r t r i n t Y i n t h e _{u e a u r t l c}

rlgnrl, i t i s important t h a t h i g h e r l e v e l r a u r c a r o f Rnawladge

t i k a b i r c o u s r ~ g i v e a d v i c e t o t h e r y r t a r n a t e a r l y r t r g a r in t h e

r n r l y r i r ; . For t h i s r a a r o n , i n aur c u r r e n t speech ~ y ~ t o m r

xoutinsr Car i d e n t l f y l n g t h e r e f e r e n t s a t d 4 k f h l t a noun Ohtaror

ars a p p l i e d r r #@an r s a p o r d i b l a noun p h r r r t is i d r n t l f i s d

U t t ~ t a n c e .

In

to

erndidctrc,

E 1 1 I p s t s and

Pronoun

than t h e

r ~ a a l u t ~ e n

CDNPB), A d e s c r t p t i a n o f t h e p r o c e s s i n u f o r e l l l p s f s and p r o n o u n

rerelutton is contrined

I n

Pragaatitrn

In

on mechanism@ f o r r e a o i v l n u DWr,

The P r o b l e m o t t a r o l v i n g DHPI I r b r a l c a l l p

r

f i n d i n g a aatchfng S t r U C t U t e In nemory, Xn the c r t t o f a

c a n p u t t r r y s t e m w i t h a rearntic nctrark k n o w l t n o ~ b a r e r t h e

Problem $ 8 t h a t o f t L n d t n p t h e n t t r a r k t b t r ~ c t u r e c o t r t S P o n d i n g t o

the B t r u c t u r ~ e t t h e

n w n

n o d e

onto

rtrueturc

noun

t h e Concrpt being l d e n t l t i r d by t h e

n o u n

r L u u r e

there

are

no

wrcnchtrlt t h e n e i t h e r n O d e W1 a t nade W3, b u t not W2, rSLl B a t c h

t h e

onrsrr

8 t r ~ l g h t f o t w r r d .

l o r

in Ftgurr 1 , Th* a d r or B e l k n r r t i n g elbmant, a r c C 8 ecr

Hendrlxr i 9 7 5 a ) linkr node t o d e l i n e r t f n q L n i o r m & t l o n a b o u t

BOX-END

efId type

f A-740522-83

FIGURE 1 NETWORK DESCRIPTION OF THREE WRENCHES

WRENCHES

-7-- S

---

FEW,

end type

I

--

J

I

FIGURE 2 SEMANTIC N E T SHOWING MEMBERS OF TWO SUBSETS OF T H E SET "WRENCHES"

WRENCHES

F-7

B O X - E N D

b o x - e n d

w r a n c h e r

r

wrrnehar

t o

n o w

u , r r , t h e b o x - e n d wrench% h e mtrnr W l r T h e u t t r r i n c c l e v e l

8 t r o c t u r e _{c r e a t e d} by p r r r l n g Cree H a n d r i x r 1 9 7 5 W f o r t h e P h r r r a

b o x m e n d w r r n c h V g I n s l b a t h e space NP

In

d e d u c t f a n ~ u s t b e dona t o e # t r b l & S h t h e c a r r a t p a n d e n c e b e t w e e n H i

and W ) ,

The s t r u c t u r e a r t c h i n g t a U t t n e S t h a t f o r # r b r g i c p a r t o f

the D N P t e r d J v a r take as t n p u t r a parre l e v e l n e t w o r k a f n O d @ S

rnd

rrcr

hateher _war w r i t t e n b y R, E. Flker). Ln g e n e r a l , a L a r g e n U m b a r

0 5 abject8 In the d a t a n e t may b@ c a n d i d ~ t t ~ i f a r t h e m s t s h a r

( i r b r r object8 t h a t a r c a l s R a n t 8 o f t h e # & m e r a t r r t h e o b j e c t

being E b c n t l f l e d b Y Zhe D N P L S I n c a ,

in

no

aechsnismr

FBCWB SPACES

The d l s c a u t & @ componadt must d e t e r m l n a a r u b n c t o f t h e

semantic net k n a w i r d g e bare for e o n r i d e r a t i o n b y t h e m a t c h e r ,

That L t nurr b e a b l e t o r r t a b l i r h a8 a 1oc.L c a n t r w t t h a t

r u b 8 e t o f t h c r y s t s r e r tot11 knowltdgd b u r t h r t $ 8 t r l t v a n t a t a g i v e n p o i n t i n t h e d i a l o g , T h i r 1 s anrlogour t o d e t r r m l n i n g what

i a in t h e urerps f o c u s o t rttrntien. P u t anofher way, wc W e u l d

like t o h i u h l t p h t c e r t a i n node8 and arc8 o f t h e rearntlc nrtwark,

c a m p a r i t s 4L t h r e e d i f f e r e n t camponant

cantaxtat

c o n t e x t , r task context, and r oantext o f g a n ~ t a l w o r l d

k n o w l e d g a l The v e r b a l e o n t e x t i n c l u d e 8 t h e h i r t o r y o f prbcsdlng utterances, t h e i r

ryntacfic

d i t c u r r e d tn them, r n d t h e prrticulrs words u s a d , The talk

context

I s

fecur

i n c l u b * $ s u c h information a r t where t h e C u r r e n t subtark f l t r in

t h e o v e r a l l p l a n , what i t s o u b t a a k r a r e , What a c t i a n a are likely

t o t a l 1 0 W ~ What o b j ~ c t r are important, T h e context of! general

w o r l d knerledge t & t h e i,ntormatlan t h a t r e f l e c t 8 a backgteund

u n d e t r t a n d i n g of t h e p r a p e t t l a l and intearslations s f o b l a c t r and

rctionrt

t o o l s and t h a t a t t a c h i n g e n t a i l 8 S a m @ kind o f fastening,

To h i g h l i g h t a b j e c t 8

in

C U n t t x t r network p a r t i t i o n i n g I r u s e d in 4

new

(1975a) ha8 r u g g s r t e d l m p o r i n ~ a legleal B a t t g t i o n i n g an

nstwarK

a t r u c t u r a d

f o r

Using tht srma t e c h n i q u e , a t s c u r p a r t i t i o n i n g may b e u l r d t o

d j v i d a t h e network 1 n u m b - o f l o c a l contextr, N o d a t and r t c r b@lonO t o B o t h l a g l e a l and Xocur a p a c @ r , T h e logical and

focus prrtltions r r e t n d e p e n d r n t o f on* another

l a

t h e loutcrl s p a s t r

on

nor d e p r n d an t h r t o c u r c p r c e t

In

A fiew focus space l a c r e a t e d f a r each s u b t a r k t h a t a n t r r e

s p a c e r , T h i r h t a r r r c h y d e t e r m i n e r what n o d s 8 a n d a r c 8 a r t

v l s i b l t f r o m a g l v t n space, The arcs and noeer t h a t b e l o n g t o a

$ p a c t age t h e o n l y o n e s Immediately v f ~ l b l @ f r o m t h a t # p a c e .

Arcs and n o d e 8 in spaces t h a t rrs abave I g l v e n s p a c e in t h e

h l t r r r c h y a t e p o t e n t i a l l y v l r i b l a r b u t n u c t b t r e q u a o t r d

s p e e f t i c r l l y t o b e t e e n , O t h e r a r c 6 and n o d e s a r e n o t v i s i b l e ,

& node m a y r p ~ t r r in

rnY

i n

o r

d l f f a r t n t a 8 p t t t r o f t h e a b j e c t may b e i n f o c u r i n t h e t w o

% U b t r ~ k % , I t I r a l ~ o p o r s i b L d f o r

r

w i t h t h e ictu11 pertoraancr o t any p a r t i c u l r r r u b t r g k . S u c h

o b j s c t r must b r d t r c t i b t d _{r e l r t i v r} ts t h o g l o b a l tack

e n v f rvnment For C e & p L c t e n a r t r wc d c f l n a a t a p = & b s t g g ~ e c ,

c a l l e d the wcanmunrl r p a c e 5 a n d a h o t t o ~ = m o r t r p r e c , c a l l a d t h e

*vista s p & c e w , T h e communal $ p a c t c o n t a i n s t h e 1 e l a t l o n r h i p 8

t h a t

are

invrrLant

t e a l b a r e r ) or earnon t o r l l e o n t c x t s . The v i s t a s p a c e L I b e l o w

a11 o t h e r spaces and hCnce c@n s c c t v c r y t h i n g I n t h e s c m r n t l e

net, T h i s p s r r p e c t i v r i s u s c F u 1 f a r d r t c r w i n l n g t h e

[email protected]~r l n t o which a n o b j e c t har r n t ~ r c d .

Th* t a s k s a d e l tn our a y r t t m w i l l br c m b ~ d i c d i n r

p r o c e d u t r l net w h i c h @ncaQcs t h e t r r k l t r u c t u r e in a h i e r a r c h y o f

8 u b t & s k s rnd encoder qach & u b t . r k rr 8 p a r t i r l o r d e r i n q o f r t e p r

C88crtdotit 1 9 7 s ) . The p r a c e d u r @ & net r y r t a m r u e r l l o w r t a r x l

n @ c e 1 8 a r y I A rrPre8antrtion o f the hirratehy of s u b t a r k r 4 8

h p a r t r n t f o r r e f e r ~ n c e t a # o l u t d a n , An ensmlnation ~f

task-otiant@d d l r 1 o g r s h o w 8 t h a t rcfctencss o p e r a t e w i t h i n tarkr and u p t h a h l r t a r e h y c h a l n (DaUtBch, 1 9 7 4 ) . U I i n g t h e hierarchy

of t h e p r a e r 4 u r a l

nrt

on

e n a b l e s us t o $*arch f o r r t f Q r e n c e S

in

Havtnp a r r p r e t r n t r t i o n o f t h e PartlrL ordtrLnp o t task@ a l l o w 8

ur t o capture t h e a l t @ r n a t l V @ 8 t h e r p p r c n t t F u has in c h e o s l n g

r o b t r q u a n t tasks,

wc have e x p l l c i t l y # @ ~ l Z ' . t @ d t h e t h t a r c a m p o n s n t r o f t h e

d i a l o g context, The r e p r r r a n t a t l o n o f an a b j e c t in a tscur a p a e s

w i l l I n c l u d ~ o n l y the r e l a t i e n r h i p r t h a t hrve b a r n m e n t i o n e d

In

t h e d i a l o g conearning t h e e o r a c s p a n d i n q r u b t a s k or t h a t a r e

ihherant i n t h e p f o e e d u r a l net d e s c r i p t i o n of t h s l o e r l twg,

T h u s r t h e v e r b a l esmPontnt dr r u ~ D l i s d b y Eha l n d o t m r t i a n

recorded L A t h e f o c u s space h i a r r t e h y , Forward rsfotcncsr t o

o b j e c t s

in

Pracedural net, The general w o r l d k n o w l e d g e camPonsnt i s

indaraetlan t h a t i s p r t a r n t in t h e communrl s p a c e , When

r a s a l v l n q a ONP, ws can d y n a m i c a l l y allaeats e f f o r t b a t w e a n

sxrmlntng llnkS I n t h r & s e a l Locus rgaee, l o o k i n g f o r w a r d In t h ~

t a s k , l o o k i n g b ~ e k u p t h o f a c u r space h i e r a r c h y l and looking

d a s p a r i n t o knoWt@dga b a r e lntatmrtXon.

t h e c u t r e n t l y a c t i v e L O C U S @pace and t h r n t o rxrnlnr t h e next

level o f d e t r t l in t h e t a s k , I f t h e

raterent

and t h e n f u r t n e r down t h e t a r k c h a i n , T h e currant C e ~ t c x t t o b e

U # e d b y t h e d l l C 0 U r 8 e ~ ~ O C I I I O I Inctudcaa

( 1 1 A focus space c o n t a i n i n g t h e b b l r c t s c u r r e n t l y In focus

( 2 ) A link t o t h e c r r a c i & t o d n o d e In t h e t a r k m o d a l ( 3 1 A t y p e f l a g urQd

in

The t y p e i s necessary becru88 t h e r e

are

4irectLy rcflCct on t h e t a s k S t r U c t U r a , For example, there e r a r a b d f a l 0 ~ ~ about t o o t I d ~ n t i f t c 4 t i o n (wWhrt i r

r

rna

I

i u b d ~ r l e g r do not f b l l o q t h e &@me f e w # space h i e r a r c h y a n d t a s k

The dlrlog S h a w n

In

ca~#lnrtion

I r Q U f d like You t o a r s e m b l a t h e a i r coaprasoot,

0.K.

I r u g p e r t you begin by r t t ~ c h L n g t h e pump t o t h e p l a t f o r m ,

0 4 ,

What #re You d o i n g now?

using t h e p l i e r s t o g a t t h e nut6 i n u n d e r n c r t h t h e p l a t f o r m ,

I r W l l z a t h f r i s c d l f f l c u l t t r r k ,

f@'m tiqhtaning t h e b a l t r now, T h e y a r e a l l In p 2 a c + , G o o d e

How tightly s h o u l d I install t h i s p i p s sibow t h a t f i t s i n t o t h e Pump?

Tabla I: O u b d l r L q g t o r aiteoaprerror r r r e m b l y ,

8hawn in F l g u r r 4 , The termo

w i n s t a l p ,

r e f w t o conceptual a ~ t l a n s Pugher t h a n lexlcal :tam#, The

darhtd l l n a r

connect

r i g h t , T h e partial o t d a r i n g of t e $ k # 1 8 encoded w i t h t h e S and J

nodes. The S 1 or ANDBPLIT, n o d e indicatar t h r beginning of

ParaLltl

brrnchro In

coming o u t o f

an

~r

A N D J O I N , nsdc indlerter a p a i n t where several p a r a l l e l t a s k s nu8t

b e completed, The box@# t a b e l a d T are relevant t o t h e s u b d i a l o g

fragment

,

In t h e following rnaly8is o f t h e d i a l o g l t h e utterance6 a r e

r a l r t f o n

(The @@arch

f o r

foeun

implementadt Integratlbn w i t h t h e t a s k m o d e l I$ n o t , ) The c o n t e x t

intaraat i a n l i s t e d under ( 1 3 - ( 3 ) above Is shown

in

network1 ( 2 ) PNETTZE; ( 3 1 FSTYPE,

E;

Er X ruggcat you b e g i n b y attaching t h e pump t a t h e p l r t t o t m ,

[ A t thL8 Point, we a t e a t task TI1 tncur spacer F60 and F61 S h o w

Ln

U P ~ J

CThil coULd

mean

d o n e l

t r s ~ s n e c

1

T A - 7 4 0 5 2 2 - 8 4

FIGURE 4 PARTIAL PRqCEDURAL NET FOR ASSEMBLING AIR COMPRESSOR

t

I N s T i L L .

I

)

0- _AFTERCOOLER

i

E LBOV'' i

E

I

1

m e ,

I

I

I

I

* * m I

I

* * a

1

o m .

I

,I I

AGTERCOOLER

AFTERCOOLER

AFTERCOOLER

TO PUMP

POSITION

PUMP ON

-

PLATFORM PLATFORM

_-

T5

START PUMP- TIGHTEN PUMP-

MOUNT NUTS MOUNT NUTS

AND BOLTS

F SO

P N E T T I E TO

FSTYPE T A S K

F I G U R E 5 FOCUS SPACES FSO AND FS1

r

---

1

I

P L A T F O R M S

I

A T T A C H - 0 P S P N E T T I E T 4

F S T Y P E T A S K

B O L T / N U T S

P O S l T l Q N l N G S

I

I

I

LFS4

---

_I

T A - 7 4 0 5 2 2 - 8 6

C: What are you d a t n g

new?

(After

r

o f t h e u s a t , l

A t Wring t h e p l l t r r t o g e t t h e n u t s in u n . d e r n t r t h t h c p l a t f o r l n .

f R t h e p l l e r s w can be

r c r o l v e d

c o n r u l t r d . For b o t h * t h e

n u t s a

hl@rrrchy i t consuJted. @The plat far^^^ P t f s in f a c u r Ln t h e

current

no

o f

nuts

in

t a s k model. The

relevant

arc

C I U l e s a ntw contextr t o b e c c t a b l i r h e d a r s h o r n i n F i g u r e 6 . 1

Et I terlfte t h t r 1 6 r d i f f i c u l t task,

[An a t t e w g t t o a s r e s o t h e r p p r r n t t e e @ s p e t e c p t l a n o t t h e problew, Note t h a t a t t h r r point t h e t r r k baa b a r e l y b e g u n and t h e r x p t t t

docs

not

r

A t 1% t f g h t e n i n g the b o l t s now, They're a l l t n p u c e ,

tFS4 contain, "he b a l t r R j t h e y were b r o u g h t I n t o f o e u s when T I

was g t a r t e d , u T h e y " i i d d r t e r ~ l n r d t o r e f e r t o ' t h e b a l t r V y checking thr obgaefr in t h a p r e v i a u s utterance f o r n u m b e r

.Ureesentr

Note

4 wT$ghtenQop*ns TS

, I

E t Good,

A 2 Hew tightly 8 h a u I d

Z

the pun$?

[There i s

no

t h a t p o i n t

in

about task TS), We c l o s e T 5 t becruse o f t h e t r r k r t t u s t u r r t h i s

b r i n g 8 ur back up t o t h @ t o p Ievcl,

we

looklne i n t o

n a w

ca%siSered

an

In r u m ~ ~ t i o n r

taalrting

nst,

t r g k r e t a p e n c e g , B o t h t h e tank mads1 and t h e f a c u r m a c a r are

linked t o t h e g e n e r a l k n o n l a d g I b r a e ; t h ~ ~ r i t Is p o s s i b l e t o Q O

from an i t e m bn e i t h e r t h e trrk _madrl

or

known b u t not p r e v i o u s l y

rafrrrncrd

Tha f o c u s r p r e e ~ and ta@k model p r a v i d a rccrrr t o c o n t e x t

intormation about o b j e c t s

in

DIUtSCh, B l t b a r P G. The b t t u ~ t u r C b t Task-Oriented D l a l a p t .

C o n t r i b u t e d PIp@?Sr LEEE S Y M g o 8 l u R

on

C a r n e ~ i e ~ n e l l o n U h i v e r a l t y , P i t t r b u r q h , P s n n r y l v r n l l ,

15-19 A g r l l 1 9 7 4 @ IEEE, N e w York, 1 9 7 4 , 2 5 0 1 2 5 4 .

Hendtix, Gary G. E x p r n d Z n p t h e U t l l l t y o f Saarntie NctworkL T h t a U p h Partitioning. Abvanee

Paperr

J o i n t CohP@tren~d on A r t l t i c i a 1 I n t @ l l X ~ ~ n c e ~ T b U l a i , Georgia, U88R, 3 - 1 S 4 p t c S b W 1 9 7 S , 1 1 5 4 2 1 ( e ) ,

H e n d r l x t Gary G, damant i c Praeasrpfng f a r S p @ @ e h

Undelrt%nding. Presented r t t h r ThLrtcenth Annual M a r t l n p o f t h e A ~ ~ e c i 8 t i e n bar

C o m ~ u t a t l o n r l

3 0 Q C t a b a t 6 1 N o v 4 m b e t 1995 ( & I ,

N 0 t 1 4 n r D, A l l R u B ~ ~ M P ~ , rb El, d t B 1 . r E x ~ l ~ r a f i o n s in

CopnitLon. W e Hq

rrrcmin

Paxton, W l l l l r m H a r

and

and Control ln a B p t e c h U n d e t $ t b n d i n g Syfitem, P r e s e n t a d r t t h e

T h l r t W n t h Annuri Msrting o f t h e A ~ r o c l r t i o n f o r Computational tinoulrticr, Bortan, Ma$t@Chu#rtt#, 30 O c t o b r r

-

Rabln80nr d m @ J a A T u n ~ r b l ~ , Per Eormrnc* Grawmrr, P r r a e n t a d a t t h e T h l r t r a n t h Annual M w t l n g s f t h e A t r a ~ i r t i o n f a r Coaputrtianri L i n g u i 8 t i e r r B o 8 t a n r M r r r a c h u 8 a t t r r 30 O c t d b f ~

-