• No results found

An Evaluation of METAL: the LRC Machine Translation System

N/A
N/A
Protected

Academic year: 2020

Share "An Evaluation of METAL: the LRC Machine Translation System"

Copied!
8
0
0

Loading.... (view fulltext now)

Full text

(1)

A n Evaluation of METAL: the LRC Machine T r a n s l a t i o n S y s t e m

Jonathan S l o c u m

Microelectronics and C o ~ u t e r T e c h n o l o g y Corp. W i n f i e l d S. Bennett

L e s l e y W h l f f i n E d d a N o r c r o s s

Siemens Co~mmmllcation Syst~-~q, Inc.

A b s t r a C t

T h e Linguistics R e s e a r c h Center (LRC) at the U n i v e r s i t y of Texas at A u s t i n is

c u r r e n t l y developing METAL, a

fully-automatlc h i g h quality m a c h i n e

translation system, for m a r k e t introduction

in 1985. This p a p e r will describe the

current stat~s of

METAL,

e~phasizing the

results of the m o s t recent post-edltors'

evaluation, a n d will b r i e f l y indicate some

future directions for the system. A 6-page

G e r m a n original tex~ and a raw (unedIt~3d,

b u t automatically reformatted) METAL

translation of that text into English are included as appendices.

Introductlon

The Linguistics R e s e a r c h Center (LRC) at the U n i v e r s i t y of Texas at A u s t i n is

currently d e v e l o p i n g METAL, a

fully-automatic h i g h quality m a c h i n e

translation system, for m a r k e t introduction

in 1985. This p a p e r wlll describe the

curren~ statn/s o f METAL, including the

results of the m o s t recent evaluation, and

will b r i e f l y indicate some fur%Ire directions

for the system. Exhibits A and B (attached)

are, respectively, a German original text

and a raw (unedlted, b u t automatically

reformatted) METAL translation of that into English.

H i s t o r y and Status

Machine translation research at the University of Texas b e g a n in 1956: the LRC

was founded in 1961. Eor m u c h o f the

h i ~ c o r y of. this project, funding was

p r o v i d e d b y the U.S. Air Force's R o m e A i r Development Center and other U.S. gove~,m~nt agencies. In 1979, Siemens A G b e g a n funding the development p h a s e of the METAL m a c h i n e

translation sy~cez, at w h i c h p o i n t

i ~ l e m e n t a t l o n of the current system was initiated. A p r o t o t y p e has recently b e e n delivered to the sponsor for m a r k e t testing.

T h e current system is a unidirectional G e r m a n - E n g l i s h system, although w o r k to add ot/%er target languages, as well as c r e a t i n g

an English-German M T system, is n o w

underway. T h e p r e s e n t staff for the METAL p r o j e c t consists of seven full-ti~e and five h a l f - t l m e personnel.

A p p l i c a t i o n Environment

Software h a s b e e n d e v e l o p e d to h a n d l e the formatting p r o b l e m s associated w i t h

technical manuals. This software, w r i t t e n

in SNOBOL, a u t o m a t i c a l l y m a r k s and p r e p a r e s texts for the M E T A L translation s y s t e m

[Slocum a n d Bennett, 1982; Slocum eu al. 0

1984]. T h e only h u m a n intervention p r i o r to translation is c h e c k i n g and c o r r e c t i n g the

results o f t_he automatic formatting

routines. P o s t e d i t i n g is e x p e c t e d for the output t ~ . T h e s y s t e m does n o t expect (or p r o v i d e for) h u m a n intervention d u r i n g the actual t r a n s l a t i o n phase.

P r e - p r o c e s s i n g a n d p o s t - e d l t i n g are p r e s a n t l y done on a DEC-2060; the actual translation, on a Symbolics Lisp machine. T h e "proch/ction ~ " design envisions a

Lisp M a c h i n e as the translation u n i t

c o , necked to 4-6 ~ranslator workstations,

from w h i c h t,he p r e p a r e d ~ will b e sent to the t r a n s l a t i o n u n i t and on w h i c h t h e output texts will b e postedlted.

M E T A L uses a transfer a p p r o a c h for translation. T h e entire p r o c e s s consists of

four p h a s e s : analysis, integration,

transfer, a n d generation (synthesis). T h e

integration p h a s e works w i t h whole p a r s e

tree st-ruc~ures, following analysis and

p r e c e d i n g transfer. Until recently,

transfer and generation w e r e e s s e n t i a l l y a single phase, b u t w o r k is c u r r e n t l y u n d e r w a y to separate this single p h a s e into ~wo, w i t h a m u c h m o r e p o w e r f u l generation phase.

L l n g u l s K i c Component

T h e curren~ M E T A L lexicon consists of over 20,000 G e r m a n and E n g l i s h m o n o l i n g u a l

entTies, c o r ~ i ~ c l n g of morphological,

syntactic, and s ~ n t l c features and values,

and an a p p r o p r i a t e l y large number of transfer entries. T h e featnlres and v a l u e s

in monollngual lexlcal entries s u p p l y

n e c e s s a r y information for the analysis

and/or synthesis of these it~m~ d u r i n g the

m a c h / x ~ translation process. Most entries

are r e a s o n a b l y s 4 ~ l e , b u t entries for v e r b

st~m~ are significantly m o r e complex.

Inflected adjectives, nouns, and verbs are

(2)

E a c h t-Fans fer l e x i c a l e n t r y is a

s t r u c t u r e e q u a t i n g t h e s o u r c e l a n g u a g e

c a n o n i c a l form w i t h a n a p p r o p r i a t e t a r g e t

l a n g u a g e c a n o n i c a l form. C e r t a i n

s i g n i f i c a n t i n f o r m a t i o n (i. e., l e x i c a l

category, s u b j e c t area, a n d p r e f e r e n c e ) is

c o d e d i n t h e e n t r y to g u i d e t h e s y s t e m in

s e l e c t i n g t h e a p p r o p r i a t e t r a n s l a t i o n .

F u r t h e r m o r e , t e s t s a n d o p e r a t i o n s ( i n c l u d i n g

t r a n s f o r m a t i o n s ) m a y b e i n c l u d e d w i t h i n

t r a n s f e r en~rles.

T h e g r ~ r for M E T A L c o n s i s t s o f o v e r

600 a u g m e n t e d p h r a s e s ~ r u c t u r e rules, e a c h

of w h i c h is u s e d in b o t h a n a l y s i s a n d

trans f e r / g e n e r a t l o n . METAL' s g r ~ - ~ - r r u l e s

are u s e d in t h e p a r s i n g o f all l e v e l s o f

s t r u c t u r e from t h e w o r d level to t h e

s e n t e n c e level, i n c l u d i n g p h r a s e s a n d

clauses. A M E T A L g r a m m a r r u l e c o n s i s t s o f

five a n a l y s i s sections, p l u s a n a d d i t i o n a l

s e c t i o n for e a c h t a r g e t language: a t o p l l n e

d e s c r i b i n g t h e p h r a s e s t r u c t u r e (with a n

o p t i o n a l e n u m e r a t i o n o f e a c h c o n s t i t u e n t ) ; a

s e r i e s o f r e s t r i c t i o n s , w h i c h t e s t t h e

a p p r o p r i a t e n e s s o f i n d i v i d u a l c o n s t i t u e n t s

on t h e r i g h t - h a n d s i d e o f t h e rule; TESTs,

w h i c h e n f o r c e a g r e e m e n t a m o n g t h e r i g h t - h a n d

c o n s t i t u e n t s ; a C O N S T R section, w h i c h

c o n s t r u c t s t h e a n a l y s i s o f t h e p h r a s e ; a n

I N T E C ~ section, w h i c h is e x e c u t e d (once a

c o m p l e t e a n a l y s i s o f t h e s e n t e n c e is

achieved) i n o r d e r to, e.g., r e s o l v e

a n a p h o r i c r e f e r e n c e s ; a n d o n e or m o r e

t a r g e t - l a n g u a g e - d e p e n d e n t T r a n s f e r sections,

w h i c h c o n t r o l l e x l c a l a n d structn/ral

t r a n s l a t i o n into t h e t a r g e t language.

H o m o g r a p h r e s o l u t i o n a n d d i s ~ m h i g u a t l o n

a r e h a n d l e d u n i f o r m l y (i.e., w i t h o u t s p e c i a l

passes) , in v a r i o u s w a y s : b y o r t h o g r a p h i c

tests, s u c h as t_he t e s t to e n s u r e t h a t a

w o r d t h a t l o o k s l l k e a G e r m a n n o u n is n o t

ali l o w e r case; b y p o s i t i o n a l c o n s t r a i n t s ,

w h i c h d i s a l l o w c o - o c c u r r e n c e o f - m h l g u o u s

s t r i n g s in t h e s a m e c l a u s e location; and,

m o s t e s p e c i a l ly, b y t h e c a s e f r a m e

m e c h a n i s m .

T h e c a s e (valency) frame m e c h a n i s m is

v i t a l in M E T A L ' s a n a l y s i s o f G e r m a n s o u r c e

l a n g u a g e s e n t e n c e s . T h i s m e c h a n i s m is

i n v o k e d in c l a u s e - l e v e l r u l e s a n d u s e s

f e a t u r e s on t h e v e r b s t e m to d e f i n e t h e

f u n c t i o n s o f t h e v a r i o u s c e n t r a l a r ~ J m e n t s

to t h e p r e d i c a t e . In additlon, t h e c a s e

frame m e c h a n i s m is u s e d to t e s t for s u c h

t/llngs as s u b j e c t - v e r b a g r e e m e n t .

T h e METAL gramm=ar m a k e s e x t e n s i v e u s e

of t r a n s f o r m a t i o n s to m o d i f y s t r u c t u r e or

p e r f o r m c e r t a i n tests. T r a n s f o r m a t i o n s m a y

b e u s e d in t h e TEST, CONSTR, I N T E r , a n d

T r a n s f e r p h a s e s o f t h e rules,

t r a n s f o r m a t i o n s m a y a l s o b e u s e d in t r a n s f e r

l e x l c a l entries. A t r a n s f o r m a t i o n m a y b e

w r i t t e n as p a r t o f a r u l e or c a l l e d b y name.

C o m p u t a t i o n a l C o m p o n e n t

T h e l e x i c o n for M E T A L is m a i n t a i n e d v i a

a D B M S w r i t t e n in LISP. I n p u t o f l e x i c a l

e n t r i e s is f a c i l i t a t e d b y a n INTERCODER, a

m e n u - d r l v e n s y s t e m w h l c h a s k s t h e u s e r for

i n f o r m a t i o n i n E n g l i s h a n d e n c o d e s t h e

a n s w e r s i n t o t h e i n t e r n a l form u s e d b y t h e

system. A n i n t e g r a l p a r t o f t h e I N T E R C O D E R

is t h e " l e x i c a l d e f a u l t " p r o g r a m w h i c h

accepts" m i n l m ~ l i n f o r m a t i o n a b o u t t h e

• p a r t i c u l a r e n t r y (root f o r m a n d l e x i c a l

category) a n d e n c o d e s m o s t o f t h e r e m a i n i n g

n e c e s s a r y f e a t u r e s a n d v a l u e s . E n t r i e s m a y

a l s o b e c r e a t e d u s i n g a n y t e x t editor,

w i t h o u t t h e a i d o f t h e I N T E R C 0 D E R or l e x i c a l d e f a u l t e r .

I n t e r f a c i n g w i t h t h e l e x i c a l d a t a b a s e

is d o n e b y m e a n s o f a n u m b e r o f m e n u - d r i v e n

f u n c t i o n s w h i c h p e r m l t t h e u s e r to access,

edit, copy, a n d / o r d e l e t e e n t r i e s

i n d i v i d u a l l y , i n g r o u p s (using s p e c i f i c

features), or e n t i r e l y . In o r d e r to a s s u r e

a h i g h d e g r e e o f l e x i c o n i n t e g r i t y t h e M E T A L

s y s t e m i n c l u d e s v a l i d a t i o n p r o g r ~ m ~ w h i c h

i d e n t i f y e r r o r s in f o r m a t a n d / o r syntax.

T h e v a l i d a t l o n p r o c e s s is a u t o m a t i c a l l y u s e d

to c h e c k l e x l c a l i t ~ m ~ w h i c h h a v e b e e n

edited, t o e n s u r e t h a t n o e r r o r s h a v e b e e n

i n t r o d u c e d d u r i n g e d i t i n g .

T h e g r a m m a r is a l s o in a d a t a b a s e a n d

m a y b e - a c c e s s e d a n d / o r e d i t e d in m u c h t h e

s a m e w a y as t h e lexicon. S y s t e m s o f t w a r e

a n d n a m e d t r a n s f o r m a t i o n s a r e s t o r e d in

i n d i v i d u a l s o u r c e files.

M E T A L ' s p a r s e r is a " s o m e - p a t h s ,

p a r a l l e l , b o t t o m - u p p a r s e r " [Slocum e t al.,

1984] . It m a y b e c o n s i d e r e d t o b e

" s o m e - p a t h s " b e c a u s e t h e g r a m m a r r u l e s a r e

g r o u p e d i n t o n u m e r i c a l l y i n d e x e d " l e v e l s "

a n d t h e p a r s e r a l w a y s a p p l i e s r u l e s at a

l o w e r level b e f o r e a p p l y i n g r u l e s at a

h i g h e r level. O n c e t h e p a r s e r h a s

s u c c e s s f u l l y b u i l t o n e or m o r e Ss at a g i v e n

level, it w i l l halt; u n t i l it d i s c o v e r s o n e

or m o r e S r e a d i n g s , t h e p a r s e r w i l l c o n t i n u e

to a p p l y r u l e s in e a c h s u c c e s s i v e level.

E x t e n s i v e e x p e r i m e n t a t i o n w i t h t h e s y s t e m

h a s f o u n d t h a t t h e p r e s e n t p a r s e r

c o n f i g u r a t i o n is t h e m o s t e f f i c i e n t o n e for

M E T A L [Slocum e t al., 1984].

P o s t - E d l t o r s ' E v a l u a t i o n

In June, 1984, t h e M E T A L s y s t e m w a s

u s e d to t r a n s l a t e 8 2 . 6 p a g e s o f t e x t i n t o

English; t h e m a t e r i a l v a r i e d from a s a l e s

p r o s p e c t u s (for a s p e e c h r e c o g n i t i o n system)

t h r o u g h v a r i o u s g e n e r a l h a r d w a r e a n d

s o f t w a r e s y s t e ~ d e s c r i p t i o n s to h i g h l y

t e c h n i c a l d o c u m e n t a t i o n . T h e o u t p u t w a s

t h e n e d i t e d b y ~ w o S i e m e n s r e v i s o r s (one a

m ~ m h e r o f t h e M E T A L p r o j e c t , o n e not) . T h i s

s e c t i o n d e s c r i b e s t h e r e v i s o r s ' o b J e c t i v e

p e r f o r m a n c e a n d s u b j e c t i v e r e a c t i o n s

( i n c l u d i n g c o m p a r i s o n w i t h e a r l i e r v e r s i o n s

o f METAL) d u r i n g t h i s e x p e r i e n c e .

(3)

P o s t - E d i t o r ist p a s s 2 n d p a s s 3 r d p a s s M i n / P g P g s / H r . P g s / D a y

#i 9hr 1 0 m l n 3hr 4 0 m i n 2br 1 0 m i n 1 0 . 9 5.5 4 4 . 1

#2 13hr 4 0 m i n 3hr 5 5 m i n 1 2 . 8 4 . 7 37.6

(N.B. T h e n u m b e r o f p a g e s o f t e x t w a s c o m p u t e d a u t o m a t i c a l l y o n t h e b a s i s o f " S i e m e n s s t a n d a r d p a g e s " : 26 l i n e s x 55 c h a r a c t e r s = 1430 c h a r a c t e r s / p g . )

T h e t a b l e a b o v e s u m m a r i z e s t h e editors'

r e v i s i o n times. T h e y e m p l o y e d r a t h e r

d l f f e r e n t e d i t i n g t e c h n i q u e s (editor #i

w o r k i n g in t h r e e passes, #2 i n J u s t two),

b u t t h e i r t i m e s a r e r e l a t i v e l y close.

C o m m e n t s b y E d i t o r #i :

~ h e 3rd Pass] t e n d s to b e c o n c e r n e d

w i t h s T y l i s t i c i ~ p r o v e m e n t s , f o r m a t t i n g

c h a n g e s a n d t~2plng errors. T h e l a s t p a r t o f

t h i s s t a g e i n v o l v e s r u n n i n g t h e s p e l l i n g

c h e c k e r o n t h e file t o e l i m i n a t e r e m a i n i n g

t y p i n g errors.

T h e ~ m p r e s s i o n o f p o s t - e d i t i n g w a s t h a t

t h e r e h a v e b e e n m a n y i m p r o v e m e n t s o v e r

p r e v i o u s t e s t runs. T h i s w a s e v i d e n c e d b y

t h e fact t h a t o n t/lls p o s t - e d l t i n g r u n less

t h a n 57 o o f s e n t e n c e s w e r e r e - t r a n s l a t e d from

scratch. T h e m a j o r t a s k in p o s t - e d i t i n g is

n o w c h a n g i n g w o r d order, c h a n g i n g v e r b

a g r e e m e n t a n d r e - t r a n s l a t l n g t h e m o r e

i d i o m a t i c usages. C o n s i d e r a b l e l ~ r o v e m e n ~ s

in f o r m a t m a d e p o s t - e d l t i n g easier, a l t h o u g h t h e r e is s t i l l r o o m for further e n h a n c e m e n t .

a n d 3 r d p h a s e s o f p o s t - e d l t l n g c o n t i n u e d as

normal. T h e p r e v i o u s p r o b l e m s wir/~

p o s t - e d l t i n g a h i g h l y f o r m a t t e d t e x t m e a n t

t h a t w h e n e v e r a t e x t u a l c h a n g e w a s m a d e i n

t h e t h e te2Cc t h e n t h e f o r m a t h a d to b e

r e - m o d i fled. T h e m e t h o d o f p o s t - e d i t i n g

u ~ e d in T-hls t e s t p r o v e d t o b e c o n s i d e r a b l y

faster a n d e a s i e r to h a n d l e . . . . ~ h e

results] d e m o n s t r a t e t h a t t h e t i m e s a v i n g

lles i n t h e i n i t i a l p o s t - e d l t p h a s e w h i c h is

w h e n t h e m o s t c h a n g e s a r e m a d e a n d w h i c h is

m o s t t i m e i n t e n s i v e w i t h r e g a r d to

re- f o r m a t t i n g text.

C o m m e n t s b y E d i t o r #2:

A s c o m p a r e d t o t h e l a s t r u n i n F e b r u a r y

1984, t h e J u n e 8 4 o u t p u t s h o w e d c o n s i d e r a b l e

i m p r o v e m e n t . A g r e a t e r n u m b e r o f s e n t e n c e s

w a s u s e a b l e a n d m ~ n y r e q u i r e d a c h a n g e in

w o r d o r d e r only. P l a c e m e n t o f t h e

d e t e r m i n e r s h a s b e e n improved. [Certain]

p o i n t s s h o u l d b e c o n s i d e r e d to I m p r o v e

f u t u r e t r a n s l a t i o n s .

F u t u r e D i r e c t i o n s

O n e o f t h e g r e a t e s t c h a n g e s a f f e c t i n g

p o s t - e d l t i n g w a s t h e fact t h a t s i n c e t h e

initial o u t p u t [ c o ~ p a r e d t o e a r l i e r

versions] o f M E T A L w a s d e e m e d t o h a v e

i " ~ r oved, t h e dl f f e r m i s t a g e s 0 f

p o s t - e d l t i n g w e r e m o r e c l e a r l y defined.

T h a t is to say, it w a s e a s i e r t o p r o d u c e a n

a d e q u a t e t r a n s l a t i o n d u r i n g t h e f i r s t r u n

t h r o u g h t h e t e x ~ ~- u s i n g t h e r e f o r m a t t e d

o u t p u t o n t h e s c r e e n a n d a h a r d c o p y o f t h e

s o u r c e t e x t for r e f e r e n c e -- t h a n in

p r e v i o u s tests. In t h e s e c o n d r u n t h r o u g h a

tex~c -- u s i n g a h a r d c o p y o f t h e M E T A L o u t p u t u p o n w h i c h p r e l i m i n a r y p o s t - e d l t i n g h a s b e e n p e r f o r m e d -- it w a s e a s i e r to c o n c e n t r a t e o n

p o l i s h i n g t h e t r a n s l a t l o n . In t h e t h i r d a n d

final p o s t - e d l t stage, one w a s a b l e to m a k e

a final c h e c k for s t y l i s t i c w e a k n e s s e s ,

s p e l l i n g m i s t a k e s a n d t y p i n g errors. T h i s

w a s t h e s a m e m e t h o d as u s e d in p r e v i o u s

t e s t s b u t o n e w a s b e t t e r a b l e to d i s t i n g u i s h

b e U w e e n t h e s t a g e s (initial teckulical a n d

s t y l i s t i c p o s t - e d l t i n g ; p o l i s h i n g output;

final s t y l i s t i c check) a n d t h e e n t i r e

p r o c e s s w a s less t i r i n g t h a n in t h e past.

A l t h o u g h t h e o v e r a l l f o r m a t o f t h e

o u t p u t h a s i ~ 3 r o v e d . . . t h e r e are s t i l l [some]

p r o b l e m a r e a s [with t h e a u t o m a t i c

r e f o r m a t t i n g p r o g r a m ] .

A s a n experlment, t h e u n f o r m a t t e d ,

i n t e r l i n e a r [German-English] v e r s i o n w a s

u s e d for t h e i n i t i a l p o s t - e d l t i n g p h a s e .

T h e t e x t w a s t h e n r e f o r m a t t e d . . . a n d t h e 2nd

T h e M E T A L G e r m a n - E n g l l s h c o n f i g u r a t i o n w a s

r e l e a s e d for m a r k e t t e s t i n g i n J a n u a r y 1985.

C u r r e n t p l a n s a r e t o c o n t i n u e Imp~ r o v e m e n t o n

t h e p r e s e n t s y s t e m a n d to b r a n c h o f f i n t o

o t h e r t a r g e t languages, s p e c i f i c a l l y S p a n i s h

a n d C h i n e s e . W e e s t i m a t e t h a t a

G e r m a n - S p a n i s h s y s t e m s h o u l d b e r e a d y for

t e s t i n g s o m e t i m e in 1986, w i t h a

G e r m a n - C h l n e s e s y s t e m s o m e t i m e t h e r e a f t e r .

W e h a v e a l s o b e g u n w o r k i n g o n a n

E n g l l s h - G e r m a n system. If t h e p l a n n e d w o r k

is s u c c e s s ful, w o r k w l l I b e g i n o n

E n g l i s h - S p a n i s h a n d E n g l i s h - C h i n e s e M T

syst~m~.

R e f e r e n c e s

Slocum, J., a n d W. S. Bennett, "The L R C M a c h i n e T r a n s l a t i o n System: A n A p p l i c a t i o n o f S ~ a t e - o f - t h e - A r t T e x t a n d N a t u r a l L a n g u a g e P r o c e s s i n g T e c h n i q u e s to t h e T r a n s l a t i o n o f T e c h n i c a l Manuals, " W o r k i n g P a p e r L R C - 8 2 - 1 , L i n g u i s t i c s R e s e a r c h Center, U n i v e r s i t y o f Texas, J u l y 1982.

Slocum, J., e t al., "METAL: T h e L R C M a c h i n e T r a n s l a t i o n System, " p r e s e n t e d at t h e I S S C O T u t o r i a l o n M a c h i n e T r a n s l a t i o n , Lugano,

S w i t z e r l a n d , 2-6 A p r i l 1984. A l s o a v a i l a b l e

(4)

ooj

!

..-4

n . . . . U O C .C ~JO '0 e- 11~. 0

"~ • U g ~ U g ' ~ ~.-* • ~a U Q . , u O I~ .~ ~ ~ g , , . 4 ~ . , ~ r. m ;>,

U ~'.'~ > O-.-4,Q C O O . U -,4 0 0 @ ~, B C ~ . , " > - - ~,. @ ~ " ~ > G..~ OJ .IJ m > I.,,,¢: 3 C ~ ) > . ,,C(U U ~ . m ~ ~-.Q O k Q . : O ' ~ '.'4 ~ , C ~ r ' ~J'O e ~c

o Q, m B ~, -o ~,4,.1 u o

g 0 ~ " ~ r" ~" 0 0 • ea ~ J B g e - ~ 0 U ~ ~" , - * ~

U

£

~- > c . u , . , o ~ 0 ~ ] m ~ . , ~ e ~ . ® ¢ . ~ ® o ~ = ~ ~ : ~ • ® . > o , " ' ~ ' = ~ . ~ .~

o ~ • ~ o Q ,

¢ U 0 C B , . ~ m ~ O u ' ) ~ ) n3 <P J:: m ~,. "0 m ~ " ~

U ~ J , : ~ I ~ ",'* Q, q) U ~ g @ B ~J @ , ' ~ g O O L I , . O ~ . O . u t ~ U " Q , O .,.I , - ~ U

3 e L C ~ @ C O ~ m - r ' m C ~ ~ 4 0 ~ I.. ~ , ~ . n O~ , . ~ ~ @,-* ~ ~ ~.~,~ P ~J ,-~ "~ ~ ,.., e- ~ ~ U C U ~

e, g ~" @.C e'~., I., O~ : 3 ~ q;

N ~ C ~ C ' ~ m : ~ O ~ C ~ = U t . ~ . ~ m ~ m ~ c u

~ J ( ~ ~A > v] "O ~ U O ~ ; J 0 0

• ,,~ g ,..* m .,.~ s~ ~1 g ~ . . , L .U g e g " ~ ' ~ e

(5)

B

0 ~

*=~ "0 Vl f.. ,-I I J

oo.

o o o ~

~ : ~

~

,,.,4 .,,.~ E U k., 0 0 i . , d ~._

0 ,IJ4J

4J ~.,,4 ,,-¢

~ I ~ U ~ 0 • U

0 C . , . ~ U Vi ,,.~ ,~ ~. ~ ' ~ , , I..

° = ° ~ ' ~ ° "

" " ° ° °

- -

-

: o : o o

"

)~i

,

'

~

, ' o = .

~ . ~ ; . .

> (0 "0 .,-~ ~ • U I,. ' - ~l r ' 0 0 0 ~ . >

--, .,.., ..., N - , ~, .-, ',,., U .u U ~ ' ~ " ..,w 0 ~

- . ® - o ~ . ~ u f l

"0 ',-, ~i i . 0 ~ , ~ .,'~ r" 0 L ~ O O 0

. . o - o

. o . .

o

o ~ .

...oi~

:&~>

U ~ U O U O U k . : ~ m ~

0 ~ . I J 0 U ~ >,,;J

• ~ 0 ~ ~ = ~ U

U . - ~ . . ~ I J O e 0 J= . r ' O U l ~- g ~ i . , I J 0 B ; O 0 ,=i ,'d ',- .-~ U

Ill ~. .-I 0 " ~ ,~ ~. ~ • ~) ~) ~

O ~ ~ "'i g 0 g ~t t~ U U O . O I . r" Ch.~

, , , ~ ® . & ,,,-, I ~ . ~ , 5

'B&.'Io

,0>.

o > , ~ . , ~ , § ~ u , ~ ' ® ~ ® o ~ ' ~ ® ~

• ~ 0 .,.I " > U g 0 ,-'i ','~ *~ ',~ 3 c -,'( "0 .C:: 'l~ ~ u

U 0 ~ 0 f C

O U Q . e ~ U O O . W ~ . ~ O U O g . ~ • n e 0 . ~ U "~ • ,C := ea ~ "0 ~ (g m " l • U " 0 r" Q . ~ Q . U > '~

~.,.®~o ®,. . - , , . ® o . o ~ . : ~'@',-

U B L'J '10 • C~-~ ~. 0 ~ . 0 0 ~ C b ~ • ~ C U U

O 0 ~ g . ~ i . g ~) ~ ~I U ' O ~ Ul ~ W ~ k ~ ~) > U L U > g • ~ - - i C ~ , w L O ~ J

g ~l ~) > ' 0 i . 0 @ .,-I (I) O. ~ ,-i.kJ ~ ~ Vl ~ m , G . G ~ C (~',.., , C ~ , C ~ , O , C ; ~J O.-.i ~ r , m m •

C a ~ q , ~

o ~ o I

0 C O B ~

C

~ ' " g ; o o O ~

~

oo

g{

U ~ U

U t...

~ U N

~ ~ U

,,,i ,,-i U

i~ °

e , u o~-m ,urn 5 5 ~

m g i - ~ 0J

,.,= ~ ~ ~ & , ~ =

e,

m

..~ = c : o ~ , ® , o ~ = w ~ , ~ . , - ~

r . g '1~ : U l " O ~ : ~ I . ~ • O ~ C m U , I . I : " r' :,.. > , , - i

! '

°

. . . - . .

o.o

~ , , . ' ~ ' ~ C ~ L I-- '-- ~ ~ " ~ ~ ~ ' 0 ~ ~ ~ ~

~ ' m w "o i . ~ ® z o~,..,...,~ l a: . ® , a . ~ . ~ = c = c i . ~ i . c ~ ' o o~ i . o ~ ~ , . ' o o

i

° i ° " ° ° " ~ ° ° " ° " ' ° + ~ ~ °

° °

: < ' " ' " " °

°

I

~ i i

o

. . o , o

o , . o , , ,

o

. ~ . o o ~ o o

,~.

.in "0 r" ~ ~ ~ 'T g ~ .,l ~- ~; -&:; [ ~ ' U t : n . ,.CU • • . V d -~ : 31 ! ~ . ' 0 ~J , . • r ' , Q r" " . . ' 0 l . • := I~ ~ g ~ i n ~ , --~ 0 . u O

°

° °

~

,

° " °

" " " ° " °

" " ° ' "

°

I,

~ C:; r" B O~ q) OI g ' 0 ,..i e" ~ .1= ~ ~. g Q..~ r" Ui ~l e" J= ~ ~, I 1 U ~ l I1 e" ~. nl ~ g .. i t ' ~ . - - - N U ' O ~ ~ ( 4 e U r , E ~ , O ~ (I) ~ O O :3 g g "0 Q. O) i W O,-.I

" " ~ ' ~ " " " " ° ~ , . i ° ~

i U g . . . - I g C 0 : ~ I ~ 1 1 . ' . . , ~ r ' g C ~ , ~ , C r ' ~ . . ~ U

(6)

, ' ~ C > ~ . o r *

::3 ~ ' g U O O U r O r" ~.. I~ 0 1 ~ '0

• ,~ o L e "

, ; ~ 5 = =

l . J o o

- > o

- . ~ ~ . Q >

~ .,., . . , ® ® = ~ . ®

~.g

= - . o .

~ c" .,..~ ',.. 4~ 0 ~1 " a > 0 0

I/) 0 "I U U

,, ,., ~ o =

U Q . Q ',~ "0 O ~ ~ ~ Q 0 0 ~ 0

F.. " " § . ~. ® o , " , . . . ~ o . , "

0 U L U ,IJ L U I-, ¢0 g U

U ~ , ' = U • O ,'~1 e. ~ ,~ =.-~ I..,~ ~3~ > ,

G ,,,,, ,l.a~

• i.= " q ~ ' ~ l i 0 • u3

,~ > 0 ~" B U ~ U ~ , ~ ~II g ~ 0 ~ 0 ~ U ',- > 5 , , ~ o g

. , . ~ : ~ . - , ~ , - >,,, = ® . ® , , . . = 5 o . ® ~ o , ~

o 1 ~ U

,~ I ~ , q r ' L ~ • 0 ','~ ~'~ U O ~ U O ~ C U ~ 0 ' , ~ ~D ~ >

Q , ~ : ~ m E- , ~ L U O ~ o ~ e . , . t C , . . i m U . , * C "~ > ~ ~ e ¢ = • I- u

,~ ~ , - = , , = . , - , - ,.. = , , ,. o , ' = ) - , ® = , ' o , , = , . , , ' 5 = - ~ ~' ~ ~ = " ;

0 0 ~,,','~ ~ * .~ 0 • e~,-~ 0 0 ~ ' , ' ~ ' ~ I g , ~ El C * u L ~ C 6 a O ~ 0 ' ~ t. = 0 0 . , ~ t. U

o ~ • U ~ - m U ~ 1 U g g ' ~ ¢@ 0 O ~ ; " ' I t ~ O . 4 J ~-t L "(:1(11 0 ~ . "1 ~ (~ ~J r" ~ "1::1

> " ~ 0 ~ . ~ - 0 " ~ . ~ = L , ~ J L ~ e • ~ e ~ - C . . ~ u e ~ . , ~ ~ o ¢ > . . ~ . o

; . . . = o - 4 ® J'~.-,'~.., .-, " 8 , - , - ~ o , , . - o g ® ='~=> o ~ o . . .

b - ~ ~ , 0 C ,,C U > ~ t - , . C = U',-* L g m ~ cn .,'~U

o , ~ . 8 , ® ® 8' 8" ~. ®

~ ;:1Q,, . ~ .u le , I 5. k.

5

g

~) ~ m O ' * ~ . ~

~ ~ ~ 0 "" ~ ~

0 ~ C ~ 1

c' ~ 0~"~ ',J r - , , j ,.I • 3=

4.~ ~ hi c" I,.* S.

. . ~ , = = = , , = ~ . = = = = = = = = = = = = = = = = = = = = = = = = .= , , , , = ,., - . o - , .

(7)

u ~4 ~J

" ° " ' " " " ° ° ° . o o . . . o o . o

• 0 0 U ~ ~.T'J g.,-~ ~ ~ --'~U U ..~ ..~ ~ ~ . ~

O C O ~ ~ > , ~ ' , ~ > ~ . ~ @ ~ U e" ~ ~ 0 ~ . ~ , ~ 0 O 0

O ~ C ~ 0 v ' , ' ~ (D r ~ L ~ &=O > 0 ,... ,~ ~J ' ~ ,~ 3 ~*~ a~ 0 C ' 0 " * I~ " * ~ Q , ~s,.~ ~ ~

- - 0 ~ . C U ~ O ~ . ~ J - > ~ ; ~. . . - i > U ~

: 0','~ O. ~ ~'~,~ 0

-.~4J @ 4J ~1 ~ * - i Vl O > ~ 0

~-, ~ ' ~ • " ~ Q . ~ C 'I~ ~ r, .,.4 ' ~ 0 ~ 0 , ~ 4:; I.. . ~ --~ e o m ~] ' ~

L

~ - U O

~ . ~ ~ ~ e ~ - O ~ . ,'~ ~ ~ U * 0 0 0 : : 1 0 0 ~ Q. ~ ~. ,-.~ ~J .u @ I.. ~

~ ' ~ o

--~ ~ . . ~ • ~ 0 0 " 0 ~ t - O ~ {2. ~ : ~,E " ~ ,~ 0 , - ~ = ~ U ~1 ~J (~ ~ U " ~ O~ • ¢ ,,.~ ~-~ ~) • ~ ,~ U ~ , ~ c o , Q ~ > ~ ' m " ~ C > --I S- m ~. ~. B m,-~ r ' O~ .I-~ .,~ .,.~ U ~ " ~ ~ ~ > , m m L ~ ~ . m N e r ' m m " ~ r . ,'~ O ' O U ~:: ~ C ~. >..m • • ..~ ~ - . ~ • m ~ .- O ~ O ~JO~ g '1~ ~ t . . : - B . , ~ 0 O" 0 g ~ - ~ ¢i~J C )., I.. ~ . - ~ ~ J 3

J ~ O g a ~ 4 J O ~ J 0 - = ~ 0 2 ~ " ~ : ~ ~ J O U ~ & I . ~ l i ~ 0 . ~ " ~ . C C ~ - q O 0 g L O @ ~ ' ~ e ¢ U , '-¢ '~ C ~ .,-I e ' ' O • ~I,~ >~ O ~ U

U ~ . . > U ~

o w , o E ~ , . g ~" " O U --~ "0 ~ g ~ 8 ~ n _ l g ~ ~ ~ . ~ ~ ~ ;: := ,,~ ~.. ~I C C - ~ . ~

~ . ~ . . . ~ ® ~ : , ~ ®,.. ,,., ,', . . ~ ® . ~ ~ . ~ c " P , ~ ~ e

~, , m ~ . ~ . ,~ .c L ~. ® e ® u ~ ~ . N . . ~ U . ~ ' ~ - .~ ~a ~ . ~ O ~ . C ' . ' O ~

~ ~ C 0

g ~ J ~1 4 J O

®~=o,,,~

§=

(8)

J

z

O ~ , ~ U U r" ~ " E I -u o U e ~ U ~ a u m ~j L ~ j:: L

m ~ J ~1 x ~ o

~'~ ~ ~ . . . ~ 0 i..

• .~ 0 .,-I U ~., ~,J t . , ~ l 0 v n C-,'* • >.,'~ ~ g e e ~ J ~- n-" ~ ' 0

0 ~...4 ~ 0 0 0

,, ~ . , ~ ~ . . = . = ' o - ~ . ' o u o, o o

.U .,.~ ~ .,..e ~ 0 ~'* ~ 0 ~ . 1

,..* ~ r ' 0 O S - ~ ~ L O O i ~ C ~ C U ~- 0 ¢1 ,,.< I,.. U ~ ~, C -'~ • ~. -'~ O ~ ) > C C ~ e , f , . B M L ,,=i .,-I ~, .,.,i ~ g " ~J O~4J ~ ,,.i

0 , 1 = > { : C m u ~ u m @ ~ U ~

O g ~ C U g O g • C i ~ '~ ." I,) J~ R . ~ 0 ,,.,~ I . U ,-~ .,-~ t., ~1 ," r~ ~ . , I g .-,I ~ ~,~ U 0 "0 .,-~ • E,.~ ~ r" " ~ U . U ~ 0 ~ .u ).. 0 U.,-I ~,..,-I ' - ~,..,~ ~ . , u ~ ~ ~ ~.,-.~ ~ ~J g ~ . ~ ' C I J~ ~J C • U ...~ .-i I.. ~ n - O 0 L ~:~ 0 . ~ L- ~

"O ~ Q O Q . Q , r" O ~ g g ~ ZJ ~ Q , " O ' ~ ~ | ~J ~J ~ U > ' U J~

< ~ ~ ~ - ~ , > . - ~ . ~ . . . .

,,,r= ~" C ' ~ ~11 ~J ,-~ ~ U ~ O" O ~ O . .

m ~ ...~ .~ . g ~ ~=.,.~ r ' ~ . ~ n g 0 , , . ~

,,-~ n< g ..4 ~J ~1 b. ¢1 O 0 g 4J C~'~ g ~' ~ - 4 g ~-I i.. N (11 e

¢q U t~ -"1J~ g f,,, 'El t" ¢1 g 4J g J~ I~ g },,, I,, N 'O 4J P' c" g } , . ~ r ' O I ~ 1 ~ .~ - i i,,, e,, U

• ,=1 .,.< ~ g

O g U

References

Related documents

INVESTIGATING THE RELATIONSHIP BETWEEN SERVICE QUALITY AND CUSTOMER LOYALTY IN MELLI BANK OF GOLESTAN BRANCH.. Aliakbar Aghaei,

Numerical results for the stress intensity factors at the crack tips and the interaction of the outer cracks on the central one and conversely through stress magnification factors

In the present study, the elastic orthotic belt resulted in significant decrease of TK with an average decrease of 10.4°. Milwaukee brace could also cause significant reduction of

Analysis of variance and mean squares for kenaf plant density, plant height, stem diameter, and biomass and ethanol yield for two row spacings (RS) and four plant densities

A meta-analysis of 12 studies with 24,520 patients comparing outcomes before and after implementation of NIs demonstrated significantly lower mortality rates (p = 0.01) and

Employment is defined as all employees on the books (employment register) of a company who are engaged on ECSC activities. Included are manual workers, staff and

Pressure coefficients (C P ) plotted as a function of location (pressure port) along dorsal antero-posterior transects (A,C) and ventral antero-posterior transects (B,D) on the

Figure B.7 shows the relative time taken for the different sub-pattern efficiency based matching methods on differently sorted collections compared to the original matching method.