Universal Dependencies
Joakim Nivre
!
Uppsala University
Department of Linguistics and Philology
Based on collaborative work with Jinho Choi, Timothy Dozat, Filip Ginter,
Yoav Goldberg, Jan Haji
č, Chris Manning, Ryan McDonald, Natalia Silveira,
Natural Language Processing
•
Linguistic diversity makes our life harder
Why 90% parsing accuracy for English but only 80% for Finnish?
Can we even compare the numbers?
Natural Language Processing
•
Linguistic diversity makes our life harder
Why 90% parsing accuracy for English but only 80% for Finnish?
Can we even compare the numbers?
•
Current NLP relies heavily on linguistic annotation
Treebank annotation schemes vary across languages
How do we avoid comparing apples and oranges?
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language X
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language X
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language X
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language Y
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language Z
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language X
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language Y
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language Z
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language X
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language Y
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language Z
Which languages are most closely related?
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language X
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language Y
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language Z
Which languages are most closely related?
1/5
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language X
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language Y
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language Z
Which languages are most closely related?
1/5
2/5
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language X
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language Y
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager r˚ader og møs
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
1
Language Z
Which languages are most closely related?
1/5
2/5
2/5
Swedish
Danish
English
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
toutefois , les fille adorer les dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1
En katt jagar r˚attor och m¨oss det nsubj conj
dobj
conj
En kat jager rotter og mus nsubj
? dobj cc conj
A cat chases rats and mice det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts . toutefois , les fille adorer les dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
toutefois , les fille adorer les dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc
Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1
Why is this a problem?
Why is this a problem?
•
Hard to compare empirical results across languages
Why is this a problem?
•
Hard to compare empirical results across languages
•
Hard to evaluate cross-lingual learning
Why is this a problem?
•
Hard to compare empirical results across languages
•
Hard to evaluate cross-lingual learning
•
Hard to build and maintain multilingual systems
Universal Dependencies
http://universaldependencies.github.io/docs/
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1
Universal Dependencies
http://universaldependencies.github.io/docs/
Part-of-speech tags
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1
Universal Dependencies
http://universaldependencies.github.io/docs/
Part-of-speech tags
Morphological features
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1
Universal Dependencies
http://universaldependencies.github.io/docs/
Part-of-speech tags
Morphological features
Dependency relations
En katt jagar r˚attor och m¨oss
det nsubj conj
dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1
Universal Dependencies
http://universaldependencies.github.io/docs/
Universal Dependencies
http://universaldependencies.github.io/docs/
Stanford
Dependencies
Universal Dependencies
http://universaldependencies.github.io/docs/
Stanford
Dependencies
Universal Dependencies
http://universaldependencies.github.io/docs/
Stanford
Dependencies
CLEAR
Google UD
Universal Dependencies
http://universaldependencies.github.io/docs/
Stanford
Dependencies
CLEAR
Google UD
Stanford UD
Universal Dependencies
http://universaldependencies.github.io/docs/
Stanford
Dependencies
CLEAR
Google UD
Stanford UD
HamleDT
Universal Dependencies
http://universaldependencies.github.io/docs/
Stanford
Dependencies
CLEAR
Google UD
Stanford UD
HamleDT
Interset
Universal Dependencies
http://universaldependencies.github.io/docs/
Stanford
Dependencies
CLEAR
Google UD
Stanford UD
HamleDT
Interset
universal tags
Universal Dependencies
http://universaldependencies.github.io/docs/
•
Milestones:
•
Kick-off meeting at EACL in Gothenburg, April 2014
•
Release of annotation guidelines, Version 1, October 2014
•Release of treebanks for 10 languages, January 2015
•
Release of treebanks for 18 languages, May 2015
•
Open community effort – anyone can contribute!
Universal Dependencies
http://universaldependencies.github.io/docs/
Goals and Requirements
Goals and Requirements
•
Cross-linguistically consistent grammatical annotation
Goals and Requirements
•
Cross-linguistically consistent grammatical annotation
•
Support multilingual research and development in NLP
Design Principles
•
Dependency
•
Widely used in practical NLP systems
Design Principles
•
Dependency
•
Widely used in practical NLP systems
•
Available in treebanks for many languages
•
Lexicalism
•
Basic annotation units are words – syntactic words
•Words have morphological properties
Design Principles
•
Dependency
•
Widely used in practical NLP systems
•
Available in treebanks for many languages
•
Lexicalism
•
Basic annotation units are words – syntactic words
•Words have morphological properties
•
Words enter into syntactic relations
•
Recoverability
Golden Rules
Maximize parallelism
•
Don’t annotate the same thing in different ways
•Don’t make different things look the same
Golden Rules
Maximize parallelism
•
Don’t annotate the same thing in different ways
•Don’t make different things look the same
But don’t overdo it
•
Don’t annotate things that are not there
•
Languages select from a universal pool of categories
•Allow language-specific extensions
Morphology
En katt jagar r˚attor och m¨ossdet nsubj conj dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
toutefois , les fille adorer les dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1
•
Lemma representing the semantic content of the word
En katt jagar r˚attor och m¨oss
det nsubj conj dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
toutefois , le fille adorer le dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct
Toutefois , les filles adorent les desserts .
toutefois , le fille adorer les dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1
Morphology
En katt jagar r˚attor och m¨ossdet nsubj conj dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
toutefois , les fille adorer les dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1
•
Lemma representing the semantic content of the word
•
Part-of-speech tag representing the abstract lexical
category associated with the word
En katt jagar r˚attor och m¨oss
det nsubj conj dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
toutefois , le fille adorer le dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct
Toutefois , les filles adorent les desserts .
toutefois , le fille adorer les dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1
Morphology
En katt jagar r˚attor och m¨ossdet nsubj conj dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
toutefois , les fille adorer les dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1 En katt jagar r˚attor och m¨oss
det nsubj conj dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
toutefois , les fille adorer les dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1
•
Lemma representing the semantic content of the word
•
Part-of-speech tag representing the abstract lexical
category associated with the word
•
Features representing lexical and grammatical properties
associated with the lemma or the particular word form
En katt jagar r˚attor och m¨oss
det nsubj conj dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
toutefois , le fille adorer le dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct
Toutefois , les filles adorent les desserts .
toutefois , le fille adorer les dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1
Morphology
En katt jagar r˚attor och m¨ossdet nsubj conj dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
toutefois , les fille adorer les dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1 En katt jagar r˚attor och m¨oss
det nsubj conj dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
toutefois , les fille adorer les dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1 En katt jagar r˚attor och m¨oss
det nsubj conj dobj
conj
En kat jager rotter og mus
nsubj
? dobj cc conj
A cat chases rats and mice
det nsubj dobj cc
conj
Toutefois , les filles adorent les desserts .
toutefois , les fille adorer les dessert .
ADV PUNCT DET NOUN VERB DET NOUN PUNCT
Definite=Def Gender=Fem Number=Plur Definite=Def Gender=Masc Number=Plur Number=Plur Person=3 Number=Plur Number=Plur
Tense=Pres advmod punct det nsubj root det dobj punct 1
•
Taxonomy of 17 universal part-of-speech tags, based on
the Google Universal Tagset (Petrov et al., 2012)
•
All languages use the same inventory, but not all tags
have to be used by all languages
Part-of-Speech Tags
Open Closed Other
ADJ ADP PUNCT ADV AUX SYM INTJ CONJ X NOUN DET PROPN NUM VERB PART PRON SCONJ
Features
•
Standardized inventory of morphological features, based
on the Interset system (Zeman, 2008)
•
Languages select relevant features and can add
language-specific features or values with documentation
Lexical Inflectional Nominal Inflectional Verbal
PronType Gender VerbForm NumType Animacy Mood
Poss Number Tense Reflex Case Aspect
Definite Voice Degree Person
Syntax
The cat could have chased all the dogs down the street .
DET NOUN AUX AUX VERB DET DET NOUN ADP DET NOUN PUNCT
det nsubj aux aux root det det dobj case det nmod punct
The cat could have chased all the dogs down the street .
DET NOUN AUX AUX VERB DET DET NOUN ADP DET NOUN PUNCT
det nsubj aux aux root det det dobj case det nmod
The cat could have chased all the dogs down the street .
DET NOUN AUX AUX VERB DET DET NOUN ADP DET NOUN PUNCT
nsubj
root
dobj
nmod
Syntax
•
Content words are related by dependency relations
The cat could have chased all the dogs down the street .
DET NOUN AUX AUX VERB DET DET NOUN ADP DET NOUN PUNCT det nsubj aux aux root det det dobj case det nmod punct
The cat could have chased all the dogs down the street .
DET NOUN AUX AUX VERB DET DET NOUN ADP DET NOUN PUNCT det nsubj aux aux root det det dobj case det nmod
The cat could have chased all the dogs down the street .
DET NOUN AUX AUX VERB DET DET NOUN ADP DET NOUN PUNCT nsubj
root
dobj
nmod
Syntax
•
Content words are related by dependency relations
•
Function words attach to the content word they modify
The cat could have chased all the dogs down the street .
DET NOUN AUX AUX VERB DET DET NOUN ADP DET NOUN PUNCT
det nsubj aux aux root det det dobj case det nmod punct
The cat could have chased all the dogs down the street .
DET NOUN AUX AUX VERB DET DET NOUN ADP DET NOUN PUNCT
det nsubj aux aux root det det dobj case det nmod
The cat could have chased all the dogs down the street .
DET NOUN AUX AUX VERB DET DET NOUN ADP DET NOUN PUNCT
nsubj
root
dobj
nmod
Syntax
•
Content words are related by dependency relations
•
Function words attach to the content word they modify
•
Punctuation attach to head of phrase or clause
The cat could have chased all the dogs down the street .
DET NOUN AUX AUX VERB DET DET NOUN ADP DET NOUN PUNCT det nsubj aux aux root det det dobj case det nmod punct
The cat could have chased all the dogs down the street .
DET NOUN AUX AUX VERB DET DET NOUN ADP DET NOUN PUNCT det nsubj aux aux root det det dobj case det nmod
The cat could have chased all the dogs down the street .
DET NOUN AUX AUX VERB DET DET NOUN ADP DET NOUN PUNCT nsubj
root
dobj
nmod
The
dog
was
chased
by
the
cat
.
DET NOUN AUX VERB ADP DET NOUN PUNCT
det nsubjpass auxpass root case det nmod punctHunden
jagades
av
katten
.
NOUN
VERB
ADP
NOUN
PUNCT
Definite=Def Voice=Pass
Definite=Def
nsubjpassroot
case nmod
punct
The
dog
was
chased
by
the
cat
.
DET NOUN AUX VERB ADP DET NOUN PUNCT
nsubjpassroot
nmod
punct
Hunden
jagades
av
katten
.
NOUN
VERB
ADP
NOUN
PUNCT
Definite=Def Voice=Pass
Definite=Def
nsubjpass
root
nmod
punct
The
dog
was
chased
by
the
cat
.
DET NOUN AUX VERB ADP DET NOUN PUNCT
det nsubjpass root det nmod punctHunden
jagades
av
katten
.
NOUN
VERB
ADP
NOUN
PUNCT
Definite=Def
Voice=Pass
Definite=Def
nsubjpassroot
nmod
punct
The
dog
was
chased
by
the
cat
.
DET NOUN AUX VERB ADP DET NOUN PUNCT
det nsubjpass auxpass root case det nmod punct
Hunden
jagades
av
katten
.
NOUN
VERB
ADP
NOUN
PUNCT
Definite=Def Voice=Pass
Definite=Def
nsubjpass
root
case nmod
punct
The
dog
was
chased
by
the
cat
.
DET NOUN AUX VERB ADP DET NOUN PUNCT
nsubjpass
root
nmod
punct
Hunden
jagades
av
katten
.
NOUN
VERB
ADP
NOUN
PUNCT
Definite=Def Voice=Pass
Definite=Def
nsubjpass
root
nmod
punct
The
dog
was
chased
by
the
cat
.
DET NOUN AUX VERB ADP DET NOUN PUNCT
det nsubjpass root det nmod punct
Hunden
jagades
av
katten
.
NOUN
VERB
ADP
NOUN
PUNCT
Definite=Def
Voice=Pass
Definite=Def
nsubjpass
root
nmod
punct
The
dog
was
chased
by
the
cat
.
DET NOUN AUX VERB ADP DET NOUN PUNCT
det nsubjpass auxpass root det nmod punct
Hunden
jagades
av
katten
.
NOUN
VERB
ADP
NOUN
PUNCT
Definite=Def Voice=Pass
Definite=Def
nsubjpassroot
nmod
punct
The
dog
was
chased
by
the
cat
.
DET NOUN AUX VERB ADP DET NOUN PUNCT
det nsubjpass auxpass root case det nmod punct
Hunden
jagades
av
katten
.
NOUN
VERB
ADP
NOUN
PUNCT
Definite=Def Voice=Pass
Definite=Def
nsubjpass
root
case nmod
punct
The
dog
was
chased
by
the
cat
.
DET NOUN AUX VERB ADP DET NOUN PUNCT
nsubjpass
root
nmod
punct
Hunden
jagades
av
katten
.
NOUN
VERB
ADP
NOUN
PUNCT
Definite=Def Voice=Pass
Definite=Def
nsubjpass
root
nmod
punct
The
dog
was
chased
by
the
cat
.
DET NOUN AUX VERB ADP DET NOUN PUNCT
det nsubjpass root det nmod punct
Hunden
jagades
av
katten
.
NOUN
VERB
ADP
NOUN
PUNCT
Definite=Def
Voice=Pass
Definite=Def
nsubjpass
root
nmod
punct
Dependency Relations
•
Taxonomy of 40 universal grammatical relations, broadly
attested in language typology (de Marneffe et al., 2014)
Dependency Relations
•
Taxonomy of 40 universal grammatical relations, broadly
attested in language typology (de Marneffe et al., 2014)
•
Language-specific
subtypes
may be added
•
Organizing principles
•
Three types of structures: nominals, clauses, modifiers
Dependents of Clausal Predicates
Nominal
Clausal
Other
Core
nsubj
nsubjpass
dobj
iobj
csubj
csubjpass
ccomp
xcomp
Non-Core
nmod
vocative
discourse
expl
advcl
advmod
neg
aux
auxpass
cop
mark
punct
Mary was quietly reading a book in the garden .
PROPN AUX ADV VERB DET NOUN ADP DET NOUN PUNCT
nsubj aux advmod root det dobj case det nmod punct
If you are sick , you should not exercise .
SCONJ PRON AUX ADJ PUNCT PRON AUX ADV VERB PUNCT
mark nsubj cop advcl punct nsubj aux neg root punct
Peter thought that he should stop smoking .
PROPN VERB SCONJ PRON AUX VERB VERB PUNCT
nsubj root mark nsubj aux ccomp xcomp punct
Cairo , the lovely capital of Egypt
PROPN PUNCT DET ADJ NOUN ADP PROPN
mark det amod appos case nmod
Hewey , Dewey and Louie
PROPN PUNCT PROPN CONJ PROPN punct
conj
cc
conj
Mary was quietly reading a book in the garden .
PROPN AUX ADV VERB DET NOUN ADP DET NOUN PUNCT
nsubj aux advmod root det dobj case det nmod punct
If you are sick , you should not exercise .
SCONJ PRON AUX ADJ PUNCT PRON AUX ADV VERB PUNCT
mark nsubj cop advcl punct nsubj aux neg root punct
Peter thought that he should stop smoking .
PROPN VERB SCONJ PRON AUX VERB VERB PUNCT
nsubj root mark nsubj aux ccomp xcomp punct
Cairo , the lovely capital of Egypt
PROPN PUNCT DET ADJ NOUN ADP PROPN
mark det amod appos case nmod
Hewey , Dewey and Louie
PROPN PUNCT PROPN CONJ PROPN punct
conj
cc
conj
5
Mary was quietly reading a book in the garden .
PROPN AUX ADV VERB DET NOUN ADP DET NOUN PUNCT
nsubj aux advmod root det dobj case det nmod punct
If you are sick , you should not exercise .
SCONJ PRON AUX ADJ PUNCT PRON AUX ADV VERB PUNCT
mark nsubj cop advcl punct nsubj aux neg root punct
Peter thought that he should stop smoking .
PROPN VERB SCONJ PRON AUX VERB VERB PUNCT
nsubj root mark nsubj aux ccomp xcomp punct
Cairo , the lovely capital of Egypt
PROPN PUNCT DET ADJ NOUN ADP PROPN
mark det amod appos case nmod
Hewey , Dewey and Louie
PROPN PUNCT PROPN CONJ PROPN punct
conj
cc
conj
Mary was quietly reading a book in the garden .
PROPN AUX ADV VERB DET NOUN ADP DET NOUN PUNCT
nsubj aux advmod root det dobj case det nmod punct
If you are sick , you should not exercise .
SCONJ PRON AUX ADJ PUNCT PRON AUX ADV VERB PUNCT
mark nsubj cop advcl punct nsubj aux neg root punct
Peter thought that he should stop smoking .
PROPN VERB SCONJ PRON AUX VERB VERB PUNCT
nsubj root mark nsubj aux ccomp xcomp punct
Cairo , the lovely capital of Egypt
PROPN PUNCT DET ADJ NOUN ADP PROPN
mark det amod appos case nmod
Hewey , Dewey and Louie
PROPN PUNCT PROPN CONJ PROPN punct
conj
cc
conj
5
Mary was quietly reading a book in the garden .
PROPN AUX ADV VERB DET NOUN ADP DET NOUN PUNCT
nsubj aux advmod root det dobj case det nmod punct
If you are sick , you should not exercise .
SCONJ PRON AUX ADJ PUNCT PRON AUX ADV VERB PUNCT
mark nsubj cop advcl punct nsubj aux neg root punct
Peter thought that he should stop smoking .
PROPN VERB SCONJ PRON AUX VERB VERB PUNCT
nsubj root mark nsubj aux ccomp xcomp punct
Cairo , the lovely capital of Egypt
PROPN PUNCT DET ADJ NOUN ADP PROPN
mark det amod appos case nmod
Hewey , Dewey and Louie
PROPN PUNCT PROPN CONJ PROPN punct
conj
cc
conj
5
Mary was quietly reading a book in the garden .
PROPN AUX ADV VERB DET NOUN ADP DET NOUN PUNCT
nsubj aux advmod root det dobj case det nmod punct
If you are sick , you should not exercise .
SCONJ PRON AUX ADJ PUNCT PRON AUX ADV VERB PUNCT
mark nsubj cop advcl punct nsubj aux neg root punct
Peter thought that he should stop smoking .
PROPN VERB SCONJ PRON AUX VERB VERB PUNCT
nsubj root mark nsubj aux ccomp xcomp punct
Cairo , the lovely capital of Egypt
PROPN PUNCT DET ADJ NOUN ADP PROPN
mark det amod appos case nmod
Hewey , Dewey and Louie
PROPN PUNCT PROPN CONJ PROPN punct
conj
cc
conj
Dependents of Nominals
Nominal
Clausal
Other
nummod
appos
nmod
acl
amod
det
case
Mary was quietly reading a book in the garden .
PROPN AUX ADV VERB DET NOUN ADP DET NOUN PUNCT
nsubj aux advmod root det dobj case det nmod punct
If you are sick , you should not exercise .
SCONJ PRON AUX ADJ PUNCT PRON AUX ADV VERB PUNCT
mark nsubj cop advcl punct nsubj aux neg root punct
Peter thought that he should stop smoking .
PROPN VERB SCONJ PRON AUX VERB VERB PUNCT
nsubj root mark nsubj punct ccomp xcomp punct
Cairo , the lovely capital of Egypt
PROPN PUNCT DET ADJ NOUN ADP PROPN
mark det amod appos case nmod 5
•
Coordinate structures are headed by the first conjunct
•
Subsequent conjuncts depend on it via the
conj
relation
•Conjunctions depend on it via the
cc
relation
•
Punctuation marks depend on it via the
punct
relation
Mary
was
quietly reading
a
book
in
the
garden
.
PROPN AUX
ADV
VERB DET NOUN ADP DET NOUN PUNCT
nsubj aux advmod root det dobj case det nmod punct
If
you
are
sick
,
you
should
not
exercise
.
SCONJ PRON AUX ADJ PUNCT PRON
AUX
ADV
VERB
PUNCT
mark nsubj cop advcl punct nsubj aux neg root punct
Peter
thought
that
he
should
stop
smoking
.
PROPN
VERB
SCONJ PRON
AUX
VERB
VERB
PUNCT
nsubj root mark nsubj aux ccomp xcomp punct
Cairo
,
the
lovely capital
of
Egypt
PROPN PUNCT DET
ADJ
NOUN ADP PROPN
mark det amod appos case nmod
Huey
,
Dewey
and
Louie
PROPN PUNCT PROPN CONJ PROPN
punct conj cc conj5
Coordination
Coordination
conj
cc
(punct)
Multiword Expressions
•
UD annotation does not permit “words with spaces”
•
Multiword expressions are analysed using special relations
•The
mwe
,
name
and
goeswith
relations are always head-initial
•
The
compound
relation reflects the internal structure
Relation
Examples
mwe
in spite of, as well as, ad hoc
name
Roger Bacon, Carl XVI Gustaf, New York
compound
phone book, four thousand, dress up
Other Relations
Relation
Explanation
parataxis
Loosely linked clauses of same rank
list
Lists without syntactic structure
remnant
Orphans in ellipsis linked to parallel elements
reparandum Disfluency linked to (speech) repair
foreign
Elements within opaque stretches of code switching
dep
Unspecified dependency
Language-Specific Relations
•
Language-specific relations are
subtypes
of universal
relations added to capture important phenomena
•
Subtyping permits us to “back off” to universal relations
Relation
Explanation
acl:relcl
Relative clause
compound:prt
Verb particle (
dress
up
)
nmod:poss
Genitive nominal (
Mary’s
book
)
nmod:agent
Agent in passive (
saved
by the bell
)
cc:preconj
Preconjunction (
both
…
and
)
det:predet
Predeterminer (
all
those
…)
Papers
Nivre, J. (2015) Towards a Universal Grammar of Natural Language Processing. In Proceedings of CICLing, 3–16.
Naseem, T., Chen, H., Barzilay, R. and Johnson, M. (2010) Using Universal Linguistic Knowledge to Guide Grammar Induction. In Proceedings of EMNLP, 1234-1244.
McDonald, R., Petrov, S. and Hall, K. (2011) Multi-Source Transfer of Delexicalized Dependency Parsers. In
Proceedings of EMNLP, 62–72.
Zeman, D., Marecek, D., Popel, M., Ramasamy, L., Stepánek, J., Zabokrtský, Z., Hajic, J. (2012) HamleDT: To Parse or Not to Parse? In Proceedings of LREC, 2735–2741.
McDonald, R., Nivre, J., Quirmbach-Brundage, Y., Goldberg, Y., Das, D., Ganchev, K., Hall, K., Petrov, S., Zhang, H., Täckström, O., Bedini, C., Bertomeu Castelló, N. and Lee, J. (2013) Universal Dependency Annotation for
Multilingual Parsing. In Proceedings of ACL (Short Papers), 92–97.
De Marneffe, M.-C., Dozat, T., Silveira, N., Haverinen, K., Ginter, F., Nivre, J. and Manning, C.D. (2014) Universal Stanford Dependencies: A Cross-Linguistic Typology. In Proceedings of LREC, 4585–4592.
Swanson, B. and Charniak, E. (2014) Data Driven Language Transfer Hypotheses. In Proceedings of EACL, 169–173. Östling, R. (2015) Word Order Typology through Multilingual Word Alignment. In Proceedings of ACL (Short Papers), 205–211.
Futrell, R., Mahowald, K. and Gibson, E. (2015) Quantifying Word Order Freedom in Dependency Corpora. In
Papers
Nivre, J. (2015) Towards a Universal Grammar of Natural Language Processing. In Proceedings of CICLing, 3–16.
Naseem, T., Chen, H., Barzilay, R. and Johnson, M. (2010) Using Universal Linguistic Knowledge to Guide Grammar Induction. In Proceedings of EMNLP, 1234-1244.
McDonald, R., Petrov, S. and Hall, K. (2011) Multi-Source Transfer of Delexicalized Dependency Parsers. In
Proceedings of EMNLP, 62–72.
Zeman, D., Marecek, D., Popel, M., Ramasamy, L., Stepánek, J., Zabokrtský, Z., Hajic, J. (2012) HamleDT: To Parse or Not to Parse? In Proceedings of LREC, 2735–2741.
McDonald, R., Nivre, J., Quirmbach-Brundage, Y., Goldberg, Y., Das, D., Ganchev, K., Hall, K., Petrov, S., Zhang, H., Täckström, O., Bedini, C., Bertomeu Castelló, N. and Lee, J. (2013) Universal Dependency Annotation for
Multilingual Parsing. In Proceedings of ACL (Short Papers), 92–97.
De Marneffe, M.-C., Dozat, T., Silveira, N., Haverinen, K., Ginter, F., Nivre, J. and Manning, C.D. (2014) Universal Stanford Dependencies: A Cross-Linguistic Typology. In Proceedings of LREC, 4585–4592.
Swanson, B. and Charniak, E. (2014) Data Driven Language Transfer Hypotheses. In Proceedings of EACL, 169–173. Östling, R. (2015) Word Order Typology through Multilingual Word Alignment. In Proceedings of ACL (Short Papers), 205–211.
Futrell, R., Mahowald, K. and Gibson, E. (2015) Quantifying Word Order Freedom in Dependency Corpora. In
Papers
Nivre, J. (2015) Towards a Universal Grammar of Natural Language Processing. In Proceedings of CICLing, 3–16.
Naseem, T., Chen, H., Barzilay, R. and Johnson, M. (2010) Using Universal Linguistic Knowledge to Guide Grammar Induction. In Proceedings of EMNLP, 1234-1244.
McDonald, R., Petrov, S. and Hall, K. (2011) Multi-Source Transfer of Delexicalized Dependency Parsers. In
Proceedings of EMNLP, 62–72.
Zeman, D., Marecek, D., Popel, M., Ramasamy, L., Stepánek, J., Zabokrtský, Z., Hajic, J. (2012) HamleDT: To Parse or Not to Parse? In Proceedings of LREC, 2735–2741.
McDonald, R., Nivre, J., Quirmbach-Brundage, Y., Goldberg, Y., Das, D., Ganchev, K., Hall, K., Petrov, S., Zhang, H., Täckström, O., Bedini, C., Bertomeu Castelló, N. and Lee, J. (2013) Universal Dependency Annotation for
Multilingual Parsing. In Proceedings of ACL (Short Papers), 92–97.
De Marneffe, M.-C., Dozat, T., Silveira, N., Haverinen, K., Ginter, F., Nivre, J. and Manning, C.D. (2014) Universal Stanford Dependencies: A Cross-Linguistic Typology. In Proceedings of LREC, 4585–4592.
Swanson, B. and Charniak, E. (2014) Data Driven Language Transfer Hypotheses. In Proceedings of EACL, 169–173. Östling, R. (2015) Word Order Typology through Multilingual Word Alignment. In Proceedings of ACL (Short Papers), 205–211.
Futrell, R., Mahowald, K. and Gibson, E. (2015) Quantifying Word Order Freedom in Dependency Corpora. In
Papers
Nivre, J. (2015) Towards a Universal Grammar of Natural Language Processing. In Proceedings of CICLing, 3–16.
Naseem, T., Chen, H., Barzilay, R. and Johnson, M. (2010) Using Universal Linguistic Knowledge to Guide Grammar Induction. In Proceedings of EMNLP, 1234-1244.
McDonald, R., Petrov, S. and Hall, K. (2011) Multi-Source Transfer of Delexicalized Dependency Parsers. In
Proceedings of EMNLP, 62–72.
Zeman, D., Marecek, D., Popel, M., Ramasamy, L., Stepánek, J., Zabokrtský, Z., Hajic, J. (2012) HamleDT: To Parse or Not to Parse? In Proceedings of LREC, 2735–2741.
McDonald, R., Nivre, J., Quirmbach-Brundage, Y., Goldberg, Y., Das, D., Ganchev, K., Hall, K., Petrov, S., Zhang, H., Täckström, O., Bedini, C., Bertomeu Castelló, N. and Lee, J. (2013) Universal Dependency Annotation for
Multilingual Parsing. In Proceedings of ACL (Short Papers), 92–97.
De Marneffe, M.-C., Dozat, T., Silveira, N., Haverinen, K., Ginter, F., Nivre, J. and Manning, C.D. (2014) Universal Stanford Dependencies: A Cross-Linguistic Typology. In Proceedings of LREC, 4585–4592.
Swanson, B. and Charniak, E. (2014) Data Driven Language Transfer Hypotheses. In Proceedings of EACL, 169–173. Östling, R. (2015) Word Order Typology through Multilingual Word Alignment. In Proceedings of ACL (Short Papers), 205–211.
Futrell, R., Mahowald, K. and Gibson, E. (2015) Quantifying Word Order Freedom in Dependency Corpora. In
Papers
Nivre, J. (2015) Towards a Universal Grammar of Natural Language Processing. In Proceedings of CICLing, 3–16.
Naseem, T., Chen, H., Barzilay, R. and Johnson, M. (2010) Using Universal Linguistic Knowledge to Guide Grammar Induction. In Proceedings of EMNLP, 1234-1244.
McDonald, R., Petrov, S. and Hall, K. (2011) Multi-Source Transfer of Delexicalized Dependency Parsers. In
Proceedings of EMNLP, 62–72.
Zeman, D., Marecek, D., Popel, M., Ramasamy, L., Stepánek, J., Zabokrtský, Z., Hajic, J. (2012) HamleDT: To Parse or Not to Parse? In Proceedings of LREC, 2735–2741.
McDonald, R., Nivre, J., Quirmbach-Brundage, Y., Goldberg, Y., Das, D., Ganchev, K., Hall, K., Petrov, S., Zhang, H., Täckström, O., Bedini, C., Bertomeu Castelló, N. and Lee, J. (2013) Universal Dependency Annotation for
Multilingual Parsing. In Proceedings of ACL (Short Papers), 92–97.
De Marneffe, M.-C., Dozat, T., Silveira, N., Haverinen, K., Ginter, F., Nivre, J. and Manning, C.D. (2014) Universal Stanford Dependencies: A Cross-Linguistic Typology. In Proceedings of LREC, 4585–4592.
Swanson, B. and Charniak, E. (2014) Data Driven Language Transfer Hypotheses. In Proceedings of EACL, 169–173. Östling, R. (2015) Word Order Typology through Multilingual Word Alignment. In Proceedings of ACL (Short Papers), 205–211.
Futrell, R., Mahowald, K. and Gibson, E. (2015) Quantifying Word Order Freedom in Dependency Corpora. In
Papers
Nivre, J. (2015) Towards a Universal Grammar of Natural Language Processing. In Proceedings of CICLing, 3–16.
Naseem, T., Chen, H., Barzilay, R. and Johnson, M. (2010) Using Universal Linguistic Knowledge to Guide Grammar Induction. In Proceedings of EMNLP, 1234-1244.
McDonald, R., Petrov, S. and Hall, K. (2011) Multi-Source Transfer of Delexicalized Dependency Parsers. In
Proceedings of EMNLP, 62–72.
Zeman, D., Marecek, D., Popel, M., Ramasamy, L., Stepánek, J., Zabokrtský, Z., Hajic, J. (2012) HamleDT: To Parse or Not to Parse? In Proceedings of LREC, 2735–2741.
McDonald, R., Nivre, J., Quirmbach-Brundage, Y., Goldberg, Y., Das, D., Ganchev, K., Hall, K., Petrov, S., Zhang, H., Täckström, O., Bedini, C., Bertomeu Castelló, N. and Lee, J. (2013) Universal Dependency Annotation for
Multilingual Parsing. In Proceedings of ACL (Short Papers), 92–97.
De Marneffe, M.-C., Dozat, T., Silveira, N., Haverinen, K., Ginter, F., Nivre, J. and Manning, C.D. (2014) Universal Stanford Dependencies: A Cross-Linguistic Typology. In Proceedings of LREC, 4585–4592.
Swanson, B. and Charniak, E. (2014) Data Driven Language Transfer Hypotheses. In Proceedings of EACL, 169–173. Östling, R. (2015) Word Order Typology through Multilingual Word Alignment. In Proceedings of ACL (Short Papers), 205–211.
Futrell, R., Mahowald, K. and Gibson, E. (2015) Quantifying Word Order Freedom in Dependency Corpora. In
Research Problems
•
Annotation
•
Produce guidelines and/or annotation for language
X
•
Study the annotation of construction
Y
across languages
•
Parsing
•
Develop and/or evaluate a parser for language
X
•
Study cross-lingual transfer learning and/or annotation projection
•Develop better evaluation schemes for multilingual parsing
•
Typology
•
Study word order patterns in language
X
