• No results found

Linguistically Informed Self Attention for Semantic Role Labeling

N/A
N/A
Protected

Academic year: 2020

Share "Linguistically Informed Self Attention for Semantic Role Labeling"

Copied!
12
0
0

Loading.... (view fulltext now)

Full text

Loading

Figure

Figure 1: Word embeddings are input to J layers ofmulti-head self-attention. In layer p one attentionhead is trained to attend to parse parents (Figure2)
Figure 2: Syntactically-informed self-attention forthe query word sloth. Attention weights Aparseheavily weight the token’s syntactic governor,saw, in a weighted average over the token val-ues Vparse.The other attention heads act asusual, and the attended representations from allheads are concatenated and projected through afeed-forward layer to produce the syntactically-informed representation for sloth.
Table 1: Precision, recall and F1 on the CoNLL-2005 development and test sets.
Table 5: Predicate detection precision, recall andF1 on CoNLL-2005 and CoNLL-2012 test sets.
+2

References

Related documents

Kilde: Centraal Bureau voor de Statistiek,

(1) Lorsqu'il s'agit d'un produit de mélange relevant de cette sous-position, qui contient du Lactosérum et/ou du lactore ajoutés, aucune restitution n'est

ABVD with or without low-dose total-nodal radiation therapy in the treatment of stages IIB, IIIA2, IIIB, and IV Hodgkin’s disease in paediatric patients: A Paediatric Oncology

Sydney rock oysters, Saccostrea glomerata , were collected from the high-intertidal and subtidal areas of the shore and exposed in an orthogonal design to either an intertidal or

Animals with surviving HT29 sphere cells after CVV treatment showed attenuated tumor growth resulting from successful killing of stem cell-like cells by CVV, whereas surviving

In Smilisca and two individuals of Osteopilus, the vibrational amplitudes of the lung area in response to free- field stimulation with the lower frequencies were comparable to

the task is to perform automatic triage of user posts gathered from the ReachOut.com mental health on- line forum 2.. Posts must be classified into

The results of antibacterial, antifungal, nutritional value and phytochemical screening activity, table 1, 2, 3, and 4 , reveals that antibacterial, antifungal,