[PDF] Top 20 Comparing Word Representations for Implicit Discourse Relation Classification

... previous word-based only config- uration appears to outperform state-of-the art re- sults for Temporal and Contingency, thus giving the best performance to date on these ...raw word pairs (One- hot ⊗ + ... See full document

... Implicit discourse relation classification is one of the most difficult steps in discourse ...coherence relation must be inferred based on the content of the discourse ... See full document

... Implicit discourse relation recognition remains a challenging task as state-of-the-art approaches reach F1 scores ranging from ...two discourse arguments that implicitly signal a ... See full document

... Among the few approaches that distinguished between paradigmatic semantic relations, Lin et al. (2003) used patterns and bilingual dictionaries to retrieve distributionally similar words, and relied on clear antonym ... See full document

... BERT representations are further pre-trained on the parts of the GENIA corpus which consists of 18k sentences and is not annotated with coherence ...for implicit discourse relation ... See full document

... sentence representations from RNN-encoded hidden states for individ- ual words, max-pooling along with bidirectional LSTM (Bi-LSTM) (Schuster and Paliwal, 1997) yields the current best universal sentence repre- ... See full document

... collect word pairs from arguments of explicit examples to help the learning; Rutherford and Xue (2014) employ Brown cluster pair and coreference patterns for performance en- ... See full document

... Penn Discourse TreeBank (PDTB) (Prasad et ...the discourse-annotated cor- pora available to researchers, using a comprehen- sive scheme for both implicit and explicit rela- ...performed ... See full document

... raw word tokens in the ar- guments of discourse relations to a limited num- ber of entries in a semantic lexicon such as polar- ity and verb ...distributed representations to overcome the data ... See full document

... course relation identification models on dialogue data and our proposed features, we build on the Deep Enhanced Representation (DER) model of Bai and Zhao (2018) 7 , which demonstrated its ef- ficiency by ... See full document

... sense classification of discourse relations, given their (gold) arguments (Xue et ...of implicit relations, where explicit connective words ... See full document

... plicit discourse relations in naturally occurring ...of implicit discourse relations via classifying explicit discourse connectives, ex- tending prior research (Marcu and Echihabi, 2002; ... See full document

... The last part of table 4 provides evaluation results for a system using the complete set of information sources (all), for systems leaving out one of the shallow information sources (all–bi, all–wp, all–pr), and a system ... See full document

... considerable interest: Pitler et al. (2009) present an extensive evaluation of mostly linguistically motivated features for implicit sense labeling in a 4-way classification experiment. Useful indica- tors, ... See full document

... aggregate word-pair features that are collected around the same connectives, which can effectively alleviate the feature sparsity prob- ...connective classification, which ... See full document

... tifying discourse relations in many early studies (Subba and Di Eugenio, 2009; Lin et ...for implicit discourse relation ...the representations from bottom ... See full document

... final classification layer (differ- ent for implicit and explicit relations as in our full model) to train this simplified ...for word pairs and k = 50 for n-grams as described in Section ... See full document

... connective classification. The connective classification task predicts which discourse con- nective is suitable for combining two given argu- ...to implicit rela- tion recognition, just with ... See full document

... this word, < ...the implicit model toward a contrastive re- lation, thus potentially helping in identifying the re- lation in example ...the word “week” is more likely to be found in the arguments ... See full document

... main implicit relation classifi- cation task, contain the task of predicting previ- ously removed connectives for explicit relations, and profit from shared representations between the ...both ... See full document