[PDF] Top 20 DEPEVAL(summ): Dependency based Evaluation for Automatic Summaries

... The dependency-based method using LFG an- notation has been successfully employed in the evaluation of Machine Translation ...best-performing automatic MT evaluation ...tomatic ... See full document

... are automatic content metrics for news summary evaluation? Here we provide a detailed answer to this question, with a particular focus on assessing the ability of automatic evaluations to identify ... See full document

... tomatic evaluation measure of summarization, pruned Basic Elements ...automated evaluation of summaries, its weakness is that it redundantly matches basic ...elements based on word similar- ... See full document

... Traditionally, automatic methods have been evaluated by ...ranked based on the results of the automatic and manual ...the automatic method is evaluated by the number of matches between both ... See full document

... 4.1 Correlation with Human Assessments As stated in Section 3, direct application of BLEU on the DUC 2001 data showed promising results. However, BLEU is a precision-based metric while the human evaluation ... See full document

... Xie et al. (2012) presented experiments using content features on spontaneous-speech data based on vector-space models, latent semantic analysis, as well as point-wise mutual information. Some of these content ... See full document

... best evaluation from JSD (correlation of ...with summaries will give good evaluation ...human summaries for this input (also shown in Table 10) seem to report the common issues observed in the ... See full document

... hand-edited summaries and to compute some measure of similarity ...between automatic and human ...An automatic summary can then be scored based on its ability to correctly identify good ... See full document

... reference summaries whose SCUs are EDUs is as ...is based on the alignment between EDUs in reference summary and source ...is based on the extractive oracle summary (Hirao et ... See full document

... our evaluation, BlogSum-generated summaries were compared with the original candidate list gen- erated by our approach without the discourse re- ordering ...this evaluation, we have gener- ated ... See full document

... their summaries do not contain enough overlapping with human summaries and also the Longest Common Subsequence mapping yet their results improve if the n-gram is ...best evaluation model among ROUGEs ... See full document

... sections’ summaries are combined into the paper’s sum- ...evaluate summaries of two papers that they have co-authored (preferably as the first ...two summaries of two types: the section-based ... See full document

... effect automatic reordering ...employed dependency syntactic and transformation rules to reorder the source sentence and applied to English to Vietnamese translation ... See full document

... Table 2 shows the computational results of the proposed method against the “ideal” summaries with compression rate of 20%. The results obtained are once again close to the ones achieved by the Topical TF-ISF, and ... See full document

... the summaries: because the summaries are only 350 words in length, it is possible to have two sum- maries of the same meeting which are equally good but completely non-overlapping in ... See full document

... total, the feature selection algorithm, for the transition-based model, may select 188 features. In Table 1 we show the training time (TT). We used this table to selected the optimal settings for the beam. After ... See full document

... relations among topics. Kou et al. (2015) pro- posed to map topics and candidate labels (phrases) to word vectors and letter trigram vectors in order to find which candidate label is more semantically related to that ... See full document

... In most hospitals, dialysis patients are often admitted to non-nephrology wards with the nephrology service consulting. As changes to the dialysis prescription are undertaken exclusively by nephrologists, this may not be ... See full document

... Katakura and Takahashi [14] also used distributed representations in order to construct a polarity dictionary. They used CBOW (Continuous Bag of Word) model [15] for the calculation of the distributed representations. ... See full document

... There are two approaches to the study of collocations, namely, the frequency-based approach (Sinclair, 1987) and the phraseological approach (Cowie, 1981; Benson, 1989). Drawing on natural language processing ... See full document