[PDF] Top 20 Unsupervised Alignment of Comparable Data and Text Resources

... the data-to-text generation situation is that in the former, sentence-aligned parallel resources exist and can be used as a starting ...In data- to-text generation we have no analogous ... See full document

... from comparable data and text resources to generators that produce texts sim- ilar to those in the text resource are then as fol- lows: (1) identify sources on the Web for com- parable ... See full document

... parallel data in comparable corpora is a promising approach for over- coming the lack of parallel texts in statis- tical machine translation and other NLP ...to comparable corpora of texts as ... See full document

... Moore’s approach constantly achieves high preci- sion, is robust to sequences of inserted and deleted text, and is fast. However, the obtained recall is at most equal to the proportion of 1-to-1 corre- spondences ... See full document

... of data for a lan- guage and the domain dependence of noise makes it impractical to construct corpus from which P(e | h) can be learnt ...the alignment between clean and noisy sentences are monotonic in ... See full document

... well-known data sparseness issues, which can be minimised through morphosyntactic analysis and ...the resources for these processes might not be readily available or accurate enough, and a common approach ... See full document

... guistic resources, unsupervised learning ...two comparable corpora much better than using an information retrieval, such as that used by Munteanu ... See full document

... With the rise of data-driven machine translation, be it statistical (Brown et al., 1990), example- based (Nagao, 1984), or rooted in neural networks (Bahdanau et al., 2014), the need for large paral- lel corpora ... See full document

... lel text with manually-aligned parallel text (Moore, 2005; Taskar et ...manually-aligned data is very valuable, it is only available for a small number of language ...are unsupervised like the ... See full document

... Statistical approaches to machine translation, pio- neered by Brown et al. (1990), estimate parame- ters for a probabilistic model of word-to-word cor- respondences and word re-orderings directly from large corpora of ... See full document

... simple unsupervised method for extracting pseudo-parallel monolin- gual sentence pairs from comparable cor- pora representative of two different text styles, such as news articles and scien- tific ... See full document

... by text structure for sentence ...overall alignment, while relying on a simple local similarity ...large text frag- ments using hypotheses learned in a supervised fash- ion and (2) we further refine ... See full document

... as comparable corpora, has been extensively explored in the last two decades (Munteanu and Marcu, 2005; Sharoff et ...allel resources from comparable data is the align- ment of sentences in ... See full document

... unseen text pairs into the same topic clusters as in the first step and aligned the texts on the paragraph level, al- lowing for multiple ...same data set, but they base their similarity measure for ... See full document

... original text into simplified variants to increase its readability and ...the text with vary- ing degree of simplicity is ...of text-transformation that involves three major types of operations such ... See full document

... the data described in Section 7) that the Pitman-Yor process with automatically adjusted parameters results in su- perior alignment results, outperforming the sparse Dirichlet process priors used in ... See full document

... In order to evaluate the sensitivity of the algorithm to the lengths of the texts that are to be aligned, we applied it to text samples that ranged in length from 10 to 1000 sentences, a[r] ... See full document

... Figure 2: Top: A synchronous derivation of a small sen- tence pair fragment under our model. The English pro- jection of the derivation represents a valid constituency parse, while the foreign projection is less ... See full document

... The evaluation of the introduced methods was car- ried out on the M EDIA corpus (Bonneau Maynard et al., 2008). This corpus consists of human-machine dialogues collected with a wizard of Oz procedure in the domain of ... See full document

... We use the English/Hindi corpus from the shared task on word alignment, organized as part of the ACL 2005 Workshop on Building and Using Par- allel Texts (WA05) (Martin et al., 2005). For En- glish/Arabic, we use ... See full document