unsupervised word alignment component
An Algorithm for Unsupervised Transliteration Mining with an Application to Word Alignment
... and word alignment using a word aligner with a transliteration ...fully unsupervised system with the semi-supervised systems presented at the NEWS10 (Kumaran et ...each word pair is ...
10
Joint Prediction of Word Alignment with Alignment Types
... Word alignment is an essential component in a sta- tistical machine translation (SMT) ...to word alignment is based on IBM models 1-5 (Brown et ...use unsupervised algorithms to ...
14
Smaller Alignment Models for Better Translations: Unsupervised Word Alignment with the l0 norm
... Automatic word alignment is a vital component of nearly all current statistical translation ...use word alignments to drive extraction of those translation ...to word alignment ...
9
Unsupervised Word Alignment with Arbitrary Features
... port alignment error rate ( AER ; Och and Ney, 2003) only for this ...age alignment “fertility” of source words that occur only a single time in the training data (so-called ha- pax ...typical ...
11
Regularizing Mono and Bi Word Models for Word Alignment
... For joint models the advanced models are stand- alone approaches (Marcu and Wong, 2002). How- ever, these models are computationally hard to handle, which frequently results in maximum ap- proximations being made. This ...
10
Improving Word Alignment by Adjusting Chinese Word Segmentation
... of alignment is imposed to the model to ensure that the aligning result covers every Chinese characters of a target word and no overlapped characters in the result morpheme ...the alignment violates ...
8
Word Order Typology through Multilingual Word Alignment
... the word order count vec- tors and treating them (together) as a single 14- dimensional ...extracted word order ...different word order characteris- ...
7
Improving Word Alignment of Rare Words with Word Embeddings
... can result in better alignments. Bilingual word embedding models like (Zou et al., 2013; Søgaard et al., 2015) train vectors for words in both languages in the same vector space, Hence a translation model can be ...
7
Word Alignment Combination over Multiple Word Segmentation
... on alignment or postponing segmenta- tion combination late till SMT decoding phase, we try to combine word alignments over multiple monolingually motivated word segmentation on Chinese-English pair, ...
5
Data Cleaning for Word Alignment
... a word-to-word transla- tion, and non-literal translation as a non word-to- word ...using word aligned results, and then sentences are selected which should either be translated by a ...
9
Word Alignment with Synonym Regularization
... manually word- aligned ...manually word-aligned sen- tences as development data for tuning the regu- larization weight ζ, and used the 347 remaining sentence pairs as evaluation ...the unsupervised ...
5
Confidence Measure for Word Alignment
... several word-level con- fidence measures for machine translation based on word posterior ...and word-level features thru multi- layer perceptron and naive Bayes algorithms for sentence and ...
9
Unsupervised Syntactic Alignment with Inversion Transduction Grammars
... Chinese word 了 , which marks the past tense (among other things), to the preter- minals VBD and VBN, which denote the English simple past and perfect ...measure word quite poorly, the generalization that ...
9
Discriminative Word Alignment with a Function Word Reordering Model
... In this paper, we introduce a new approach to im- proving the modeling of reordering in alignment. In- stead of relying on monolingual parses, we condi- tion our reordering model on the behavior of func- tion ...
11
Unsupervised Word Segmentation Without Dictionary
... 主耶, 和華 0.0004775030 0.0007714881 - 0.0000003684 主耶和, 華 0.0000000074 0.0007198180 - 0.0000000000053 主, 耶和, 華 0.0018672506 0.0000017360 0.0007198180 0.0000000000023 Iterating between building N-gram and word ...
5
Unsupervised POS Induction with Word Embeddings
... Unsupervised POS induction is the problem of as- signing word tokens to syntactic categories given only a corpus of untagged text. In this paper we ex- plore the effect of replacing words with their vector ...
6
Factored Translation with Unsupervised Word Clusters
... One can go far in terms of translation quality with plenty of bilingual text and a translation model that maps small chunks of tokens as they appear in the surface form, that is, the usual phrase-based sta- tistical ...
5
A New Unsupervised Approach to Word Segmentation
... This article proposes ESA, a new unsupervised approach to word segmentation. ESA is an iterative process consisting of three phases: Evaluation, Selection, and Adjustment. In Eval- uation, both the ...
34
Unsupervised Acquisition of Predominant Word Senses
... into word sense disambiguation, particularly since the inception of the Senseval evaluation ...a word often has more than one meaning, resolving word sense ambiguity could benefit applications that ...
38
Unsupervised Alignment for Segmental based Language Understanding
... as word error rate (WER) used in speech recogni- tion; it is obtained from the Levenshtein alignment between both hypothesized and reference sequences as the ratio of the sum of the concepts in the hy- ...
8