minimum description length (MDL)
Inference of Phrase Based Translation Models via Minimum Description Length
... the MDL principle aims at obtaining the simplest possible model Φ that de- scribes D as well as possible (Solomonoff, 1964; Rissanen, ...to MDL is the one- to-one correspondence between description ...
5
Minimum Description Length Penalization for Group and Multi-Task Sparse Learning
... We propose a framework MIC (Multiple Inclusion Criterion) for learning sparse models based on the information theoretic Minimum Description Length (MDL) principle. MIC provides an elegant way ...
40
Unsupervised Transduction Grammar Induction via Minimum Description Length
... When the structure of an ITG is induced without supervision, it has so far been assumed that smaller rules get clumped together into larger rules. This is a natural way to search, since maximum like- lihood (ML) tends to ...
7
Efficient Unsupervised Recursive Word Segmentation Using Minimum Description Length
... which enables an efficient algorithm for greedy con- struction of a morph dictionary using an MDL cri- terion. The algorithm we have devised is generic, in that it may easily be applied to any local ...
7
MoL 2007 03: Transfer Learning Using the Minimum Description Length Principle with a Decision Tree Application
... To provide formal grounds for the utility of our method we need theorem 3.2.4 which gives bounds for the divergence of a probability measure from a true measure. Loosely speaking, this theorem tells us that if the true ...
84
Minimum Conditional Description Length Estimation for Markov Random Fields
... The Minimum Description Length (MDL) [18] principle states essentially that the best model is that one that provides the best compression of the ...
6
Stochastic Complexity, Histograms and Hypothesis Testing of Homogeneity
... with minimum stochastic ...Rissanen’s minimum description length (MDL) which gives the length of a sequence of decipherable binary code resulted from optimally encoding the data ...
30
Segmenting vs. Chunking Rules: Unsupervised ITG Induction via Minimum Conditional Description Length
... Conditional description length (CDL) is a general method for evaluating a model and a dataset given a preexisting ...tion length (Solomonoff, 1959; Rissanen, 1983), but the length calculations ...
9
A Novel DOA Estimation Approach for Unknown Coherent Source Groups with Coherent Signals
... of Minimum Description Length (MDL) or Eigenvalue Gradient Method (EGM), Joint Approximate Diagonalization of Eigenmatrices (JADE) and Modified Forward-Backward Linear Prediction (MFBLP) ...
9
Unsupervised Learning of Bilingual Categories in Inversion Transduction Grammar Induction
... Conditional description length (CDL) is a general method for evaluating a model and a dataset given a preexisting ...to description length (Solomonoff, 1959; Rissanen, 1983), but the ...
10
Unsupervised Learning of the Morphology of a Natural Language
... This study reports the results of using minimum description length MDL analysis to model unsupervised learning of the morphological segmentation of European languages, using corpora rang[r] ...
46
Research Article on Image Denoising
... 5% of the MSE of the best soft-thresholding benchmark with the image assumed known. It also outperforms Donohue and Johnston’s Sure Shrink most of the time. The subsequent part of the paper attempt to further validate ...
7
Identification of functional connections in biological neural networks using dynamical Bayesian networks
... and Minimum Description Length (MDL) score. The MDL algorithm was originally proposed from studies on universal coding (Rissanen, ...data length, i.e., the total ...
6
A Tool for Automated Revision of Grammars for NLP Systems
... We also discuss algorithms to make the revised grammar compact using minimum description length MDL based grammar compaction techniques and extensions to our basic algorithm to handle gr[r] ...
8
DNA methylome profiling of human tissues identifies global and tissue specific methylation patterns
... Next, the regions with distinctive methylation patterns in certain tissues were analyzed in detail. We applied an algo- rithm to identify statistically significant differential methy- lation existing between two sets of ...
14
Text Segmentation by Language Using Minimum Description Length
... The problem addressed in this paper is to seg- ment a given multilingual document into seg- ments for each language and then identify the language of each segment. The problem was motivated by an attempt to collect a ...
10
Minimized Models and Grammar Informed Initialization for Supertagging with Highly Ambiguous Lexicons
... The idea of searching for minimized models is related to classic Minimum Description Length (MDL) (Barron et al., 1998), which seeks to se- lect a small model that captures the most regularity ...
9
Occam’s razor-based spam filter
... Abstract Nowadays e-mail spam is not a novelty, but it is still an important rising problem with a big economic impact in society. Spammers manage to circumvent current spam fil- ters and harm the communication system by ...
9
Large alphabet sequence modelling a comparative study
... The KN with th.is adaptive discounting parameter outperforms the traditional KN method on the Large Calgary corpus: Keywords Kolmogorov Complexity; minimum description length; online lea[r] ...
80
Regularized Minimum Length Method in Scattered Data Interpolation
... Observing Figs. 2(a)…2(b) can easily find the interpolation errors ξ approach uncontrollably in the range 0.5 ≤ h < 1. These two figures confirm the aforementioned pilot observation finding the instability of original ...
8