Minimum Description Length Learning
One approach to conceptualizing the problem of learning is in terms of the mimumum description length (MDL) principle. Given a body of data D and a representation language L, one seeks the shortest possible representation of D in L.