On Iterative Algorithms with an Information Geometry Background (invited lecture for ALT 2008) Author: Imre Csiszár Affiliations: Alfréd Rényi Institute of Mathematics, Hungarian Academy of Sciences, Budapest, Hungary Abstract. Several extremum problems in Statistics and Artificial Intelligence, e.g., likelihood maximization, are often solved by iterative algorithms such as iterative scaling or the EM algorithm, admitting an intuitive “geometric” interpretatation as iterated projections in the sense of Kullback information divergence. Such iterative algorithms, including those using Bregman rather than Kullback divergences, will be surveyed. It will be hinted to that the celebrated belief propagation (or sum-product) algorithm may also admit a similar interpretation. ©Copyright 2008 Author