A general framework for the design of error adaptive learning algorithms in multiple output domains based on Dietterich’s ECOC approach, recursive error output correcting codes and iterative APP decoding methods is proposed. A particular class of these Recursive ECOC (RECOC) learning algorithms based on Low Density Parity Check is presented.