The No Free Lunch Theorem of Optimization (NFLT) is an impossibility theorem telling us that a general-purpose universal optimization strategy is impossible, and the only way one strategy can outperform another is if it is specialized to the structure of the specific problem under consideration. In this paper, a framework is presented for conceptualizing optimization problems that leads to useful insights and a simple explanation of the NFLT.
optimization - stochastic optimization - ordinal optimization - No Free Lunch Theorem