Adaptive sensing involves actively managing sensor resources to achieve a sensing task, such as object detection, classification,
and tracking, and represents a promising direction for new applications of discrete event system methods. We describe an approach
to adaptive sensing based on approximately solving a partially observable Markov decision process (POMDP) formulation of the
problem. Such approximations are necessary because of the very large state space involved in practical adaptive sensing problems,
precluding exact computation of optimal solutions. We review the theory of POMDPs and show how the theory applies to adaptive
sensing problems. We then describe a variety of approximation methods, with examples to illustrate their application in adaptive
sensing. The examples also demonstrate the gains that are possible from nonmyopic methods relative to myopic methods, and
highlight some insights into the dependence of such gains on the sensing resources and environment.
Keywords Markov decision process - POMDP - Sensing - Tracking - Scheduling
This material is based in part upon work supported by the Air Force Office of Scientific Research under Award FA9550-06-1-0324
and by DARPA under Award FA8750-05-2-0285. Any opinions, findings, and conclusions or recommendations expressed in this publication
are those of the author(s) and do not necessarily reflect the views of the Air Force or of DARPA. Approved for Public Release,
Distribution Unlimited.