We present a space robotic system capable of capturing a free-flying satellite for the purposes of on-orbit satellite servicing.
Currently such operations are carried out either manually or through discrete-event scripted controllers. The manual approach
is costly and exposes astronauts to danger, while the scripted approach is tedious and brittle. Consequently, there is substantial
interest in performing these operations autonomously, and the work presented here is a step in this direction. To our knowledge,
ours is the only satellite-capturing system that relies on vision and cognition to deal with an uncooperative satellite. Our
innovative system combines visual perception (object identification, recognition, and tracking) with high-level reasoning
in a hybrid deliberative/reactive computational framework. The reasoning module, which encodes a model of the environment,
performs deliberation to control the perception pipeline—it guides the vision system, validates its performance, and suggests
corrections when vision is performing poorly. Furthermore, it advises the behavioral controller to carry out its tasks. Reasoning
and related elements, among them intention, context, and memory, are responsible for the robustness and reliability of the
overall system. We demonstrate our prototype system controlling a robotic arm that autonomously captures a free-flying satellite
in a realistic laboratory setting that faithfully mimics on-orbit conditions.