Nonlinear hybrid dynamical systems are the main focus of this paper. A modeling framework is proposed, feedback control strategies and numerical solution methods for optimal control problems in this setting are introduced, and their implementation with various illustrative applications are presented. Hybrid dynamical systems are characterized by discrete event and continuous dynamics which have an interconnected structure and can thus represent an extremely wide range of systems of practical interest. Consequently, many modeling and control methods have surfaced for these problems. This work is particularly focused on systems for which the degree of discrete/continuous interconnection is comparatively strong and the continuous portion of the dynamics may be highly nonlinear and of high dimension. The hybrid optimal control problem is defined and two solution techniques for obtaining suboptimal solutions are presented (both based on numerical direct collocation for continuous dynamic optimization): one fixes interior point constraints on a grid, another uses branch-and-bound. These are applied to a robotic multi-arm transport task, an underactuated robot arm, and a benchmark motorized traveling salesman problem.