This paper documents the recognition method of deciphering Japanese sign language(JSL) using projected images. The goal of
the movement recognition is to foster communication between hearing impaired and people capable of normal speech. We uses
a stereo camera for recording three-dimensional movements, a image processing board for tracking movements, and a personal
computer for an image processor charting the recognition of JSL patterns. This system works by formalizing the space area
of the signers according to the characteristics of the human body, determining components such as location and movements,
and then recognizing sign language patterns.
The system is able to recognize JSL by determining the extent of similarities in the sign field, and does so even when vibrations
in hand movements occur and when there are differences in body build. We obtained useful results from recognition experiments
in 38 different JSL in two signers.