next up previous
Next: Feature extraction and hand Up: Real-Time American Sign Language Previous: The Task

Hidden Markov Modeling

Due to space limitations, the reader is encouraged to refer to the existing literature on HMM evaluation, estimation, and decoding [1,6,11,23]. A tutorial relating HMM's to sign language recognition is provided in the first author's Master's thesis [15].

The initial topology for an HMM can be determined by estimating how many different states are involved in specifying a sign. Fine tuning this topology can be performed empirically. In this case, an initial topology of 5 states was considered sufficient for the most complex sign. To handle less complicated signs, skip transitions were specified which allowed the topology to emulate a strictly 3 or 4 state HMM. While different topologies can be specified per sign explicitly, the above method allows training to adapt the HMM automatically without human intervention. However, after testing several different topologies, a four state HMM with one skip transition was determined to be appropriate for this task (Figure 1).

  
Figure 1: The four state HMM used for recognition.



Thad Starner
1998-09-17