Next: 3 Modeling gestures with Up: Using Hidden Markov Models Previous: 1 Introduction

2 Representation of shape

2.1 Size functions

Size functions [ 3 , 4 ] are topological descriptions of generic 2D shapes. They are invariant with respect to translation and scale and they are robust with respect to small variations of shape. In this work, they are used, as in [ 9 ], to characterize the occluding contour of the hand. To compute a size function, one must first define a continous real-valued measuring function over the curve G that approximates the contour. could be, for example, the distance of the contour from the center of mass of the image as a function of arc-length as in Figure (1).

Figure 1: (Left) The occluding contour G of the hand. (Right) A continuous measuring function on G , in this case G is partitioned by x and y in one equivalence class. The size function is determined by computing, for every pair of values x and y in the range of , the number of connected components of the subgraph which contain at least an element of . This consists in calculating the number of equivalence classes in which is partitioned by the relationship defined below [ 9 ]:

The integer-valued function of the pair ( x , y ) obtained in this fashion is called size function . It can be easily shown that all the information is contained in the triangular region

where m and M are the minimum and maximum values of over G .

Figure 2: Graphical representation of the size function relative to the contour and the measuring function of figure (1). The gray levels are proportional to the values of the function. The main advantage of size functions is, as already mentioned, the robustness with respect to small shape deformations. It must be said, however, that robustness strongly depends on the choice of measuring function .

2.2 Choice of measuring functions

To fully represent the shape of the contour, one needs a family of measuring functions. Since the meaning of signs does not depend on the position and distance of the hand with respect to the camera, the measuring functions should be invariant for translation over the image plane and scale.

We used, as in [ 9 ], two different families, called respectively distance from a line segment and distance from a point. The definitions are explained in Figures (3) and (4) respectively.

The representation consists in a collection of size functions, one for each measuring function in the two defined families. It is a cumbersome representation, however, experimental results seem to prove that, due to its redundancy, a size function can be characterized by its mean value. Each size function is piecewise constant and monotonic along x and y separately, hence, the entire information resides in the location and value of the jumps of along x and y which correspond only to few integer numbers.

Figure 3: (Left) Minimum box and ``distance from a line" calculation. (Right) Values of the measuring function for a given line.

Figure 4: (Left) Example of calculation of a ``distance from a point" measuring funtion. (Right) Values of the measuring function for a given point.

Next: 3 Modeling gestures with Up: Using Hidden Markov Models Previous: 1 Introduction

Adrian F Clark
Mon Jul 28 12:54:58 BST 1997