Dynamic Operation Area Technology with Tessellation

Recent years have witnessed the emergence of equipment with a user interface in which the actions of characters on the screen can be controlled with gestures. Although existing types of user interfaces allow users to manipulate a predetermined specific object with simple gestures, such interfaces are not suitable for performing fine manipulation tasks with gestures, such as selecting a small object on the screen and fine-tuning its position. Therefore, FX Palo Alto Laboratory, Inc. in California's Silicon Valley is developing a dynamic operation area technology to display an expanded view of the area of a small target. TessellationNote 1 (i.e., a method that applies Voronoi diagramsNote 2 widely used in the field of information processing) is implemented in the development of this technology.

Fig. 1-a: The screens before gesture operation Fig. 1-b: Semi-transparent operation areas displayed on each split screen
Fig. 1: Example of dynamic operation area technology

The targets for gesture operation are four-sided objects of varying sizes, as displayed on the screens shown in Fig. 1-a. When an operator moves his/her hands over a screen, an installed camera detects the hand movements with which gestures are made. Color-coded areas that encircle each four-sided object are then displayed on the screens as shown in Fig. 1-b. These color-coded areas are operation areas for the objects contained therein. Instead of selecting and manipulating a four-sided object, the operator selects an operation area of a certain color and manipulates it, in order to perform such manipulation tasks as selecting, positioning, and resizing the object in the area. With this technology, gesture operation can be performed without selecting a small object because a larger operation area encircling the object can be selected and manipulated. This allows an operator to easily perform a manipulation task that requires precision.

  • Note 1 Partitioning of a plane into a mosaic structure.
  • Note 2 A diagram in which a plane is partitioned along the lines, each of which is equidistant between two points placed at any given positions.

Related information