Technology for Controlling the Visual Perception of Images

Due to the growing popularity of digital cameras and mobile phones, including smartphones, in recent years, there are now more opportunities for people to take photos. Accordingly, the need of users to be able to edit and correct their digital photos according to their preferences is growing as well. However, this usually entails a complex task requiring special editing software. Even in the case of a company making a catalog, it involves the potentially time-consuming process of professional designers painstakingly creating the catalog's images, and then the company having to check and edit them.
At Fuji Xerox, we are developing technology that can control the visual perception of images as well as an interface to edit and correct images. This technology considers an image's visibility, frequency band information, and color characteristics to be important factors in controlling the visual perception the image. To edit and control these elements, we have developed four fundamental technologies underpinning this technology which can be used in combination. By operating these fundamental technologies through an easy-to-use interface, a user can intuitively change the color characteristics or the surface properties of specified areas of an image in order to create the desired image (Fig. 1-A). The image can also be modified to have characteristics similar to those of another model image (Fig. 1-B).

The four technologies underpinning the Technology for Controlling the Visual Perception of Images

  • Identification technology: parts of an image are selected and cut out to be edited.
  • Reproduction technology: an entire image or a cut-out part of an image is reproduced based on the characteristics of human visual perception.
  • Synthesis and transfer technology: characteristics of an image are transferred onto another image to give the two images similar characteristics.
  • Analysis technology: parameters used to reproduce an image, such as visibility and frequency band information, can be determined by analyzing the characteristics of the image.

Fig. 1: An example of editing an image using the technology for controlling surface properties

Identification technology

Technology that allows a user to easily cut out specific areas within an image displayed on a computer or tablet

Reproduction technology

Technology that reproduces the visual perception of images based on the characteristics of human visual perception

Synthesis and transfer technology

Technology that can synthesize a part of an image into another image or transfer a property of an image to another image to give it a similar look and feel

Analysis technology

Technology for analyzing an image before it is processed using our reproduction technology or identification technology