Machine vision sorts produce at self-service checkout

AUGUST 4, 2008--Researchers at the Fraunhofer Institute for Information and Data Processing IITB (Karlsruhe, Germany) have developed a webcam module for self-service scales.

AUGUST 4, 2008--Working on behalf of the industrial weighing company Mettler-Toledo (Geissen, Germany;de.mt.com), researchers at the Fraunhofer Institute for Information and Data Processing IITB (Karlsruhe, Germany; www.iitb.fraunhofer.de) have developed a webcam module for self-service scales. "The scales automatically recognize which fruit or vegetables are to be weighed and ask the customer to choose between only those icons that are relevant--such as tomatoes, vine-ripened tomatoes and beefsteak tomatoes," states IITB scientist Sascha Voth. Customers can confirm the correct variety on a touch screen.

But how do the scales know whether the customer has placed a pepper, a tomato, or a kiwi fruit on them? "The goods are registered by a camera integrated in the scales. An image evaluation algorithm compares the image with stored data and thus automatically recognizes which type of fruit this is," says Voth. Even the cloudy plastic bags in which the fruit may be packaged at the counter are no problem for the scales--the image evaluation system recognizes the various types of fruit and vegetable anyway.

However, though this initially sounds straightforward, it actually involves a number of challenges: Many types of fruit are a different color depending how ripe they are. Bananas, for instance, range from a uniform green to yellow or even spotted brown. Other types of fruit such as apples and pears come in numerous varieties that can likewise vary widely in color. "The new scales are very tolerant to fluctuations in color and brightness. The module can be employed under many different kinds of illumination and with different kinds of camera. Supermarket employees can of course extend the selection of fruit recognized by the scales to make it include new varieties," says Voth. The scales are currently being tested in about 300 supermarkets across Europe.

More in Consumer Packaged Goods