Image Recognition System in Fields

National Agriculture and Food Research Organization and

University of TsukubaKei Tanaka

Contents

• Backgrounds– Field Server– Features of Image

• Image Change Detection Application– Server– Web Application

• Results• Conclusions

Backgrounds (1)

• A Field Server is a Web server that has a weather station and a camera.

• Field Server has been installed in many fields all over the world.

• A standard Field Server takes an image every 2 minutes.

• A total of 720 images for each Field Server are stored every day.

Backgrounds (2)

• Existing application• Image viewer shows images as

thumbnail or animation.(Web application & Java Applet)

• More effective use of images is expected.• observing the growth of plants• detecting the changes in a field

Animation

Thumbnail

Features of Image

• Intermittent image.• Changes do not occur fundamentally between

the images taken in the field.• Users want to see only the images in which

change took.– appearance / disappearance of people or cars– density change by daylight– shaking of a tree by wind– clouds flowing past

These unimportant changes should not be detected.

The image with appearance of this day is only this one.

Image Change Detection SystemImage ChangeDetection Server

Image Change Detection Program

Record image change information on XML format files

Change Information

Web application

Thumbnail Timeline

Field Server

Stored Images

Images

Images

Server

1. Download images from the image server to the image change detection server.

2. Execute the image change detection program, and calculate the value of change between images.

3. Transform the change information into XML format and output it to a file.

XML Data Format

<?xml version="1.0" encoding="UTF-8"?>

<data>

…

<event start="2007/04/01 07:50:00 +0900" image="http://fsds.dc.affrc.go.jp/data4/

Ichikawa10_cam/200704/20070401/200704010750.jpg“

change="12932“

area="(69,207)-(180,302)" />

…

</data>

URL of an image

Value of change

Coordinates of change area

Time

Web Application (1)

Field Server

Date

Display Type

Web Application (2) Thumbnail

Previous Image Detected Image

Change Value& Time

Web Application (3)

A Square means a Detected Change Area

Previous Image Detected Image

Web Application (4) Timeline

Short span band

Long span band

Timeline is a DHTML-based Ajax widget for visualizing time-based events.Bands can be panned by dragging with the mouse.A band synchronizes with panning of another band.

Previous Image Detected Image

Results (1)

Appearance of cars in the fruit farm and the vegetable field.

Results (2)

Appearance of farmers in the vegetable field.

Incorrect Results

The strong density change by daylight

The movement of clouds

Conclusions / Future Works

• Expected role of this system • To appeal the safety of agricultural products by

extracting images of agricultural work and show them to a consumer

• To monitor the theft of agricultural products and illegal disposal of garbage.

• To raise the accuracy of the image change detection• Setting up the threshold for an image change and

optimizing the program parameters based on the installation location of a Field Server.