A Seminar On

Mobile Camera Based Text Detection & Translation

Under The Guidance Of: Prof. Gaikwad K.P.

Presented By: Mr. Vivek Kumar

2

Contents Introduction History Present Working System Flow Requirement Block Diagram Test & Results UML diagrams Applications Advantages & Limitation Conclusion Bibliography

3

Introduction…

Our project ‘Mobile camera based text detection and translation’ retrieves text from an images and converts it into text format, then it is translated to specified language.

4

History

In 1929, first OCR device was invented but it was mechanical device

In about 1965, earliest form of OCR was implemented in one of the first generation computers for Airline Ticket stock.

Revolutionary in 1971, it was implemented in postal services OCR systems where reading and printing of routing bar code was done on the postal code.

In 1974, the modifications was done which would allow blind people to have a computer read text to them out loud.

In late 90’s, Webcam was used for OCR process.

5

Present

Webcam integrated with computers are being used for capturing image and easily the text can be extracted by it and than translated.

The image can be analyzed and translated also online.

Only some software companies manufactures the OCR system in mobile , having high specifications.

ABBYY Mobile OCR, is the leading manufacture of mobile OCR.

6

Working…

Capture image

Detect edges

Detect corners

Match with stored image file

Retrieve text from image

Translate using Google API

Show Result

7

Working Diagram

Fig. a: Working diagram

8

System flow

Algorithms:

Edge detection

Image feature filtering

Image binarization

Optical character recognition

Text correction

Text translation

Display of translation

9

1. Convert Input image into Gray – scale image : Y = 0.299R + 0.587G + 0.114B

2. Apply Blurring on image Y .

3. Find threshold value of Y2 =

Edge Detection

10

Text feature filtering:

After Detecting Text Area, the Extraction of the character from the image is perform

For Extraction & detection of the character the Edge detection, corner detection used.

11

RequirementMobile Hardware Requirements:• ARM 11 processor or higher• Memory 1 GB • 256 MB RAM• Mobile camera 5 mega pixel

Software Requirements:• JAVA - J2ME and J2EE• Operating System – Android Mob OS

Communication Requirements:• Internet Connection is required• Android Mobile OS inbuilt web browser

12

Block Diagram

Captured Image

Text Feature Filtering

Google Translator

File Library

Match Image

Retrieve Text

Translate Text

Display Output Text

Fig. b: Block diagram

13

Example

Fig. c: Example

c.1 c.2

c.3 c.4

c.5

Fig c.1Fig c.2Fig c.3Fig c.4Fig c.5

14

Test & Results

Font : Recognition rate does not vary as font changes

Font size : As the size of text varies , Recognition rate will vary i.e. if the text is of larger size then recognition rate will be greater.

15

Test & ResultsImage quality :

As image quality degraded recognition rate will decrease

Recognition rate of character ‘A’ , ‘B’ , ‘L’ will be higher than recognition rate of character ‘y’ , ‘u’ , ‘c’.

Fig. d: Test & result

18

Applications

Tourist understanding native language.

Instant recognition of texts, street and e-mail addresses, links, and telephone numbers.

Unknown language guideline.

Easy to recognize road signs scripts.

19

Advantages

Android Mobile OS based platform.

No tiresome manual data entry.

Versatility and ease of use.

No database is needed

20

Limitations

Image taken by Mobile camera should be of good quality.

Many arithmetical equations cannot be recognized correctly.

Mobile should be of high specifications

For translation of extracted text , Internet connection is required.

Translated text may have Grammatical mistakes

21

Conclusion

This project which we have implemented is an Android Mobile OS based application which is web based real time mobile application for real-time text extraction, recognition and translation.

22

Bibliography1. Michael Hsueh “Interactive Text Recognition and Translation on a Mobile Device “

[Technical Report No. UCB/EECS-2011-57 ]

2. Yassin M.Y.Hasan and Lina J.Karam “Morphological Text Extraction from Images” IEEE Transaction on Image Processing Vol.9 No.11, Nov 2000

3. Nobuyuki Otsu, A threshold selection method from gray-level histograms. IEEE Trans.Sys.,Man., Cyber 9(1):62-66

4. Celine Mancas-Thillou, Bernard Gosselin, Color text extraction with selective metric based clustering. Computer Vision and Image Understanding 2007

5. B. Epshtein, Detecting Text in Natural Scenes with Stroke Width Transform. Image Rochester NY, pp. 1-8.

6. Derek Ma , Qiuhau Lin, Tong Zhang “Mobile Camera Based Text Detection and Translation” – research paper

7. WWW.wikipedia.org/optical_character_recognization

Any Question..??

Thank yOu..!!