IMPLEMENTATION OF MOBILE CAMERA BASED TEXT DETECTION

AND TRANSLATIONMr. Vivek kumar

Computer Engineering, Pune University

Abstract— The overall capabilities of mobile devices

have rapidly increased in recent years in terms of

processing power, connectivity, and available sensors.

These advancements, together with the growing

prevalence of smart phones, have made it feasible and

in some cases preferable to run OCR software on

mobile platforms. The motivation of a real time text

translation mobile application is to help tourists

navigate in a foreign language environment. The

application we have implemented enables the users to

get text translate as ease as a button click. The

camera captures the text and returns the translated

result in real time. The system we implemented

includes automatic text detection, OCR (optical

character recognition) and text translation.

Introduction

A. Relevance of the Work:

The advancements, together with the growing

prevalence of smart phones, have made it feasible

and preferable to run OCR software on mobile

platforms. The motivation of implementing this

real time text translation mobile application is

demo to help tourists navigate in a foreign

language environment (English) and overcome

language barriers. Even a giant OCR software

manufacturer does not provide text conversion to

Hindi language.

.

B. Present Theory and Practices:

There are Prior and Related Work like text

extraction (Text extraction techniques are widely

studied because text embedded in images and

videos provides important information.), Optical

Character Recognition: OCR, Optical Character

Recognition, is developed to translate scanned

images of handwritten, typewritten or printed text

into machine-encoded text and Text Correction:

The text correction is a necessary step after OCR

text recognition, since the result returned by the

OCR engine is not be always correct due to image

imperfections. This type of errors can be

categorized into so called non-word error – which

means that the text string returned by OCR does

not correspond to any valid word in a given word

set.

C. Proposed Work:

When, the user begins by capturing an

image containing text of interest using the Mobile

camera. The specified area of the image is

processed on the device in order to optimize it for

transfer and input to the OCR Internet server /

database. The processed data is sent to a web

service where recognition takes place. The results

are delivered back to the device and a translated

string is obtained

.D. Features:

Smart phones with ARM (Advanced

RISC Machine) processor used in mobile which is

32-bit RISC microprocessor is used with 256 RAM

in the mobile which enable the process to be faster

in mobile.

The camera quality must be high for better

accuracy and the snap of the scripts must be taken

in proper way that the characters can be

recognized.

Stimulus/Response Sequences

Capture the image

Find text area

Extract Lines

Extract characters

Recognize Character

Match with image library

Convert it to text

Translate using Google

translator

Display text in translated

language

E. Technology & Programming Languages

User Interfaces

Our project has number of user interfaces that

allow user to access system easily. In this project

guidelines and help files are given to user that is

very useful to learn how to operate software.

Different buttons are provided to access these help.

Hardware Interfaces

1. Smart Mobile Phone with Advance

RISC Microprocessor (ARM) 500MHz.

2. 5MP camera.

3. 256 RAM.

Software Interfaces

1. Android Mobile operating System

2. J2ME.

3. J2EE.

Communications Interfaces

1. Mobile Internet (Runs fast on 3g

Internet)

2. 2.1 Web browser inbuilt in Android

Mobile OS

CONCLUSION

This project is an Android Mobile OS

based application which is web based real time

mobile application for real-time text

extraction, recognition and translation.

Now a day’s use of mobile is broadly

increased and almost each and every person

possess mobile phone, in which lots of

applications run. Our project is also

compatible with mobile phones which make it

portable that’s a desired property of any

software.

Hence we can conclude this project is real

time application and very useful for tourist

navigation & language understanding.

ACKNOWLEDGMENT

For the successful completion of any

project, it takes the complete dedication and the

combined guidelines provided by college

professors. The project would not have been

complete without the support, guidance and co-

operation of several persons to whom we owe our

sincere gratitude.

Firstly we are highly indebted to our class

teacher Prof. M.G. Bhandare. It was his genuine

interest, timely guidance and encouragement that

has given us the opportunity to put our ideas into

reality and helped us to complete our project work

successfully.

Had it not been the sincere efforts of our

project guide Prof. K.P.Gaikwad without whom it

would have been next to impossible for the

completion of our project. His efforts have been

very helpful in the development of project.

We are also very highly grateful to Prof.

S.N. Kulkarni for his interest and encouragement in

the progress of our project.

Lastly we are highly indebted to all our

respondents without whose co-operation the project

would not have been completed and the persons

who have indirectly helped us.

REFERENCES

[1] Luigi Ferrigno, Vincenzo Paciello, and Antonio

Pietrosanto, “A Bluetooth-Based Proposal of Instrument

Wireless Interface” IEEE TRANSACTIONS ON

INSTRUMENTATION AND MEASUREMENT, VOL.

54, NO. 1, FEBRUARY 2005.

[2] Jan Beutel, Oliver Kasten, Matthias Ringwald, Frank

Siegemund, Lothar Thiele, “Bluetooth Smart Nodes for

Mobile Ad-hoc Networks”. Computer Engineering and

Networks Lab Swiss Federal Institute of Technology

(ETH) Zurich 8092 Zurich, Switzerland.

[3] Pradip Lamsal, “J2ME ARCHITECTURE AND

RELATED EMBEDDED TECHNOLOGIES.”

[4] [Alfredo del Rio and Juan Jose Rodriguez Andina.

“A SIMULATED TOOL FOR

TEACHING/LEARNING THE 8051

MICROCONTROLLER.”

[5] Myke Predko, “Programming and Customising the

8051 Microcontroller”, Tata McGraw Hill, Edition 1999

[6] Michael. J. Pont, “EMBEDDED C”,Addison

Wesley, Edition 2006

[7] R. P. Jain, “DIGITAL ELECTRONICS”, Tata

McGraw Hill, 2nd Edition

[8] Ramakant Gaikwad, “Op-Amps and Linear

Integrated Circuits”, Prentice-Hall, 4th Edition

[9] Brian W. Kernighan, Dennis M. Ritchie, “The C

programming Language”, Prentice-Hall, 1st Edition.

[10] Sing Li & Jonathan Knudsen, “Beginning J2ME:

From Novice to Professional”, Prentice-Hall, 3rd Edition.