Efficient verification of holograms using mobile augmente reality

Click here to load reader

download Efficient verification of holograms  using mobile augmente reality

of 25

  • date post

    11-Feb-2017
  • Category

    Engineering

  • view

    108
  • download

    3

Embed Size (px)

Transcript of Efficient verification of holograms using mobile augmente reality

PowerPoint Presentation

Efficient Verification of Holograms Using Mobile Augmented Reality PRESENTED BY,AKHIL MUKUNDANROLL NO. 29S7 CSEISSATGUIDED BY,Ms. NEENU SHEREEF

IntroductionPaper Documents are frequently checked by inspection of security element.

Holograms are important security element, but difficult to inspect.

Augmented Reality can provide relevant information on standard mobile devices.

First evaluate a series of similarity measures for matching hologram patches.

That provides a sound basis for automatic decisions.

Enables faster verification of documents.Efficient Verification of Holograms Using Mobile Augmented Reality2

ContentsIntroductionExisting SystemProposed TechnologyAugmented RealityHologram Verification with Mobiles Hologram CaptureProcessingInterface DesignFindings and DiscussionsApplicationsConclusionReferencesEfficient Verification of Holograms Using Mobile Augmented Reality3

Existing SystemHolograms incorporates wide variety of security elements in it.They can be viewed by changing the viewing angle or by changing the angle of incident light.Requires an individual to find all relevant patterns listed in a manual by looking at the hologram.Only trained individuals can efficiently verify them.Manuals often lack an indication on the viewing direction and do not specify requirements on lighting conditions.Efficient Verification of Holograms Using Mobile Augmented Reality4

Contd.In real-world situations, manuals are not always at hand, so users fall back to solely looking for appearance changes.

People inspect holograms on security documents just by looking for changes in appearance or the pure presence of rainbow colors.

This has no particular value regarding security.

Development of tools and algorithms for the automatic detection and verification of holograms by laypeople deserves our interest.Efficient Verification of Holograms Using Mobile Augmented Reality5

Proposed TechnologyCapture reference data from holograms along with a matching approach that can be used for automatic verification at runtime.Performs classification, tracking and augmentation of relevant information.This allows to select the correct reference information for hologram verification.Ensures that the elements are observed from the correct viewpoint.This setup serves as a basic building block for mobile hologram verification with appropriate user guidance and visualization.Efficient Verification of Holograms Using Mobile Augmented Reality6

Augmented RealityA live direct or indirect view of a physical, real-world environment.

Elements are augmented (or supplemented) by computer-generated sensory input such as sound, video, graphics or GPS data.

Replaces the real world with a simulated one.

Efficient Verification of Holograms Using Mobile Augmented Reality7

Hologram Verification with MobilesCapturing hologram patches

View alignment/user guidance

Mobile AR prototype

Evaluation within user study

Revision of the prototype

Efficient Verification of Holograms Using Mobile Augmented Reality8

Hologram CaptureAssumptionTotal radiance from a point on the hologram is dominated by a single light sourceFixed distance to surface

Dominant Light SourceLED light on mobile phoneFixed to the camera with offset vector

Efficient Verification of Holograms Using Mobile Augmented Reality9

View alignmentObjectiveMobile method for alignment with a given poseReasonable accuracy despite mobile environment

ApproachVisual guidance with iron sights and a virtual horizon1 matching direction of the viewing ray2 position along the ray3 in-plane rotationEfficient Verification of Holograms Using Mobile Augmented Reality10

123

PreprocessingCapturing Reference Data With moderate ambient light.Appearance of a hologram is largely dominated by using the LED flashlight of mobile devices.The workspace consists of a hemisphere centered at the hologram on the document.Capture the current video image and the corresponding pose for each position on the hemisphere.Efficient Verification of Holograms Using Mobile Augmented Reality11

Contd.We assume the hologram to be planar and project its bounding box into the image using the recorded pose.Results a set of registered image patches that represent all observable appearances of the current hologram.Exclude all data recorded < 5 degree and > 55 degree away from the orthogonal view.In order to avoid artifacts caused by oblique views and tracking failure.Efficient Verification of Holograms Using Mobile Augmented Reality12

Runtime ProcessingClassification and TrackingIdentification of the document type.

MatchingEvaluate similarity measures such as

Perform linear scaling of matching scores using coefficients obtained by analysis of all recorded patch data.

Efficient Verification of Holograms Using Mobile Augmented Reality13Manual selectionComputing from image Sum of Absolute Differences (SAD)Normalized cross correlation (NCC)

Interface DesignGuide the user to align the mobile device with exactly those view points which are associated with the selected reference data.

User-friendly hybrid interface together with automatic matching which makes the hologram verification more accessible.

Facts regarding interface design are:Efficient Verification of Holograms Using Mobile Augmented Reality14Concept and Graphical RepresentationUser-Oriented Parametrization

1.Concept and Graphical RepresentationThe user should be guided towards different viewing directions or ranges.A 2D orientation map (projection of the conic space) is used for this task.It is divided into slices that are aligned on one or more tracks.We record several shots per slice that differ at least by a given angle threshold.Small arrows around the cursor serve as movement indicators.The upper arc switches from red to green with increasing slice coverage.Efficient Verification of Holograms Using Mobile Augmented Reality15

Contd.

Efficient Verification of Holograms Using Mobile Augmented Reality16

2.User-Oriented ParametrizationChanges in orientation generally took place roughly along the vertical and horizontal axes.Conducted an experiment with people.They are asked to record a hologram document with smartphone.Provided two approaches:

Both approaches made considerable differences.Efficient Verification of Holograms Using Mobile Augmented Reality17Document and phone held on their handsDocument placed on a table

Efficient Verification of Holograms Using Mobile Augmented Reality17

Orientation changesEfficient Verification of Holograms Using Mobile Augmented Reality18Fig 1Fig 2

Findings and DiscussionHolograms can be assessed by the system immediately after image capture, which takes approximately 15 seconds.A subsequent decision by the user takes another 20s.The system was able to assess the hologram correctly in all cases.Users were unsure about the validity of the hologram in 10.94 percent of all cases.Succeeded to give a correct decision in 85.94 percent of all casesEfficient Verification of Holograms Using Mobile Augmented Reality19

Contd.Efficient Verification of Holograms Using Mobile Augmented Reality20

ApplicationsDetection of fake documents.

Counterfeit currency detection.

Enhanced verification of passports and visa.

For checking identity cards.

Can replace barcode system.

Efficient Verification of Holograms Using Mobile Augmented Reality21

ConclusionCapture of holograms and view alignment worked reasonably well.Hologram verification on mobiles seams feasible.Takes less amount to complete verification than that of manual method.Verification is possible under optimal lighting conditions.Mobile AR systems can serve as tools for the verification of holograms by laypeople.Efficient Verification of Holograms Using Mobile Augmented Reality22

ReferencesR. L. van Renesse. Optical Document Security. Artech House, third edition, 2005.T.-H. Park and H.-J. Kwon. Vision inspection system for holograms with mixed patterns. In CASE, pages 563567, 2010.M. Haindl and J. Filip. Visual Texture. Advances in Computer Vision and Pattern Recognition. Springer Verlag, 2013J. Jachnik, R. A. Newcombe, and A. J. Davison. Real-time surface light-field capture for augmentation of planar specular surfaces. In ISMAR, pages 9197, 2012P. Ren, J. Wang, J. Snyder, X. Tong, and B. Guo. Pocket reflectometry. n Proc. SIGGRAPH 2011, SIGGRAPH 11, pages 45:145:10, New York, NY, USA, 2011. ACM.Efficient Verification of Holograms Using Mobile Augmented Reality23

Thank You

Efficient Verification of Holograms Using Mobile Augmented Reality25

Any Questions?