Automated Testing of Multimodal Applications

20.10.2014 M2M Summit 2014, Düsseldorf Sheet # 1

Automated Testing ofMultimodal Applications

Raphael GronerISTQB® Certified Tester

Bachelor of Science for Production ManagementIT Specialist (IHK) - Application Development

http://www.xing.com/profile/Raphael_Groner

voice-mediator @ email.de

http://www.jvoicexml.org


Init: What is it all about?


Agenda1.Technical Communication2.Fields of Use3.MMI as a Standard4.Requirements5.Testing6.Demo7.Q&A


1.Technical Communication* Mechanical buttons19-20th centuryB. Preim, Development of Interactive Systems, 1999

Graphics and Touch21st centuryApple Siri, iPhone6, 2014

+ Functions through Interaction +


2.Fields of Use for MMI• Logistics: „Pick by Voice“ Commissioning & Inventory Voice-based Briefing Controlling via Identification

• Entertainment Multimedia & Games Social Networks Microsoft Kinect

• Home Automation DIY Automation Project

• Inquiry desk and agency Travel, Stocks, Weather, … Call Center: „FAQ“ Traffic Navigation Monitoring of Animals


3.MMI as a Standard• Why? → Theory of Communication

Naturally spoken and Formalised LanguagesInteraction between People & MachineHow interact Machines among each other?

• VoiceXML is an extra W3C and XML standardVersion 2.1 is CurrentVersion 3.0 is DraftDeployment like HTMLEditors, Generators

VoiceXML Forum


4.RequirementsText interface available (VoiceXML)Automation & Scripting enabledValidation of Inputs und Outputs Input done with Keys or Spoken Output with Emphasis and Idioms or Dialects Output checked for correct Parts

Combination of ConditionsDelay of Inputs meaning „Timeout“…


5.a)Test in a Process

http://www.scrum-kompakt.de


5.b)Test Approaches• Javascript → Voxeo Phono

• C/C++ → OpenVXI, publicVoiceXML, …

• Stress/Penetration → Voice Prover, PAGI, …

• „Flow objects“ → SpeakRight

• Java → JVoiceXML with JUnit


6.Demo<?xml version="1.0" encoding="UTF-8"?> <vxml xmlns="http://www.w3.org/2001/vxml" version="2.1"> <form> <field name="answer"> <grammar src="yesno.srgs" type="application/srgs+xml"/> <prompt>Do you like this example?</prompt> <filled> <if cond="answer=='yes'"> You like this example. <else/> You do not like this example. </if>

</filled> </field> </form> </vxml>


7.Q&A

Automated Testing of Multimodal Applications

Technology

Transcript of Automated Testing of Multimodal Applications