20.10.2014 M2M Summit 2014, Düsseldorf Sheet # 1

Automated Testing ofMultimodal Applications

Raphael GronerISTQB® Certified Tester

Bachelor of Science for Production ManagementIT Specialist (IHK) - Application Development

http://www.xing.com/profile/Raphael_Groner

voice-mediator @ email.de

http://www.jvoicexml.org

20.10.2014 M2M Summit 2014, Düsseldorf Sheet # 2

Init: What is it all about?

20.10.2014 M2M Summit 2014, Düsseldorf Sheet # 3

Agenda1.Technical Communication2.Fields of Use3.MMI as a Standard4.Requirements5.Testing6.Demo7.Q&A

20.10.2014 M2M Summit 2014, Düsseldorf Sheet # 4

1.Technical Communication* Mechanical buttons19-20th centuryB. Preim, Development of Interactive Systems, 1999

Graphics and Touch21st centuryApple Siri, iPhone6, 2014

+ Functions through Interaction +

20.10.2014 M2M Summit 2014, Düsseldorf Sheet # 5

2.Fields of Use for MMI• Logistics: „Pick by Voice“ Commissioning & Inventory Voice-based Briefing Controlling via Identification

• Entertainment Multimedia & Games Social Networks Microsoft Kinect

• Home Automation DIY Automation Project

• Inquiry desk and agency Travel, Stocks, Weather, … Call Center: „FAQ“ Traffic Navigation Monitoring of Animals

20.10.2014 M2M Summit 2014, Düsseldorf Sheet # 6

3.MMI as a Standard• Why? → Theory of Communication

Naturally spoken and Formalised LanguagesInteraction between People & MachineHow interact Machines among each other?

• VoiceXML is an extra W3C and XML standardVersion 2.1 is CurrentVersion 3.0 is DraftDeployment like HTMLEditors, Generators

VoiceXML Forum

20.10.2014 M2M Summit 2014, Düsseldorf Sheet # 7

4.RequirementsText interface available (VoiceXML)Automation & Scripting enabledValidation of Inputs und Outputs Input done with Keys or Spoken Output with Emphasis and Idioms or Dialects Output checked for correct Parts

Combination of ConditionsDelay of Inputs meaning „Timeout“…

20.10.2014 M2M Summit 2014, Düsseldorf Sheet # 8

5.a)Test in a Process

http://www.scrum-kompakt.de

20.10.2014 M2M Summit 2014, Düsseldorf Sheet # 9

5.b)Test Approaches• Javascript → Voxeo Phono

• C/C++ → OpenVXI, publicVoiceXML, …

• Stress/Penetration → Voice Prover, PAGI, …

• „Flow objects“ → SpeakRight

• Java → JVoiceXML with JUnit

20.10.2014 M2M Summit 2014, Düsseldorf Sheet # 10

6.Demo<?xml version="1.0" encoding="UTF-8"?> <vxml xmlns="http://www.w3.org/2001/vxml" version="2.1"> <form> <field name="answer"> <grammar src="yesno.srgs" type="application/srgs+xml"/> <prompt>Do you like this example?</prompt> <filled> <if cond="answer=='yes'"> You like this example. <else/> You do not like this example. </if>

</filled> </field> </form> </vxml>

20.10.2014 M2M Summit 2014, Düsseldorf Sheet # 11

7.Q&A