Special Interest Group in Software Testing - ANZTB - …€¦ ·  · 2015-08-25Special Interest...

42
Australia and New Zealand Testing Board www.anztb.org 25 th August 2015 Sydney David Fuller & Steve Toms Special Interest Group in Software Testing Please feel free to Tweet: #ANZTBSIGIST

Transcript of Special Interest Group in Software Testing - ANZTB - …€¦ ·  · 2015-08-25Special Interest...

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

25th August 2015 Sydney

David Fuller & Steve Toms

Special Interest Group in

Software Testing

Please feel free to Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

Agenda 5:30pm ANZTB update 5:40pm “Mobile Testing and our focus on enhancing the Customer Experience " by David Fuller 6:15pm Networking & Refreshments 6:45pm “Transition from V-Model into Agile Scrum : What does it mean to testing in embedded mobile audio projects?" by Dr Jason Lee 7:20pm Close Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

Who is ANZTB? • ANZTB is a national board of the ISTQB,

representing and supporting software testing professionals in Australia and New Zealand

• ANZTB offers: • Accreditation and on-going audit of training providers to

supply courses which meet the ISTQB's syllabi.

•  Facilitation of certification of individuals according to ISTQB standards.

•  Promotion of testing as a worthwhile career path for IT testing professionals throughout Australasia.

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org

ANZTB Team 1.  Steve Toms, Chair – Sydney 2.  David Fuller, Accreditation Chair – Sydney 3.  Graeme Mackenzie, Treasurer – Wellington 4.  Ian Ross, Governance Officer & Vice Chair – Christchurch 5.  Carol Cornelius, Examination Chair – Wellington 6.  Marie Walsh, Marketing Chair & Training Provider Liaison Officer –

Brisbane 7.  Sarah Benstead , SIGiST Coordinator – Perth 8.  Nigel Saunders, Accreditation Chair – Auckland

9.  Leanne Howard – Sydney 10.  Veronica Belcher – Brisbane 11.  Stanley Johannes – Christchurch 12.  Anne Carter - Adelaide 13.  Tracy Merlino – Melbourne

Board Members

Associate Members

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org

What does ANZTB offer?

ANZTB

Certification of Software Testers

Training Provider

Accreditation

Create & run exams

Participate in ISTQB

international working groups

Support the development

of syllabi

SIGiSTs

Conference

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

ANZTB

Certification of Software Testers

Training Provider

Accreditation

Create & run exams

Participate in ISTQB

international working groups

Support the development

of syllabi

SIGiSTs

Conference

Certification of Software

Testers

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

Certifying Software Testers Worldwide

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org

•  Automatic inclusion on the ANZTB certified testers list •  http://anztb.org/certifiedtesters.php •  Employers can

check qualification levels

Copyright © ANZTB 8

Why take ISTQB certification with the ANZTB?

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org

Certified Testers in Australia & New Zealand

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

ANZTB

Certification of Software Testers

Training Provider

Accreditation

Create & run exams

Participate in ISTQB

international working groups

Support the development

of syllabi

SIGiSTs

Conference Accreditation

of Training Providers

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org

•  ANZTB accreditation of training providers is globally recognised which means our training providers have met the terms of ISTQB

•  Accreditation ensures –  Training materials conform with the current syllabi –  Trainers have relevant experience and skills in both

software testing and training –  Organisations have access to facilities adequate for

delivering training.

Copyright © ANZTB

Training Provider Accreditation

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org

Copyright © ANZTB 12

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

ANZTB

Certification of Software Testers

Training Provider

Accreditation

Create & run exams

Participate in ISTQB

international working groups

Support the development

of syllabi

SIGiSTs

Conference

Create & run exams

Exams  are  wri+en  in:  -­‐  Wellington  -­‐  Auckland  -­‐  Brisbane  -­‐  Melbourne    

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

ANZTB

Certification of Software Testers

Training Provider

Accreditation

Create & run exams

Participate in ISTQB

international working groups

Support the development

of syllabi

SIGiSTs

Conference

Participate in ISTQB

international working groups

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org

The ISTQB® Working Groups ensure the development and the spread of the knowledge according to the most up-to-date needs of the profession.

Copyright © ANZTB

ISTQB Working Groups

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

ANZTB

Certification of Software Testers

Training Provider

Accreditation

Create & run exams

Participate in ISTQB

international working groups

Support the development

of syllabi

SIGiSTs

Conference

Support the development

of syllabi

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

Foundation Level Extension Syllabus Agile Tester – Released June 2014

New syllabus & supporting documents can be downloaded from: http://anztb.org/downloads.php

ANZTB members were involved in the co-authoring and reviewing of the new Agile Tester Syllabus

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

ANZTB

Certification of Software Testers

Training Provider

Accreditation

Create & run exams

Participate in ISTQB

international working groups

Support the development

of syllabi

SIGiSTs

Conference

SIGiSTs

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org

Copyright © ANZTB

ANZTB SIGiSTs

SIGiSTs are run 3 to 4 times a year across Australia and New Zealand in the following cities:

•  Adelaide •  Auckland •  Brisbane •  Canberra •  Christchurch •  Melbourne •  Perth •  Sydney •  Wellington

!  Up to 30 SIGiSTs per year and growing

!  Past presentations are available on the ANZTB website

!  If you would like to be involved – please speak to your facilitator

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org

•  The aim of our Specialist Interest Groups is to: –  Discuss White Papers –  Discuss Technology or Technique changes –  Share Information –  Network

SIGiSTs are sponsored by ANZTB and are in no way linked to any particular training provider or third party.

Copyright © ANZTB

Special Interest Groups

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

ANZTB

Certification of Software Testers

Training Provider

Accreditation

Create & run exams

Participate in ISTQB

international working groups

Support the development

of syllabi

SIGiSTs

Conference Conference

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org

Advancing Expertise in Software Testing

When: May 2016 Where: Melbourne

This one-day event will feature local and international testing experts, discussing the latest advances in the profession. For more details and registration see the website in coming months

Copyright © ANZTB

ANZTB Test 2016 Conference

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

“Mobile Testing and our focus on enhancing the Customer Experience"

by David Fuller

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

As part of our journey with Mobile Testing we are focused on putting the customer at the centre of

everything we do.

This has changed the focus on our coverage from just "functional tests" to include Accessibility and

Technical testing (+ more).

I will take you through some of our approaches & the challenges we have faced.

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

Current Focus Areas

1. Move from Web to Hybrid & Native

2. Functional coverage to User Experience [including Accessibility]

3. Increased Automated testing [Progressive & Regression]

4. Break testing – OS betas, App upgrades, Backward compatibility,

Connectivity drop outs etc

5. Risk Based Testing approach to reduce need for physical devices

6. Feedback loop with our Production Support teams to understand

customer usage & defects found post testing

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

Next Focus Areas 1. Mobile network simulation & performance testing [including server

performance testing]

2. Establishing Mobile SME body of knowledge

3. Device Emulation & Fleet Management

4. Non-functional testing for Native, Web & Hybrid mobile apps [including

Reliability, Load & Destructive coverage]

5. Sharing of assets across Dev (continuous integration), Business IT Support

& PIV

6. Ongoing Tool Evaluation

7. Clear ownership, operating model & cost model [Devices & tools]

8. Periodic reviews & prioritization of Regression Test suites

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

Networking & Refreshments

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

“Transition from V-Model into Agile Scrum : What

does it mean to testing in embedded mobile audio

projects?" by Dr Jason Lee

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org

Overview

•  Bio •  Background •  Key takeaways

–  Transition from Traditional SDLC to Agile –  Types of Testing –  Challenges

•  Conclusion

Copyright © ANZTB

Australia and New Zealand Testing Board www.anztb.org

Bio

–  Senior Test Lead, Dolby Labs –  PhD in Software Engineering (Testing) with

The University of Melbourne –  10+ working experience in embedded

software testing in telecommunication, networking, mobile and audio domain

Copyright © ANZTB

Australia and New Zealand Testing Board www.anztb.org

Background

–  Delivering embedded audio technologies in SoC

–  Android AOSP platform, recently working on iOS apps

–  Teams focusing on different market segments; PC, Mobile, Gaming

–  25 – 30 QA Engineers across SYD, BEJ and SFO

Copyright © ANZTB

Australia and New Zealand Testing Board www.anztb.org

How we fit into the Android Space - I

Copyright © ANZTB

Australia and New Zealand Testing Board www.anztb.org

Waterfall to Agile

Copyright © ANZTB

Australia and New Zealand Testing Board www.anztb.org

Low Level API Testing

Copyright © ANZTB

Australia and New Zealand Testing Board www.anztb.org

Copyright © ANZTB

Australia and New Zealand Testing Board www.anztb.org

Challenges Partnering with multiple OEMs

• OEMs – MTK, Qualcomm

• Different timelines integrating code bases with multiple chipsets

Rapid Test Time

• Tests kick off rapidly

• Sprint switching two-weeks to one-week and vice-versa

Test Automation

Tools • Build tools rapidly

and require strategic planning

•  Involves feedback from the team; developers and UX team members

Reference Tests

• Finding accurate reference vectors even from early of the sprint (defining scope)

• Golden ears

Copyright © ANZTB

Australia and New Zealand Testing Board www.anztb.org

Conclusion

Copyright © ANZTB

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

Any questions? Discussion

Australia and New Zealand Testing Board www.anztb.org

•  Volunteers for facilitation of the next SIGiST? •  Volunteers to submit white papers for presentation

and discussion? The SIGiST cannot succeed without your input.

Copyright © ANZTB

Future SIGiSTs

Tweet: #ANZTBSIGIST

Australia and New Zealand Testing Board www.anztb.org

What did you think of the SIGiST? Please feel free to Tweet now.

#ANZTBSIGIST

www.anztb.org

Copyright © ANZTB

ANZTB SIGiST

Australia and New Zealand Testing Board www.anztb.org

Please  be  aware  that  ANZTB  may  be  taking  photos  of  this  event  for  marke;ng  and  social  media  purposes.  If  you  do  not  wish  to  

be  included  in  the  photos  please  no;fy  the  photographer.    

Thank  you  

Copyright © ANZTB 41

Photographs

Australia and New Zealand Testing Board www.anztb.org Australia and New Zealand Testing Board www.anztb.org

Any questions?