QA in Sakai A Practical Guide to Getting Involved

Alan Berg – QA Director, SakaiMegan May – QA Lead & Project Coordinator, IU

Agenda

11th Sakai Conference - June 15-17, 2010

• What is QA?• The QA WG & QA Network• The basics of the current lifecycle• Resources

• Jira, Confluence, Distribution lists• Hudson, Automation

• How to get involved?• Hear from someone involved• Automation, peer code review• Problem owner (Example Internationalization)

• Making the Argument back home• Questions?

“What is Quality Assurance?”

“Those who don't know the [past] are destined to repeat it.”

Edmund Burke

The QA WG

11th Sakai Conference - June 15-17, 2010

QA WG

11th Sakai Conference - June 15-17, 2010

• History of QA in Sakai

• Who

• QA Network

The basics of the current lifecycle

11th Sakai Conference - June 15-17, 2010

The basics of the lifecycle

11th Sakai Conference - June 15-17, 2010

WORK IN PROGRESSYOUR VIEWS COUNT

We’re Walking about at the Conference

SAY THINGS ON LIST

We are a DO-OCRACRY looking for activeMembers.

The basics of the lifecycle

11th Sakai Conference - June 15-17, 2010

2.7 as an example• Boundaries (In theory]

o Alpha Beta -- Functional freeze – Differences in product documented

o Beta Release Candidate – No Known blockerso Release Candidate Production – All Jira’s in

known state• Tags every two weeks

o QA server’s for biodiversity• Release Management once a week

o What is playing out in the fieldo Where are our priorities.o Interaction with other WG’s (Internationalization, MT]

The basics of the lifecycle

11th Sakai Conference - June 15-17, 2010

2.7 as an example – More• Cross cutting concerns

o Static code sweepo Security sweepo Internationalization sweep – David R.Mo Jira sweepo Need QA leads – We need talented doer’s

• New infrastructureo Hudson CI + Blame mechanism (more soon)

• Maintenance Team is born

Resources

11th Sakai Conference - June 15-17, 2010

Be informed!

11th Sakai Conference - June 15-17, 2010

• Important Distribution Lists http://collab.sakaiproject.org/mailman/listinfo

• QA WG• Management

• Help Documentation• Confluence

• QA WG Space: http://confluence.sakaiproject.org//x/RYApAQ• Release Management Space: http://confluence.sakaiproject.org//x/IQAiAQ • Individual Project Spaces

Confluence

11th Sakai Conference - June 15-17, 2010

http://confluence.sakaiproject.org

JIRA

11th Sakai Conference - June 15-17, 2010

http://jira.sakaiproject.org/secure/Dashboard.jspa

Resources

11th Sakai Conference - June 15-17, 2010

• Hudson (sakaiproject.org:8080) Show around if Internet connection

• Continuous Build Server• Blame mechanism• Includes Indie projects – Busy part of the infrastructure• Expect much more [TIME ALLOWING]

-Looking at integration tests and automated functional testing o Sakai 3 – Stuart Freeman leading the charge, people like Carl

Hall and the Cambridge UI teamo JavaScript Unit Testso Ruby Integration testso Good old hand testingo Automated Functional testing – Corey from rSmarto Jmeter tests

How to get involved

11th Sakai Conference - June 15-17, 2010

Personal Experience

11th Sakai Conference - June 15-17, 2010

Only certainties in life: Death, taxes and bugs in code!

How to Get Involved

11th Sakai Conference - June 15-17, 2010

• Code Review [catch things early]o Whats new via static code review – Keep an eye on defects

moving into trunko New patches – Need to look at Jira best practices.o MT working efficiently and need supporto Review around code that breaks trunk - Blame mechanism

• Automation [If only I had time]o GUI side Sakai 3 is difficult to defend – Brainstorming

welcomed – this might save embarrassment latero Jira Reports / Jira pluginso Help with pushing from Hudson testso Fitnes – Looking at writing and running automated Functional

tests via a WIKIo YOUR OWN IDEA’s HERE

How to Get Involved

11th Sakai Conference - June 15-17, 2010

• Can have more than one hat per QA expert• Problem owners – Will be difficult to find

o Expert in field, Has driveo Links to associate WG (if it exists) – But who guards

the guardo Evangelist as well as consistent coordinator of

testing • David Ronald – Internationalization• Stuart Freeman – Nucleation point for central

QA testing for Sakai 3

How to Get Involved

11th Sakai Conference - June 15-17, 2010

• Code boundaries act as entropy• Cross cutting concerns

o Micro defects – Static code reviewo Security, GUI, Internationalization, SQL

conversion scripts, Performance and so ono Uneven code quality – Code reviewo Bridge to Product councilo Jira best practice and reporting

Selling to the suits

11th Sakai Conference - June 15-17, 2010

• Low barrier entry point to community

• Opportunity to become SME from technical and functional view point

• What happens in the community has a direct local impact

• Costs

Q/A and not QA

11th Sakai Conference - June 15-17, 2010