Post on 18-Dec-2014
description
QA in Sakai A Practical Guide to Getting Involved
Alan Berg – QA Director, SakaiMegan May – QA Lead & Project Coordinator, IU
Agenda
11th Sakai Conference - June 15-17, 2010
• What is QA?• The QA WG & QA Network• The basics of the current lifecycle• Resources
• Jira, Confluence, Distribution lists• Hudson, Automation
• How to get involved?• Hear from someone involved• Automation, peer code review• Problem owner (Example Internationalization)
• Making the Argument back home• Questions?
“What is Quality Assurance?”
“Those who don't know the [past] are destined to repeat it.”
Edmund Burke
The QA WG
11th Sakai Conference - June 15-17, 2010
QA WG
11th Sakai Conference - June 15-17, 2010
• History of QA in Sakai
• Who
• QA Network
The basics of the current lifecycle
11th Sakai Conference - June 15-17, 2010
The basics of the lifecycle
11th Sakai Conference - June 15-17, 2010
WORK IN PROGRESSYOUR VIEWS COUNT
We’re Walking about at the Conference
SAY THINGS ON LIST
We are a DO-OCRACRY looking for activeMembers.
The basics of the lifecycle
11th Sakai Conference - June 15-17, 2010
2.7 as an example• Boundaries (In theory]
o Alpha Beta -- Functional freeze – Differences in product documented
o Beta Release Candidate – No Known blockerso Release Candidate Production – All Jira’s in
known state• Tags every two weeks
o QA server’s for biodiversity• Release Management once a week
o What is playing out in the fieldo Where are our priorities.o Interaction with other WG’s (Internationalization, MT]
The basics of the lifecycle
11th Sakai Conference - June 15-17, 2010
2.7 as an example – More• Cross cutting concerns
o Static code sweepo Security sweepo Internationalization sweep – David R.Mo Jira sweepo Need QA leads – We need talented doer’s
• New infrastructureo Hudson CI + Blame mechanism (more soon)
• Maintenance Team is born
Resources
11th Sakai Conference - June 15-17, 2010
Be informed!
11th Sakai Conference - June 15-17, 2010
• Important Distribution Lists http://collab.sakaiproject.org/mailman/listinfo
• QA WG• Management
• Help Documentation• Confluence
• QA WG Space: http://confluence.sakaiproject.org//x/RYApAQ• Release Management Space: http://confluence.sakaiproject.org//x/IQAiAQ • Individual Project Spaces
Confluence
11th Sakai Conference - June 15-17, 2010
http://confluence.sakaiproject.org
JIRA
11th Sakai Conference - June 15-17, 2010
http://jira.sakaiproject.org/secure/Dashboard.jspa
Resources
11th Sakai Conference - June 15-17, 2010
• Hudson (sakaiproject.org:8080) Show around if Internet connection
• Continuous Build Server• Blame mechanism• Includes Indie projects – Busy part of the infrastructure• Expect much more [TIME ALLOWING]
-Looking at integration tests and automated functional testing o Sakai 3 – Stuart Freeman leading the charge, people like Carl
Hall and the Cambridge UI teamo JavaScript Unit Testso Ruby Integration testso Good old hand testingo Automated Functional testing – Corey from rSmarto Jmeter tests
How to get involved
11th Sakai Conference - June 15-17, 2010
Personal Experience
11th Sakai Conference - June 15-17, 2010
Only certainties in life: Death, taxes and bugs in code!
How to Get Involved
11th Sakai Conference - June 15-17, 2010
• Code Review [catch things early]o Whats new via static code review – Keep an eye on defects
moving into trunko New patches – Need to look at Jira best practices.o MT working efficiently and need supporto Review around code that breaks trunk - Blame mechanism
• Automation [If only I had time]o GUI side Sakai 3 is difficult to defend – Brainstorming
welcomed – this might save embarrassment latero Jira Reports / Jira pluginso Help with pushing from Hudson testso Fitnes – Looking at writing and running automated Functional
tests via a WIKIo YOUR OWN IDEA’s HERE
How to Get Involved
11th Sakai Conference - June 15-17, 2010
• Can have more than one hat per QA expert• Problem owners – Will be difficult to find
o Expert in field, Has driveo Links to associate WG (if it exists) – But who guards
the guardo Evangelist as well as consistent coordinator of
testing • David Ronald – Internationalization• Stuart Freeman – Nucleation point for central
QA testing for Sakai 3
How to Get Involved
11th Sakai Conference - June 15-17, 2010
• Code boundaries act as entropy• Cross cutting concerns
o Micro defects – Static code reviewo Security, GUI, Internationalization, SQL
conversion scripts, Performance and so ono Uneven code quality – Code reviewo Bridge to Product councilo Jira best practice and reporting
Selling to the suits
11th Sakai Conference - June 15-17, 2010
• Low barrier entry point to community
• Opportunity to become SME from technical and functional view point
• What happens in the community has a direct local impact
• Costs
Q/A and not QA
11th Sakai Conference - June 15-17, 2010