www.excointouch.com
Andy Glover
EuroSTAR 2013
KANBAN STYLE
TEST SCRIPT-FREE VALIDATION IN A REGULATED ENVIRONMENT:
@esconfs #esconfs
Agenda
History
Mentality
Ideas
Case Study
History
Pitfalls
Ideas Freedom
@esconfs #esconfs
Go to Jail
@esconfs #esconfs
Do you expect better testing practices in a heavily regulated environment?
Question for the audience
@esconfs #esconfs
Different Test Phases
A formal process V. An informal process
• Formal test process near the end of the project. Highly detailed and rigid process.
• Informal test process throughout project. Flexible, low detail.
@esconfs #esconfs
Reality: Informal Test Process
Hard to describe Not managed Seems random at times
@esconfs #esconfs
Reality: Formal Test Process
• Test Plan– Test Scripts
• Traceability Matrix– Test Report
– Issue Logs
• Screen Shots• Review, Review, Review
• Sign and date
@esconfs #esconfs
Agenda
History
Mentality
Ideas
Case Study
History
Pitfalls
Ideas Freedom
@esconfs #esconfs
What’s the problem
Testers mind-set:
Pass an audit!
@esconfs #esconfs
Tester’s Mind Set
@esconfs #esconfs
Ideas, Suggestions
History
Mentality
Ideas
Case Study
History
Pitfalls
Ideas Freedom
@esconfs #esconfs
Every project is different
FDA do not mandate a test approach or techniques
Every software development project is different
Testing starts from day one
Request testability requirements
@esconfs #esconfs
Manage all the testing
Manage the informal testing
Manage the testing in sessions
Add Variety Not just Requirements based
testing
@esconfs #esconfs
Don’t settle down
• Good testing is hard
• Software Development (and testing) is new(ish)
@esconfs #esconfs
Learn
Learning doesn’t stop at the end of conferences [or webinars]
Learn from other testers in the same industry as well as other industries
Books, magazines/articles, blogs, forums, exercises/group sessions
@esconfs #esconfs
It’s all about the evidence
Highly detailed test scripts are common in the industry
@esconfs #esconfs
It’s all about the evidence
“Abundant, quality evidence mitigates your other problems”- Griffin Jones 2012
Video shows software working in specific scenarios
@esconfs #esconfs
Video example??
@esconfs #esconfs
Merge the [testing] phases
Agile
Working software overcomprehensive documentation
@esconfs #esconfs
Automation
• Automate as you go within the sprint• Automate only what needs automating
– Focus on checking the software• Add to the automated regression suite• Work with the developers as one team• Use the automation to validate product:
– Build reviews/checks around the automation– Produce screenshots & reports from the automation
@esconfs #esconfs
Kanban… or is it ATDD?
History
Mentality
Ideas
Case Study
History
Pitfalls
Ideas Freedom
@esconfs #esconfs
Put your hands up
Admit you do Requirements Based Testing- i.e. Checking every specification item
From a Requirements or Specification doc:
Req ID Requirement Test Result1 Valid User can login to the system Pass2 Invalid passwords will be rejected Pass3 User will be locked out following 5 invalid passwords Pass
@esconfs #esconfs
OLD PROCESS
@esconfs #esconfs
NEW AND AMAZINGLY AWESOME PROCESS
@esconfs #esconfs
NEW AND AMAZINGLY AWESOME PROCESS
@esconfs #esconfs
WHO OWNS QUALITY?
@esconfs #esconfs
SOAP OPERA TESTING
@esconfs #esconfs
SOAP OPERA TESTING
@esconfs #esconfs
Summary
Highly regulated environments can develop and learn from other industries
Suggestions on new processes/tools
Testers must keep learning and developing skills
Case Study
THANK YOU
www.excointouch.com
Andy Glover
Head of Testing at Exco [email protected]
Software Testing community:Blog: http://cartoontester.blogspot.comTwitter: @cartoontesterI regularly contribute on STC’s The Testing Planet
www.excointouch.com
EXCO INTOUCH
Our mission is to improve clinical and healthcare outcomes through simple, effective and engaging
patient communication
Exco InTouch is a privately owned & managed company, established in 2004
Operational offices in UK, USA and CanadaStudies conducted in 85 countries with over 750,000 patients
@esconfs #esconfs
Questions
?
