Characteris*cs of a modern test process Jan Jaap Cannegieter
Agenda
R.I.P. 1983 – 2017
2
3
Specifications predictable Tools
PROCESS ADHERENCE
Stages
Waterfall
Method based Certification
PLANNING FIXED REQUIREMENTS QUALITY GATES BIG BANG O R G A N I Z AT I O N A L P O L I C Y
Project management
Quality accurance
TEST PLAN
Process
Contract
DOCUMENTATION
DESIGN
SDM
HAND BOOK
Monitoring and control
PLANNING
STABILITY
5
FAST
DevOps FLEXIBILITY
PEOPLE SKILLS
PERFORMANCE AGILE PASSION SCRUM CHANGE CRAFTMANSHIP
PRAGMATIC C O L L A B O R AT I O N
TOOLING
OUTSOURCING
VALUEBASED
CUSTOMER SATISFACTION CONTINUOUS DELIVERY
CULTURE
AUTONOMOUS
PROJECT
SECURITY
TEAM PLANNING
vision
User stories ITERATIONS
MULTIFUNCTIONAL TEAM
BUSINESSVALUE
Changes Planned
Flexible
7
Changes Planned
Flexible
Method
Cra=smanship
8
Changes Planned
Flexible
Method
Cra=smanship
9
Changes Planned
Flexible
Method
Cra=smanship
Process focus
Goal oriented
10
Changes Planned
Flexible
Method
Cra=smanship
Process focus
Goal oriented
Thoroughly
Fast
11
Changes Planned
Flexible
Method
Cra=smanship
Process focus
Goal oriented
Thoroughly
Fast
Standard
PragmaFc 12
Changes Planned
Flexible
Method
Cra=smanship
Process focus
Goal oriented
Thoroughly
Fast
Standard
PragmaFc 13
The classical way of tes*ng…
Test management Strategy & planning Design & Specification
Execution
Closure
…is not (always) applicable anymore 14
Goal oriented
Fast
Flexible
15
Characteris*c 1: Goal orienta*on
Some testers in their project
17
18
From: ‘Start with why’ by Simon Sinek
19
Goal oriented Confirmation based
= Check
Goals testing
Risk based
Is the system in line with the regulations and requirements Which risks are (not) covered
= Risk
Value based
Which value is delivered By the product/iteration
= Value
Inspired by testing vs checking and testing vs checking revised by Michael Bolton and James Bach: http://www.developsense.com/blog/2009/08/testing-vs-checking/ and http://www.satisfice.com/blog/archives/856 as well as ‘Reinventing software qualtiy by Goyko Adzic, Agile testing days 2012: https://www.youtube.com/watch?v=8To_Nh68QPk
Characteris*c 2: Flexibility
15.57
Flexibility in tes*ng Tes*ng
Scripted tes*ng
Exploratory tes*ng
23
Different ways of tes*ng Detailed scripFng
Global scripFng
Scripted tesFng
Session based tesFng
Bug hunts
Freestyle Test exploratory tours tesFng
Exploratory tesFng
Based on‘Telling your exploratory story’ by Jon Bach, Agile 2010 conference
24
Different ways of tes*ng Detailed scripFng
Global scripFng
Scripted tesFng Focussed on preparation Focussed on planning Rely on the method Confidence in the process Focussed on documentation
Session based tesFng
Bug hunts
Freestyle Test exploratory tours tesFng
Exploratory tesFng Focussed on action Flexible Pragmatic Rely on the tester Focussed on test execution Based on‘Telling your exploratory story’ by Jon Bach, Agile 2010 conference
25
Characteris*c 3: Fast
16.10
Fast
Documentation
Automation
Detailed scripFng
Global scripFng
Scripted tesFng
Session based tesFng
Bug hunts
Freestyle Test exploratory tesFng tours
Exploratory tesFng
28
Automa*on = checking
29
What can we automate? Infinite amount of tests Valuable tests Tests that you want to do more than once
Tests that you want to do once
Tests you can automate
Tests that you want to automate Tests you have automated
Based on ‘Implication of emphasis on automation in CI’ - Martin Jansson http://thetesteye.com/blog/2017/03/implication-of-emphasis-on-automation-in-ci/
Automa*on and costs Manual
Automated
Functional testing Analysis outcome Regression test Non-functional test 31
You can test more You can test more o=en You can test faster You can test different things Maybe it is even more expensive
32
Documenta*on Â
33
TESTERS ALL COUNTRIES, DEINSTALL WORD
R.I.P. 1983 – 2017
34
Recap Â
16.20
Check
Goal oriented
Fast Automation
Risk
Documentation Value
Flexible Detailed scripFng
Globale scripFng
Scripted tesFng
Session based tesFng
Bug hunts
Freestyle Test exploratory tesFng tours
Exploratory tesFng
36
What about the state of tes*ng in Turkey? • Go to www.menF.com • Code: 137910 • Choose three skills you want to improve: – – – – – – – –
Goal orientaFon Checking skills Risk based tesFng Value based tesFng Detailed scripFng and global scripFng Session based tesFng and bug hunFng Test tours and free style exploratory tesFng AutomaFon
– CreaFve documentaFon
Link 37
So a modern tester… … determines the goal of his/her tesFng … is able to apply check, risk based and value based tesFng … masters different ways of scripted tesFng … masters different ways of exploratory tesFng … knows when to apply which way of tesFng … masters different ways of documentaFon … masters test automaFon … has a community to discuss his/her situaFon … and never stops learning 38
Keep learning
Train Apply
Experi-‐ ment
Ques*ons Â