TestIstanbul 2017 Keynote: "Characteristics Of A Modern Test Process" by Jan Jaap Cannegieter

Page 1

Characteris*cs of a modern test process Jan Jaap Cannegieter


Agenda

R.I.P. 1983 – 2017

2


3


Specifications predictable Tools

PROCESS ADHERENCE

Stages

Waterfall

Method based Certification

PLANNING FIXED REQUIREMENTS QUALITY GATES BIG BANG O R G A N I Z AT I O N A L P O L I C Y

Project management

Quality accurance

TEST PLAN

Process

Contract

DOCUMENTATION

DESIGN

SDM

HAND BOOK

Monitoring and control

PLANNING

STABILITY


5


FAST

DevOps FLEXIBILITY

PEOPLE SKILLS

PERFORMANCE AGILE PASSION SCRUM CHANGE CRAFTMANSHIP

PRAGMATIC C O L L A B O R AT I O N

TOOLING

OUTSOURCING

VALUEBASED

CUSTOMER SATISFACTION CONTINUOUS DELIVERY

CULTURE

AUTONOMOUS

PROJECT

SECURITY

TEAM PLANNING

vision

User stories ITERATIONS

MULTIFUNCTIONAL TEAM

BUSINESSVALUE


Changes Planned

Flexible

7


Changes Planned

Flexible

Method

Cra=smanship

8


Changes Planned

Flexible

Method

Cra=smanship

9


Changes Planned

Flexible

Method

Cra=smanship

Process focus

Goal oriented

10


Changes Planned

Flexible

Method

Cra=smanship

Process focus

Goal oriented

Thoroughly

Fast

11


Changes Planned

Flexible

Method

Cra=smanship

Process focus

Goal oriented

Thoroughly

Fast

Standard

PragmaFc 12


Changes Planned

Flexible

Method

Cra=smanship

Process focus

Goal oriented

Thoroughly

Fast

Standard

PragmaFc 13


The classical way of tes*ng…

Test management Strategy & planning Design & Specification

Execution

Closure

…is not (always) applicable anymore 14


Goal oriented

Fast

Flexible

15


Characteris*c 1: Goal orienta*on


Some testers in their project

17


18


From: ‘Start with why’ by Simon Sinek

19


Goal oriented Confirmation based

= Check

Goals testing

Risk based

Is the system in line with the regulations and requirements Which risks are (not) covered

= Risk

Value based

Which value is delivered By the product/iteration

= Value

Inspired by testing vs checking and testing vs checking revised by Michael Bolton and James Bach: http://www.developsense.com/blog/2009/08/testing-vs-checking/ and http://www.satisfice.com/blog/archives/856 as well as ‘Reinventing software qualtiy by Goyko Adzic, Agile testing days 2012: https://www.youtube.com/watch?v=8To_Nh68QPk



Characteris*c 2: Flexibility

15.57


Flexibility in tes*ng Tes*ng

Scripted tes*ng

Exploratory tes*ng

23


Different ways of tes*ng Detailed scripFng

Global scripFng

Scripted tesFng

Session based tesFng

Bug hunts

Freestyle Test exploratory tours tesFng

Exploratory tesFng

Based on‘Telling your exploratory story’ by Jon Bach, Agile 2010 conference

24


Different ways of tes*ng Detailed scripFng

Global scripFng

Scripted tesFng Focussed on preparation Focussed on planning Rely on the method Confidence in the process Focussed on documentation

Session based tesFng

Bug hunts

Freestyle Test exploratory tours tesFng

Exploratory tesFng Focussed on action Flexible Pragmatic Rely on the tester Focussed on test execution Based on‘Telling your exploratory story’ by Jon Bach, Agile 2010 conference

25



Characteris*c 3: Fast

16.10


Fast

Documentation

Automation

Detailed scripFng

Global scripFng

Scripted tesFng

Session based tesFng

Bug hunts

Freestyle Test exploratory tesFng tours

Exploratory tesFng

28


Automa*on = checking

29


What can we automate? Infinite amount of tests Valuable tests Tests that you want to do more than once

Tests that you want to do once

Tests you can automate

Tests that you want to automate Tests you have automated

Based on ‘Implication of emphasis on automation in CI’ - Martin Jansson http://thetesteye.com/blog/2017/03/implication-of-emphasis-on-automation-in-ci/


Automa*on and costs Manual

Automated

Functional testing Analysis outcome Regression test Non-functional test 31


You can test more You can test more o=en You can test faster You can test different things Maybe it is even more expensive

32


Documenta*on Â

33


TESTERS ALL COUNTRIES, DEINSTALL WORD

R.I.P. 1983 – 2017

34


Recap Â

16.20


Check

Goal oriented

Fast Automation

Risk

Documentation Value

Flexible Detailed scripFng

Globale scripFng

Scripted tesFng

Session based tesFng

Bug hunts

Freestyle Test exploratory tesFng tours

Exploratory tesFng

36


What about the state of tes*ng in Turkey? •  Go to www.menF.com •  Code: 137910 •  Choose three skills you want to improve: –  –  –  –  –  –  –  –

Goal orientaFon Checking skills Risk based tesFng Value based tesFng Detailed scripFng and global scripFng Session based tesFng and bug hunFng Test tours and free style exploratory tesFng AutomaFon

–  CreaFve documentaFon

Link 37


So a modern tester… … determines the goal of his/her tesFng … is able to apply check, risk based and value based tesFng … masters different ways of scripted tesFng … masters different ways of exploratory tesFng … knows when to apply which way of tesFng … masters different ways of documentaFon … masters test automaFon … has a community to discuss his/her situaFon … and never stops learning 38



Keep learning

Train Apply

Experi-­‐ ment


Ques*ons Â