Listen beyond the pass and fail A story of looking at the bigger picture


Thursday 19th,

2:30 p.m. – 3:15 p.m.


Talks (Track 2) – Indoor Hall

Session Type

25-minute Talk,

All levels


Anyone involved in testing but especially people leading testing efforts or test automation experts


  • Looking at your test results over a longer time period will give you additional insights
  • Categories and traps to look out for
  • How to use trends for continuous improvement

Looking at trends will help you see patterns. Through those, areas where changes will have big impacts. Involving people with other expertise might solve problems you thought were unsurpassable.

I started a new job a number of years back, with one of my responsibilities stated as “Move the existing automation to the next level”. They had a lot of automated tests in place already and had gotten automation to be a normal part of team delivery. Great! I've worked with a lot of problematic automation and I know a thing or two about what not to do. So, it sounded like a dream! In my vision, I saw a nice, smooth pipeline where tests pass or are fixed ASAP. In reality however, most days at least something had failed. And it felt like no one was worried about it. I worried. And I could smell a pattern. Armed with a mountain of data, my ancient statistics minor and a lot of curiosity I set off to figure out how to move from fire fighting to long-term and continuous improvement. During this talk we will look at a number of perspectives you can explore and how they might give you important insights. We will look at how to use trends, categorisation and how to embrace responsibility instead of making it someone else's problem.

More Related Sessions

  • Talk
  • Workshop
  • Bonus
  • Keynote
  • Social

25-minute Talk

2:30 p.m. – 3:15 p.m. Talks (Track 1) – Main Stage at the Beach

25-minute Talk

10:45 a.m. – 11:30 a.m. Talks (Track 1) – Main Stage at the Beach

25-minute Talk

1:15 p.m. – 2:00 p.m. Talks (Track 2) – Indoor Hall