F14-11/3: Create Your Roadmap to Data-Driven Quality

Track/s: STRATEGY

Bing analyzes Petabytes of data per day. Facebook instruments everything. Outlook.com analyzes web performance for millions of real users. Why? Because testing is measurement, and measurement requires data.

Testers have traditionally relied on test results, but additional data sources now available to the tester are expanding like never before. Data-Driven Quality (DDQ) strategies such as Testing in Production (TiP) are essential tools for most testers, but the question is how do you implement these strategies to benefit your specific product? If you are seeking this answer, Seth and Monica will show you how to move forward. The data you will need can be big or small, real-time or delayed, synthetic or organic. So it is critical that you know what questions you need to answer and what data you need to answer them. With this workshop, you will learn the tools and knowledge necessary to get insights from this data and then get hands-on experience applying this knowledge. We will take you through the critical thinking and framing to understand how data-driven quality can benefit your product and team. We will then enable you to create a roadmap for how you can implement your data-driven quality strategy for your product to take your testing to the next level. This session is for quality team leaders, thought leaders, and individuals who want to educate their leadership on DDQ.

Workshop Takeaways:

  • See the power of DDQ to provide business value
  • Apply the DDQ lifecycle of Questions, Data, and Insights to create an Action Plan
  • Learn the model of how to understand system health using data
  • Understand the basics of a data platform


Download Presentation

Please Note: The presentations are intended for attendees only. The presentations page is password protected – contact info@softwaretestpro.com for verification of attendance and the password to access the presentation.


Session Speakers:

Seth Eliot – Principal Knowledge Engineer, Microsoft Test Excellence
Seth EliotSeth Eliot is the Principal Knowledge Engineer for Microsoft Test Excellence, focusing on driving best practices for services and cloud development and testing across the company. He previously was Senior Test Manager, most recently for the team solving exabyte storage and data processing challenges for Bing, and before that enabling developers to innovate by testing new ideas quickly with users “in production” with the Microsoft Experimentation Platform Testing in Production (TiP). TiP, software processes, cloud computing, and other topics are ruminated upon at Seth’s blog. Prior to Microsoft, Seth applied his experience at delivering high quality software services at Amazon.com where he led the Digital QA team to release Amazon MP3 download, Amazon Instant Video Streaming, and Kindle Services.

Speaker Details:

Twitter: @setheliot
LinkedIn: Seth Eliot
Blog: Your Software Has Bugs
Past Events: STPCon, STAR East, STAR West, TestBash, CAST


Monica Catunda – Senior Service Engineer, Microsoft
Monica CatundaMonica Catunda is Senior Service Engineer for Microsoft Service Engineering Excellence, focusing on driving best practices for data-driven engineering across the company. She previously was Senior Service Engineering Manager for the Windows and Windows Live Division under the Operating Systems Group, where she worked on release management, overseeing operational planning and readiness across 100s of online apps and services. She worked for Microsoft Ireland for eight years managing international releases of Internet Explorer and Windows Update before relocating to Microsoft headquarters in 2003. Monica earned a master’s degree in Information Systems Management from the National College of Ireland.

Speaker Details:

LinkedIn: Monica Catunda