Testing is a cornerstone of XP, tests are written for every piece of code before it is programmed. This workbook helps testers learn XP, and XP devotees learn testing. This new book defines how an XP tester can optimally contribute to a project, including what testers should do, when they should do it, and how they should do it.
With this book as a guide, you will learn to embrace testing. A sound testing program is the engine that drives an XP project.
I. THE XP TESTER ROLE.
1. An Overview.
Overview of XP.
How XP Solves Testing and Quality Assurance Problems.
System and Acceptance Testing Resources Wasted on Unit- and Integration-Level Bugs.
Missing and Out-of-Date Requirements.
Huge Gaps between the System and User Expectations.
Wolves in Sheep's Clothing.
2. Why XP Teams Need Testers.
Definition of Tester.
The Tester's Contribution, Illustrated.
Shun the Dark Side.
3. How XP Teams Benefit from Having Testers.
Checks and Balances.
Acceptance Tests versus Unit Tests.
Navigating for XP Projects.
4. XP Testing Values.
5. Overview of the XP Tester Role.
XP Tester's Bill of Rights.
XP Tester Activities.
6. Quality and XP.
Setting Quality Criteria.
Who Is Responsible for Quality?
II. TEST DRIVE THROUGH AN XP PROJECT.
7. User Stories and Release Planning.
The Tester's Role in Up-Front Activities.
Goals of Up-Front Tester Activities.
8. Identifying Hidden Assumptions.
A Process for Finding Hidden Assumptions.
Introducing the XTrack Application.
9. Defining High-Level Acceptance Tests.
Basic Acceptance Test Definitions.
10. High-Level Acceptance Test Estimates.
Ways to Estimate Acceptance-Test Effort.
A More Detailed Estimating Method.
11. Enabling Accurate Estimates during Release Planning.
Why We Care about Estimates.
How You Can Improve Estimate Accuracy.
12. Planning the First Iteration.
Overview of Iteration Planning.
The Tester's Role in Iteration Planning.
Thinking of All the Tasks.
13. Defining and Estimating Testing and Test Infrastructure Tasks.
Identifying and Estimating Test Infrastructure Tasks.
Identifying and Estimating Functional and Acceptance Testing Tasks.
A Note on Separate Test Teams.
Test Infrastructure Tasks.
Acceptance Testing Tasks.
14. Acceptance Tests and Quality.
Acceptance Test Details.
Internal and External Quality.
15. Nailing Down the Details.
Picking the Customer's Brain (and the Programmers'!).
The Good, the Bad, and the Ugly.
Lights-Out Test Design.
16. Writing Acceptance Tests.
If You Have Trouble Getting Started.
17. Organizing Acceptance Tests.
Version Control of Acceptance Tests.
Executable Test Files.
Organizing Acceptance Tests in Spreadsheets.
18. Test Design and Refactoring.
Establishing the Initial System State.
Tests That Leave the System State Unchanged.
Coupling between Tests.
Exercise 12 130
19. Manual Tests.
Manual Tests Are Unreliable.
Manual Tests Undermine the XP Testing Practice.
Manual Tests Are Divisive.
The Wings-Fall-Off Button.
What If You Have Manual Tests?
21. Test Automation.
22. Making Executable Tests Run.
Linking the Executable Test to an Application Test Class.
Defining the Application Test Class.
Calling the Code to be Tested.
Running the Test.
Getting Additional Tests to Run.
Combining Multiple Tests into Test Suites.
Exercise 16 156
23. Running Executable Tests through Other Interfaces.
Code Missed by Direct Calls.
Expanding Coverage of the Executable Tests.
Interfacing to a Test Tool.
Creating an Application Test-Interface Class.
Refactoring the Direct-Call Interface.
Refactoring the Application Test Class.
Creating a Tool-Specific Interface Class.
One Team's Experience with Direct-Call Test Automation.
24. Driving the System with a Test Tool.
Main WebART Script.
25. Bugs on the Windshield: Running Acceptance Tests.
How Often Do You Run Acceptance Tests?
Educating the Customer.
Road Food for Thought.
26. Looking Back for the Future.
27. Keep On Truckin': Completing the XP Road Trip.
When XP Projects End.
III. ROAD HAZARD SURVIVAL KIT.
28. Challenges in “Testability” .
Designing for Testability.
A Real-Life Example.
29. Selecting and Implementing Tools.
Other Tools Related to Quality.
Choosing an Off-the-Shelf Tool.
Experimenting with Tools.
30. Project Tune-Ups.
Accessorizing for XP.
Other Obvious Best Practices.
Additional Tester Duties.
31. Introducing XP to Your Organization: A Tester's Point of View.
Test Phases and Practices.
Introducing People to the XP Tester Role.
Helping XP Testers Succeed.
XP Testing with Blended Practices.
What If You Don't Have Enough Testers?
32. XP for Projects of Unusual Size.
Advance Planning Pays Off.
Working with Customers.
Satisfying Customer Test Documentation Requirements.
Iteration Planning and Execution for Large or Multilocation Projects.
33. Extreme Testing without Extreme Programming.
Planning and Defining Tests.
Let Worry Be Your Guide.
34. In Closing: May the Road Rise Up to Meet You.
Answers to Exercises.