CARVIEW |
Beautiful Testing
Leading Professionals Reveal How They Improve Software
- Edited By
- Tim Riley, Adam Goucher
- Publisher:
- O'Reilly Media
- Released:
- October 2009
- Pages:
- 352
Successful software depends as much on scrupulous testing as it does on solid architecture or elegant code. Beautiful Testing offers 23 essays from 27 leading testers and developers that illustrate the qualities and techniques that make testing an art. Through personal anecdotes, you'll learn how each of these professionals developed ideas of beauty in testing a wide range of products -- valuable knowledge that you can apply to your own projects.
Successful software depends as much on scrupulous testing as it does on solid architecture or elegant code. But testing is not a routine process, it's a constant exploration of methods and an evolution of good ideas.
Beautiful Testing offers 23 essays from 27 leading testers and developers that illustrate the qualities and techniques that make testing an art. Through personal anecdotes, you'll learn how each of these professionals developed beautiful ways of testing a wide range of products -- valuable knowledge that you can apply to your own projects.
Here's a sample of what you'll find inside:
- Microsoft's Alan Page knows a lot about large-scale test automation, and shares some of his secrets on how to make it beautiful
- Scott Barber explains why performance testing needs to be a collaborative process, rather than simply an exercise in measuring speed
- Karen Johnson describes how her professional experience intersected her personal life while testing medical software
- Rex Black reveals how satisfying stakeholders for 25 years is a beautiful thing
- Mathematician John D. Cook applies a classic definition of beauty, based on complexity and unity, to testing random number generators
All author royalties will be donated to the Nothing But Nets campaign to save lives by preventing malaria, a disease that kills millions of children in Africa each year.
This book includes contributions from:
- Adam Goucher
- Linda Wilkinson
- Rex Black
- Martin Schröder
- Clint Talbert
- Scott Barber
- Kamran Khan
- Emily Chen
- Brian Nitz
- Remko Tronçon
- Alan Page
- Neal Norwitz
- Michelle Levesque
- Jeffrey Yasskin
- John D. Cook
- Murali Nandigama
- Karen N. Johnson
- Chris McMahon
- Jennitta Andrea
- Lisa Crispin
- Matt Heusser
- Andreas Zeller
- David Schuler
- Tomasz Kojm
- Adam Christian
- Tim Riley
- Isaac Clerencia
-
Beautiful Testers
-
Chapter 1 Was It Good for You?
-
Chapter 2 Beautiful Testing Satisfies Stakeholders
- For Whom Do We Test?
- What Satisfies?
- What Beauty Is External?
- What Beauty Is Internal?
- Conclusions
-
Chapter 3 Building Open Source QA Communities
- Communication
- Volunteers
- Coordination
- Events
- Conclusions
-
Chapter 4 Collaboration Is the Cornerstone of Beautiful Performance Testing
- Setting the Stage
- 100%?!? Fail
- The Memory Leak That Wasn’t
- Can’t Handle the Load? Change the UI
- It Can’t Be the Network
- Wrap-Up
-
-
Beautiful Process
-
Chapter 5 Just Peachy: Making Office Software More Reliable with Fuzz Testing
- User Expectations
- What Is Fuzzing?
- Why Fuzz Test?
- Fuzz Testing
- Future Considerations
-
Chapter 6 Bug Management and Test Case Effectiveness
- Bug Management
- The First Step in Managing a Defect Is Defining It
- Test Case Effectiveness
- Case Study of the OpenSolaris Desktop Team
- Conclusions
- Acknowledgments
- References
-
Chapter 7 Beautiful XMPP Testing
- Introduction
- XMPP 101
- Testing XMPP Protocols
- Unit Testing Simple Request-Response Protocols
- Unit Testing Multistage Protocols
- Testing Session Initialization
- Automated Interoperability Testing
- Diamond in the Rough: Testing XML Validity
- Conclusions
- References
-
Chapter 8 Beautiful Large-Scale Test Automation
- Before We Start
- What Is Large-Scale Test Automation?
- The First Steps
- Automated Tests and Test Case Management
- The Automated Test Lab
- Test Distribution
- Failure Analysis
- Reporting
- Putting It All Together
-
Chapter 9 Beautiful Is Better Than Ugly
- The Value of Stability
- Ensuring Correctness
- Conclusions
-
Chapter 10 Testing a Random Number Generator
- What Makes Random Number Generators Subtle to Test?
- Uniform Random Number Generators
- Nonuniform Random Number Generators
- A Progression of Tests
- Conclusions
-
Chapter 11 Change-Centric Testing
- How to Set Up the Document-Driven, Change-Centric Testing Framework?
- Change-Centric Testing for Complex Code Development Models
- What Have We Learned So Far?
- Conclusions
-
Chapter 12 Software in Use
- A Connection to My Work
- From the Inside
- Adding Different Perspectives
- Exploratory, Ad-Hoc, and Scripted Testing
- Multiuser Testing
- The Science Lab
- Simulating Real Use
- Testing in the Regulated World
- At the End
-
Chapter 13 Software Development Is a Creative Process
- Agile Development As Performance
- Practice, Rehearse, Perform
- Evaluating the Ineffable
- Two Critical Tools
- Software Testing Movements
- The Beauty of Agile Testing
- QA Is Not Evil
- Beauty Is the Nature of This Work
- References
-
Chapter 14 Test-Driven Development: Driving New Standards of Beauty
- Beauty As Proportion and Balance
- Agile: A New Proportion and Balance
- Test-Driven Development
- Examples Versus Tests
- Readable Examples
- Permanent Requirement Artifacts
- Testable Designs
- Tool Support
- Team Collaboration
- Experience the Beauty of TDD
- References
-
Chapter 15 Beautiful Testing As the Cornerstone of Business Success
- The Whole-Team Approach
- Automating Tests
- Driving Development with Tests
- Delivering Value
- A Success Story
- Post Script
-
Chapter 16 Peeling the Glass Onion at Socialtext
- It’s Not Business…It’s Personal
- Tester Remains On-Stage; Enter Beauty, Stage Right
- Come Walk with Me, The Best Is Yet to Be
- Automated Testing Isn’t
- Into Socialtext
- A Balanced Breakfast Approach
- Regression and Process Improvement
- The Last Pieces of the Puzzle
- Acknowledgments
-
Chapter 17 Beautiful Testing Is Efficient Testing
- SLIME
- Scripting
- Discovering Developer Notes
- Oracles and Test Data Generation
- Mindmaps
- Efficiency Achieved
-
-
Beautiful Tools
-
Chapter 18 Seeding Bugs to Find Bugs: Beautiful Mutation Testing
- Assessing Test Suite Quality
- Watching the Watchmen
- An AspectJ Example
- Equivalent Mutants
- Focusing on Impact
- The Javalanche Framework
- Odds and Ends
- Acknowledgments
- References
-
Chapter 19 Reference Testing As Beautiful Testing
- Reference Test Structure
- Reference Test Extensibility
- Building Community
-
Chapter 20 Clam Anti-Virus: Testing Open Source with Open Tools
- The Clam Anti-Virus Project
- Testing Methods
- Summary
- Credits
-
Chapter 21 Web Application Testing with Windmill
- Introduction
- Overview
- Writing Tests
- The Project
- Comparison
- Conclusions
- References
-
Chapter 22 Testing One Million Web Pages
- In the Beginning…
- The Tools Merge and Evolve
- The Nitty-Gritty
- Summary
- Acknowledgments
-
Chapter 23 Testing Network Services in Multimachine Scenarios
- The Need for an Advanced Testing Tool in eBox
- Development of ANSTE to Improve the eBox QA Process
- How eBox Uses ANSTE
- How Other Projects Can Benefit from ANSTE
-
-
Appendix Contributors
-
Colophon

- Title:
- Beautiful Testing
- Edited By:
- Tim Riley, Adam Goucher
- Publisher:
- O'Reilly Media
- Formats:
-
- Ebook
- Safari Books Online
- Print Release:
- October 2009
- Ebook Release:
- October 2009
- Pages:
- 352
- Print ISBN:
- 978-0-596-15981-8
- | ISBN 10:
- 0-596-15981-1
- Ebook ISBN:
- 978-0-596-80810-5
- | ISBN 10:
- 0-596-80810-0
The cover image is from Getty Images. The cover fonts are Akzidenz Grotesk and Orator. The text font is Adobe's Meridien; the heading font is ITC Bailey.
![]() ©2010, O'Reilly Media, Inc. (707) 827-7000 / (800) 998-9938 All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. |
About O'Reilly
Academic Solutions Authors Contacts Customer Service Jobs Newsletters O'Reilly Labs Press Room Privacy Policy RSS Feeds Terms of Service User Groups Writing for O'Reilly |
Content Archive Business Technology Computer Technology Microsoft Mobile Network Operating System Digital Photography Programming Software Web Web Design |
More O'Reilly Sites
O'Reilly Radar Ignite Tools of Change for Publishing Digital Media Inside iPhone makezine.com craftzine.com hackszine.com perl.com xml.com Partner Sites InsideRIA java.net O'Reilly Insights on Forbes.com |