Tejas Software Consulting Newsletter

v1 #7, September 2001

As usual, those of you reading the plain text version can find the html version under http://tejasconsulting.com/#news, which is also where you'll find a form to join or sign off from the mailing list.
 

Contents

• Tejas Newswire - News bits on the recent past and future events
• Resource Pointer - Mailing lists for testers
• Feature Article - Book review - The Art of Software Testing

 

Tejas Newswire

My "Scripts on My Tool Belt" slides from the Fall 2001 Software Test Automation Conference are now available (PowerPoint format). I'm working on cooking something up for the next Software Test Automation Conference in March 2002.

I'd like to announce that the American Society for Quality has updated me to senior member grade. I feel that it's important to have an understanding of traditional quality control mechanisms when managing software quality.
 

Resource Pointer
Mailing lists for testers

I have maintained the swtest-discuss mailing list for the past six years. It now has more than 600 subscribers from around the world who like to discuss the finer points of software testing.

software-testing is a moderated list focusing on context-driven software testing.

test-patterns is used primarily for organizing events for workshopping software test patterns.

tester-career-support is used to bring testers and employers together, and also is a forum for testers to share job hunting tips.

You'll find several other mailing lists of interest to testers listed in the SRM Hotlist.
 

Feature Article
Book review - The Art of Software Testing

• The Art of Software Testing is not the oldest book on software testing. That award goes to Program Test Methods, edited by William Hetzel and published in 1973. It contains the proceedings of the Computer Program Test Methods Symposium of 1972.
• Long rumored to have moved into compiler development after leaving the software testing field, Glenford Myers is now CEO of Radisys Corporation. A recent interview is at ceocfointerviews.com.

Published in 1979, this book is generally recognized as a seminal work on software testing. The first three pages describe the famous “triangle problem”—an assessment of basic test design skills that still is probably the most likely interview question to be posed to software test job candidates. The book covers the state of the art in black box test design for its time, including equivalence partitioning, boundary analysis, cause-effect graphing, and error guessing. It covers white box test design based on code coverage measures. There’s a chapter on code review that includes error checklists, most of which can be modified for use with modern  programming languages.

There is a chapter on module testing that discusses the ins and outs of stubs and drivers, along with a comparison of two different approaches to testing the parts of a software product. The chapter on higher order testing includes a nice list of system-level testing tasks. These tasks are  illustrated on what is basically a V-model chart, except that it’s shaped like a rectangle. The chapter on tools and techniques comes across as a walk on the frontier, with mostly academic references and few commercialized tools.

The author has written several other books about software reliability, architecture, and design, all now out of print. But this book remains his most significant and lasting legacy to the software testing field. It’s a shame that he has moved his attention to other interests.

This classic book on software testing is a thin volume that has aged fairly well. It has value now in an age where testing still requires artistry. The book introduced a number of concepts that helped to form the foundation of the state of the practice today. The most significant principle from Myers is that “Testing is the process of executing a program with the intent of finding errors.” If you do testing primarily to prove that a program is working, then you have some reading to catch up on. In the test-case design chapter, we find the timeless suggestion to start with black box methods, and then supplement those tests using a white box approach. It is interesting to note the seeds of other concepts that have grown up since the book was written.

One anachronism in the book is the chapter on debugging. I got a feeling of guilty pleasure reading this chapter. Guilty, because including information on debugging in a testing book is a reflection of the notion in the1950s that testing and debugging are synonymous (Myers does include a semi-apology). Pleasure, because I think that debugging and test failure analysis share many skills in common. There are a number of other minor anachronisms in the book that aren’t a problem if the reader knows enough  about legacy systems to be able to put them into context. One other interesting thing to note is that the book does not recognize the role of the independent software tester, so there’s no help for determining the division of testing tasks between developers and testers.

I would not recommend this as a first book to learn about software testing, even though many organizations need to catch up on what Myers already knew in the late 1970s. There have been a number of innovations in the past 20+ years that should not be ignored. I would recommend the book for serious students of the testing field who want to put modern practices into perspective. Note that the list price is at the top of the usual range for technical books.

Originally published in the StickyMinds.com Books Guide.