Software Quality and Software Testing in Internet Times

(1)

Dirk Meyerhoff, Begona Laibarra,

Rob van der Pouw Kraan, Alan Wallet (Eds.)

Software Quality

and Software Testing

in Internet Times

With Contributions of

Stale Amland, Walter Bischofberger, Arnim Buch, Astrid Dehnel, Tessa Doring, Stefan Engelkamp, Thomas Fehlmann, Elmar Fichtl, Stephan Friedrich, Ulrich Hasenkamp, Dirk Huberty, Paul Keese, Dirk Kirstein, Andreas Kramp, Jens Lehmbach, Claus Lewerentz, Martin Lippert, Christoph Mecke, Michael Meyer, Trevor Price, Werner Schmitz-Thrun, Katrin Severid, Frank Simon, David Singleton, Jarle Vaga, Erik van Veenendaal, Michael Vetter, Steve Willis,

Jan-Gerold Winter, Heinz Ziillighoven

(2)

Part I: Managing for Optimal Time to Market

Jarle Vdga, Stale Amland

Managing High-Speed Web Testing

1 Project Background 23

2 "High-Speed" Methods and Preparation 24 2.1 Exploratory Testing 24 2.2 Pair Testing 25 3 "High-Speed" Test Planning 25 4 "High-Speed" Test Execution 27 5 The Web Testing Experience 28 6 Warning! 30 7 Acknowledgements 30

Steve Willis

Using QA for Risk Management in Web Projects

1 Increased Visibility of Application Failure 31 2 Risk and Management Thereof 32 2.1 Identify the Risks 33 2.2 Problem Perfect 33 2.3 Quantify the Risks 34 2.4 Manage the Risks 35 2.5 Communicate the Risks 35 2.6 Monitor the Risks 35 2.7 Examples of Risks 35 2.8 Additional Factors that Impact upon Risk 36 3 QA as a Risk Management Technique 37 3.1 Simple Prioritisation of QA and Testing against Risk 37 3.2 The Role of the QA and Test Strategy 40 3.3 QA and Test Planning Against the Identified Risks 42 4 Summary 48

Andreas Kramp, Tessa Doring, Stephan Friedrich

Establishing Quality Procedures for Incremental Software Development

1 Introduction 49 2 Establishing a QM Procedure 50

(3)

VIII Table of Contents

2.1 Defining the Phases of the Development Procedure 51 2.2 Definition of Quality Management Integrated in the Process Flow 51 2.3 Co-operation with Other Project-Integrated Tasks 53 3 Experience with Integrated Quality Management 54 4 Acceptance Procedure 55 4.1 Objective and Content of the Acceptance Process 55 4.2 Integration in the Software Development Production Process 56 4.3 Sequence of the Acceptance Process 58 4.4 Inspection Criteria for Result Types 58 5 Experience Gained in Establishing the Acceptance Process 61 6 Summary 62

Part II: Processes

Michael Meyer, Astrid Dehnel, Elmar Fichtl

Designing Processes for User-oriented Quality Engineering

1 Introduction 65

2 Role, Significance and Design of Processes 66 2.1 Starting Basis 66 2.2 Roles 68 2.3 Flexible Application of the Processes in Practice 70 3 User-centred Quality Engineering: A Customer-Oriented Approach

Including Acceptability, Usability and Quality-of-Service Analysis 71 3.1 Motivation 71 3.2 Usability, Acceptability and Quality Assessment 72 3.3 Integrated Process-Accompanying Approach 73 4 Integration of User-Centred Quality Engineering and Quality Criteria for

Processes 74 4.1 Analysis 75 4.2 Integration in the Processes 77 4.3 Experiences 83 5 Summary 84

Martin Lippert, Heinz Zullighoven

Using Extreme Programming to Manage High-Risk Projects Successfully

1 Flexible Processes for High-Risk Projects 85 1.1 Risk •. 86 1.2 Extreme Programming 87 2 Steering XP Projects 88 2.1 The Planning Game 89 2.2 Small and Frequent Releases 90 2.3 Project Planning ...91 3 Experience: Facts and Numbers 94 3.1 Small Releases 95 3.2 Internal Daily Planning 97 3.3 Estimates and Forecasts 99 3.4 Lessons Learned 100 4 Summary and Perspective 100

(4)

Table of Contents IX

Dirk Huberty

Adapting the Test Process for Web Applications - Strategies from Practice

1 Introduction 101 2 Internet Architecture and Infrastructure 102 3 Quality Objectives for Internet Applications 105 4 Classical Test Levels 107 5 Testing Internet Applications 108 5.1 Differences in Documentation and Developer Testing 109 5.2 Differences in Functional Testing 109 5.3 Differences in Overall Integration Testing 110 5.4 Differences in Non-Functional Testing I l l 5.5 Publishing 112 6 Test Tools and Test Automation 112 7 Differences in Test Organisation 112 8 Summary 113

Part III: Testing from the User's Perspective Thomas Fehlmann

Business-Oriented Testing in E-Commerce

1 Software Testing and E-Commerce 117 1.1 Testing in E-Commerce 117 1.2 A Model for an E-Commerce System 118 2 Interaction Scenarios & Testing Techniques 121 2.1 Scenario Overview 121 2.2 User-Centred Testing 123 2.3 Business Process Testing 124 2.4 Web Integration Testing 125 3 Dynamic Testing According to Business Needs 126 3.1 Combinatory Metrics 127 3.2 Business Metrics 129 3.3 Test Coverage Combinators 131 3.4 Example: Hotel Reservation System 131 4 Conclusions 136 Paul Keese

Strategic Testing: Focus on the Business

1 Introduction 138

2 Business Processes and Integration Testing 139 2.1 Testing Business Processes 139 2.2 The Business Process "New Bank Account" 140 3 Structuring the Test 142 3.1 Organisation of Integration Testing 142 3.2 Description of Software to be Tested 142 3.3 Test Item Definition 143 4 From Business Process to Test Case Sequence 143 4.1 Level of Testing Intensity 143 4.2 Building a Test Case Sequence 144

(5)

XII Table of Contents

5 A Typical Software Quality Assessment... 241 5.1 The System Assessment 242 5.2 The Architecture Assessment 244 5.3 The Design Assessment 245 5.4 The Code Assessment 246 6 Summary/Outlook 247

Katrin Severid, Jan-Gerold Winter

"The Back-End Side of Web Testing": Integration of Legacy Systems

1 Introduction 250 2 The Settlement System db trader MVS 251 3 Test Environment of db trader MVS 252 4 Development of NetTrader 253 5 Challenges for the Development of New Front-Ends 254 6 Use of a Code Generator 254 7 Regression Testing 255 8 Configuration Management 256 9 Conclusion 256

Part V: Test Automation Techniques and Tools

Christoph Mecke

Automated Testing of mySAP Business Processes

1 Introduction 261 2 Methodology 262 2.1 Motivation for Testing in an SAP Environment 262 2.2 Advantages of Automatic Testing 263 2.3 Test Strategy 264 2.4 The Modular Concept 265 2.5 Robustness and Adaptations 267 3 Tools 268 3.1 The SAP Test Workbench 268 3.2 Outlook 276 4 Summary 279

Part VI: Appendix

References 283 List of Contributors 289 Copyrights 295