ESA PSS-05-10 Issue 1 Revision 1
       March 1995
       Guide to
       software
       verification
       and
       validation
       Prepared by:
       ESA Board for Software
       Standardisation and Control
       (BSSC)
       Approved by:
       The Inspector General, ESA
       european space agency / agence spatiale européenne
       8-10, rue Mario-Nikis, 75738 PARIS CEDEX, France
             ii                                  ESA PSS-05-10 Issue 1 Revision 1 (March 1995)
                                                                  DOCUMENT STATUS SHEET
                                    DOCUMENT STATUS SHEET
               DOCUMENT STATUS SHEET
               1. DOCUMENT TITLE: ESA PSS-05-10 Guide to Software Verification and Validation
               2. ISSUE      3. REVISION   4. DATE      5. REASON FOR CHANGE
               1             0             1994         First issue
               1             1             1995         Minor updates for publication
             Issue 1 Revision 1 approved, May 1995
             Board for Software Standardisation and Control
             M. Jones and U. Mortensen, co-chairmen
             Issue 1 approved by:
             The Inspector General, ESA
             Published by ESA Publications Division,
             ESTEC, Noordwijk, The Netherlands.
             Printed in the Netherlands.
             ESA Price code: E2
             ISSN 0379-4059
             Copyright © 1994 by European Space Agency
              ESA PSS-05-10 Issue 1 Revision 1 (March 1995)                                   iii
              TABLE OF CONTENTS
                                         TABLE OF CONTENTS
              CHAPTER 1 INTRODUCTION................................................................................ 1
                1.1  PURPOSE...............................................................................................................1
                1.2  OVERVIEW..............................................................................................................1
                1.3  IEEE STANDARDS USED FOR THIS GUIDE.........................................................2
              CHAPTER 2 SOFTWARE VERIFICATION AND VALIDATION..............................3
                2.1  INTRODUCTION.....................................................................................................3
                2.2 PRINCIPLES OF SOFTWARE VERIFICATION AND VALIDATION.........................4
                2.3  REVIEWS.................................................................................................................6
                  2.3.1 Technical reviews..............................................................................................7
                      2.3.1.1 Objectives...............................................................................................8
                      2.3.1.2 Organisation...........................................................................................8
                      2.3.1.3 Input........................................................................................................9
                      2.3.1.4 Activities..................................................................................................9
                          2.3.1.4.1 Preparation................................................................................ 10
                          2.3.1.4.2 Review meeting......................................................................... 11
                      2.3.1.5 Output.................................................................................................. 12
                  2.3.2  Walkthroughs................................................................................................ 12
                      2.3.2.1 Objectives............................................................................................ 13
                      2.3.2.2 Organisation........................................................................................ 13
                      2.3.2.3 Input..................................................................................................... 14
                      2.3.2.4 Activities............................................................................................... 14
                          2.3.2.4.1 Preparation................................................................................ 14
                          2.3.2.4.2 Review meeting......................................................................... 14
                      2.3.2.5 Output.................................................................................................. 15
                  2.3.3 Audits............................................................................................................. 15
                      2.3.3.1 Objectives............................................................................................ 16
                      2.3.3.2 Organisation........................................................................................ 16
                      2.3.3.3  Input.................................................................................................... 16
                      2.3.3.4 Activities............................................................................................... 17
                      2.3.3.5 Output.................................................................................................. 17
                2.4 TRACING.............................................................................................................. 18
                2.5 FORMAL PROOF.................................................................................................. 19
                2.6 TESTING............................................................................................................... 19
                  2.6.1 Unit tests........................................................................................................ 22
                      2.6.1.1 Unit test planning ................................................................................ 22
                      2.6.1.2 Unit test design ................................................................................... 23
                          2.6.1.2.1 White-box unit tests .................................................................. 25
                          2.6.1.2.2 Black-box unit tests................................................................... 26
                          2.6.1.2.3 Performance tests..................................................................... 28
       iv                ESA PSS-05-10 Issue 1 Revision 1 (March 1995)
                                    TABLE OF CONTENTS
           2.6.1.3 Unit test case definition....................................................................... 28
           2.6.1.4 Unit test procedure definition.............................................................. 28
           2.6.1.5 Unit test reporting................................................................................ 29
         2.6.2 Integration tests............................................................................................. 29
           2.6.2.1 Integration test planning ..................................................................... 29
           2.6.2.2 Integration test design ........................................................................ 30
             2.6.2.2.1 White-box integration tests....................................................... 31
             2.6.2.2.2 Black-box integration tests....................................................... 32
             2.6.2.2.3 Performance tests..................................................................... 32
           2.6.2.3 Integration test case definition............................................................ 32
           2.6.2.4 Integration test procedure definition................................................... 32
           2.6.2.5 Integration test reporting..................................................................... 33
         2.6.3 System tests.................................................................................................. 33
           2.6.3.1 System test planning........................................................................... 33
           2.6.3.2 System test design.............................................................................. 33
             2.6.3.2.1 Function tests............................................................................ 34
             2.6.3.2.2 Performance tests..................................................................... 34
             2.6.3.2.3 Interface tests............................................................................ 35
             2.6.3.2.4 Operations tests........................................................................ 35
             2.6.3.2.5 Resource tests.......................................................................... 36
             2.6.3.2.6 Security tests............................................................................. 36
             2.6.3.2.7 Portability tests.......................................................................... 37
             2.6.3.2.8 Reliability tests........................................................................... 37
             2.6.3.2.9 Maintainability tests .................................................................. 37
             2.6.3.2.10 Safety tests.............................................................................. 38
             2.6.3.2.11 Miscellaneous tests................................................................ 38
             2.6.3.2.12 Regression tests..................................................................... 38
             2.6.3.2.13 Stress tests.............................................................................. 39
           2.6.3.3 System test case definition................................................................. 39
           2.6.3.4 System test procedure definition........................................................ 39
           2.6.3.5 System test reporting.......................................................................... 40
         2.6.4 Acceptance tests........................................................................................... 40
           2.6.4.1 Acceptance test planning................................................................... 40
           2.6.4.2 Acceptance test design...................................................................... 40
             2.6.4.2.1 Capability tests.......................................................................... 41
             2.6.4.2.2 Constraint tests......................................................................... 41
           2.6.4.3 Acceptance test case specification.................................................... 41
           2.6.4.4 Acceptance test procedure specification........................................... 42
           2.6.4.5 Acceptance test reporting................................................................... 42