Changes between Version 2 and Version 3 of TestEnvRequirements


Ignore:
Timestamp:
Sep 6, 2011, 8:12:25 PM (6 years ago)
Author:
marcin
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • TestEnvRequirements

    v2 v3  
    1010== Test Tools Requirements ==
    1111- MUST be implementation agnostic. For DNS, it must be able to test both BIND9 and BIND10. For DHCP the same is true for ISC DHCP4 and BIND10 DHCP (Kea). Although we don't need it now, it would be useful if we also could test other implementation. See Competitive comparison.
     12- MUST produce deterministic and consistent results.
     13- MUST produce consistent and readable log
     14- MUST be versioned/labelled
     15- MUST have test cases documented
     16- SHALL have test documentation generator built-in
     17
    1218
    1319== Test Execution Environment Requirements ==
     
    1925- MUST be able to recover from infinite loop. There should be a possibility to specify a timeout for each test.
    2026- SHOULD be able to recover from crash.
     27- MUST be able to execute tests in parallel
     28- MUST be scalable
     29- MUST not influence test result