Operating System Test Suite Architecture
This is an update on the test suite architecture for testing XSH (X/Open System Interfaces & Headers).
At the time of writing (February 1998) outline test coverage by feature and test suite is shown above.
Most of the Open Group's test suites for the operating system calls use the VSXgen framework - this test framework has been abstracted away from the testcases (termed testsets) themselves and is called VSXgen (for Generic VSX).
This permits a common look and feel to the test suites (ala VSX), the ability to run the test suites standalone, as well as to integrate them into a meta test suite.
For users familiar with the VSX4 testsuite, there is a minimal learning curve to running a testsuite based on VSXgen. The harness itself is based on the core of VSX4.3.5, and is proven with over 10 years of use in the industry.
The test suites supported as testsets under the VSXgen structure are (as of July 2000):
VSRT - Realtime (1003.1b/.1i) VSTH - Threads (1003.1c/Aspen threads) VSU5 - UNIX Extensions VSX4 - The existing VSX4 test suite (POSIX.1/XPG4 extensions) VSX5 - The Large File, Dynamic Linking and ISO MSE testsets VSRTE - Advanced Realtime (1003.1d) VSART - Additional Realtime (1003.1j) VSX-PCTS - VSX POSIX Conformance Test suite LSB-FHS - Linux Standard Base FHS test suite
VSXgen sits above the Test Environment Toolkit (TET), a generic test framework. The following diagram shows the concept of the testsets that can be plugged into VSXgen. Note that these four testsets are separate and have no dependencies between them.
The test set packages may either be run standalone as individual test suites plugged into VSXgen, or they may be merged into a meta test suite. The merged suite of VSX4, VSRT and VSTH form a single test suite covering all of POSIX 1003.1-1996.