The Open Group : Making Standards Work
About The Open Group The Open Group Forums Certification Collaboration Services
HOME   |   SITE MAP  
Sponsor an Event Become a Member of The Open Group The Open Group Member Area
Government Programs Events Bookstore & Downloads Newsroom Contact The Open Group
You are here: Home >Testing >Test Suites >VSC5 Overview
Test Suites
 
VSC5 Overview

The Commands and Utilities Test Suite


Summary

  • The most complete Commands and Utilities test suite in the industry.
  • Test Coverage: FIPS 189, ISO/IEC 9945-2:1993 (technically identical to IEEE Std POSIX® 1003.2), UNIX® 95, UNIX® 98.
  • Includes test coverage for Large File support, Year 2000 date handling and new XCU5 commands.
  • The Westwood version contains additional coverage for UNIX® 03 and IEEE Std 1003.1,2003 edition.
  • Mandatory for testing the Single UNIX® Specification Version 2 and 3.
  • Includes test scenarios for particular areas, for example the tests for LFS or just the POSIX.2 tests.
  • Available as an upgrade to VSC4 for the Single UNIX® Version 2

VSC Core Summary

VSC offers the industry's most complete test coverage for the Shell and Utilities standards (XPG4,UNIX 95, UNIX 98, UNIX 03, ISO/IEC 9945:1993, ISO/IEC 9945:2003, IEEE Std 1003.2-1992, IEEE Std 1003.1,2003 Edition), standardization of which is key to the development of portable shell applications. It remains the most complete commands test suite in the industry and contains over 10,000 tests (over 1 million lines of source code).

Its use is mandatory for the Open Brand for XPG4 Base 95, UNIX 95 , UNIX 98 and UNIX 03. VSC, has the following test modes:

  • ISO/IEC 9945-2 mode (technically identical to IEEE Std POSIX 1003.2-1992)
  • Commands and Utilities Issue 4 (XCU4) for XPG4 and UNIX 95
  • UNIX 98
  • UNIX 03 (Westwood version only)
  • POSIX 01 (Westwood version only)

For the Open Brand the test suite is run in the XPG4, UNIX 98 or UNIX 03 mode which are essentially supersets of the POSIX test modes.

VSC5 includes test coverage for Large File Summit extensions, n-bit clean, Aspen commands and year 2000 alignment.

The Westwood version includes further test coverage for UNIX 03

VSC uses the industry standard Test Environment Toolkit (TET) as its test harness.

Numbers of tests, and time to run

  • POSIX mode - over 6000 tests
  • XPG4/UNIX 98/UNIX 03 Mode - over 10,000 tests

A typical test run from start to finish takes approximately 20 hours on an Intel Pentium based system.

Test Coverage

The VSC test suite verifies the compliance of systems to the Open Group Commands & Utilities specification , a superset of the POSIX Shell & Utilities standard.

VSC features include:

  • The industry's most complete standard commands test suite.
  • Extensive automated tests for interactive commands, ensuring more rigorous testing that could be obtained by manual testing.

Test Organization

The source tree and the executable tree are organized in a hierarchical design, being divided into sections corresponding to boundaries between various standards and parts contained therein.


SIZE

The size of VSC before the suite is built is approximately 30MB.

The size of VSC after the suite is built is roughly 50MB, exclusive of journal files, on a RISC system.

TIME

When LFS tests are not run, this test suite takes from 15 to 40 hours to run on systems of current vintage. The average time is about 28 hours. The LFS tests take between 10 and 60 hours to run depending on the implementation's maximum file size, disk I/O speed and device driver implementation.


Motif, OSF/1 and UNIX are registered trademarks and X/Open, the "X Device" and The Open Group are trademarks of The Open Group.
POSIX is a registered trademark of the IEEE.


Further Information

   
 

 

 

 
   |   Legal Notices & Terms of Use   |   Privacy Statement   |   Top of Page   Return to Top of Page