Interpreting the hbacert test results

The hbacert test record test results in a data file called journal that is placed in a unique directory each time you run the test. A tool, rpt, is included that allows you to examine the test results.

Using rpt to examine certification test results

The easiest way to use rpt is to log in using the login name you specified when you installed the hbacert package (by default, the login is hbacert). Under this login's HOME directory, you'll find the rpt command in the directory testsuites/common/bin; the hbacert login's PATH variable includes the $HOME/testsuites/common/bin directory.

When one of the hbacert tests is run, the test output is recorded in a results/ directory, and the output of each run is placed in a separate directory.

For example, if you installed using the default login name of hbacert, the results for the first run of the cdrom test would be found in the file:

/home/hbacert/testsuites/cdrom/results/0001e/journal.

The simplest way to use the rpt command is to specify the -a option and a test directory name, as in this example:

   rpt -a cdrom | pg

This displays an ASCII format report from the journal file under the results subdirectory with the highest number (which, presumably, holds results for the most recent run of the test).

For example, if you run the cdrom test 4 times, and then execute the rpt command above, it would use the pathname /home/hbacert/testsuites/cdrom/results/0004e/journal as the data file for the report.

The full synopsis for the rpt command is:

   rpt [-a testsuite] [-f pathname] [-dpst]

With no options, rpt looks under the current working directory for a results directory.

The -a option lets you specify one of the test directory names (cdrom, fdd, hd, mtest, pdiext, precert, or tape), and then looks for a file named:

$HOME/testsuites/test_name/results/run_dir/journal

where test_name is the test name you specified with -a, and run_dir is the highest numbered (presumably latest) directory found under the results directory.

The -f option lets you specify a full or relative pathname to a specific journal file. For example, if your current directory is the hbacert HOME directory, the following command will display results for the fourth run of the cdrom test:

   rpt -f cdrom/results/0004e/journal

Note that if you specify -a together with -f, then -a is ignored.

The -p option tells rpt to report only on tests that failed. In this context, failed means that the test did not return one of the PASS, NOTINUSE, UNSUPPORTED or UNTESTED result codes (see ``Possible certification test results'').

Possible certification test results

The hbacert tests can return the following results:

PASS

The test case has passed.

NOTINUSE

This test is currently not in use.

UNSUPPORTED

The device does not support this test.

UNTESTED

The assertion is not evaluated.

FAIL

The test case has failed.

NORESULT

No result code was specified.

UNINITIATED

The test was marked as cancelled because it could not be started. This can happen, for example, if the device is not found or has timed out.

UNRESOLVED

An event occurred that interrupted the test.

The details of the machine configuration should be recorded (using the SysInfo.sh tool) along with the test results, as mentioned under ``Overview description of the checklist''.