QA/QC procedure

Outline procedure for performing QA/QC checks on scripts. A full test is a pain because of the number of possible configurations that are supported.

At least one pass should be performed for each OS that is in use by a customer. Test system should have all applicable OS updates installed.

Some tests need to be repeated with difference hardware or software combinations. These will be noted in the sections below.

Test procedure

Prep

Start point is a server configured to support a minimum of two sessions, with the previous version of the scripts. And a basic working roadrunner data set with a single company "A".

Record and verify configuration

As the administrative user (root) run RTadmin.

RT_HaveBosMenu=True REVEAL=True RT_QC=True RTadmin

Go to the System Menu and run option 8 to show the configuration. Check that it a fare representation of the configuration you want to test. Record it, and add to your QA/QC documentation for the test.

Run system check menu and check for any obvious configuration issue.

BOS menu make sure OS is as up to date as it can be.

Linux only BOS menu Analyse system. check that the files written to ~/SystemInformation match your system configuration.

Update to new scripts.

See upgrade section of main page.

Login as the Roadtech admin user and run RTadmin. Select Road Tech Utilities, Roadrunner Administration, Road Tech updates menu.

Default Print Queue := NoPrinters

RMcobol Ver 12.11 Serial 6E-1000-78534-0010
Data Set := "Base data set"     {/usr/share/roadtech/Roadrunner}

                ----- ----- ----- -----
                        Road Tech Update Menu
                ----- ----- ----- -----
        1  Make previous Cobol program updates permanent.
                ----- ----- ----- -----
        2  Update from DOS Diskette.
        3  Update from ISO CD-ROM.
        4  Load update tape. {CPIO}
        5  Load update from tar file
                ----- ----- ----- -----
        6  Create ISO image containing Roadtech scripts and Roadrunner programs. 
        7  Create tar file containing Roadtech scripts and Roadrunner programs. 
        8  Create Install tape containing Roadtech scripts and Roadrunner programs. 
        9  Create tar file containing Roadtech script update. 
                ----- ----- ----- -----
        N  Save nominal structure files to diskette.
        P  Backup /usr/share/roadtech/Roadrunner/cobs to tape CPIO. 
                ----- ----- ----- -----
        M  Main menu.
                ----- ----- ----- -----


        [ ]

Select the update method you are using for this run, and update the system. Record this method as tested on this OS. Code for Linux and AIX differs, but is consistent across releases of the OS.

Verify system after update.

This is the same as for the prep stage above. Results may be different, where new scripts make additional checks.

As the administrative user root

Invoke 2 copies of RTadmin, one with

RT_HaveBosMenu=True REVEAL=True RTadmin

and one as a normal customer would.

RTadmin

Use the two copes in parallel. The first will show which options could be available for the installed scripts. The second the options available based on the hardware and software found, along with any configuration options from rt.var.

Verify options on menu RTadmin/SYSTEM utilities

Around 60 options, grouped across 8 sub menus.

09/11/2016-exp  Linux Ver CentOS rel 7.2.1511 kernel 3.10.0-327.36.1.el7.x86_64
Default Print Queue := NoPrinters

        ----- ----- ----- ----- ----- ----- -----
        1  Base Operating System menu.
        2  Admin reports.
        3  User Account Menu.
        4  .

        5  Maintenance reports menu.
        6  Maintenance utilities menu.
        7  Performance evaluation menu.
        8  Show configuration.
        9  System check menu.
        .  Network menu.
        ----- ----- ----- ----- ----- ----- -----
        M  Main menu.
        ----- ----- ----- ----- ----- ----- -----
                [ ]

Many of the options use the same code across all platforms, some do not.

reporting menus

These differ substantially between AIX and Linux, but not between different release of the OS.

BOS menu

Differs substantially between different releases of AIX and Linux. It is not available for all releases. Run test of sub menu on each OS to be supported.

User account menu

Major differences between AIX and Linux, minor differences between RHEL 5.x, 6.x, and 7.x. Test requiered on at lease one of the supported AIX platforms, plus at leased one system for each release of RHEL (CentOS).

Removable media

Options that support removable media differ for none, one, and more than one device of a class being present. Testing must cover all 3 cases for each OS.

Archive creation

Options for creating archive files differ according to the program selected, and the version of that program.

Verify options on menu RTadmin/Relativity Menu

09/11/2016-exp  Linux Ver CentOS rel 7.2.1511 kernel 3.10.0-327.36.1.el7.x86_64
Default Print Queue := NoPrinters

Version  installed 
        ----- ----- ----- ----- ----- ----- -----
        Relativity Menu                          
        ----- ----- ----- ----- ----- ----- -----
        1  Stop Relativity Server.
        2  Start Relativity Server.
        3  Restart Relativity server.
        4  Connection Log Report.
        5  Relativity Information.
        6  .
        7  .
        9  .
        .  .
        ----- ----- ----- ----- ----- ----- -----
        E  Exit menu.
        ----- ----- ----- ----- ----- ----- -----
                [ ]

Verify options on RoadTech menu

Verify options on USER menu

RT_HaveBosMenu=True REVEAL=True RTadmin
RT_HaveBosMenu=True REVEAL=True RTadmin