LSB Distribution Checker Getting Started

From ISP_RAS
Jump to: navigation, search

This document describes the general steps on getting started with the LSB Distribution Checker.

Contents

Installation

  1. Download the LSB Distribution Checker package (tar.gz) for your architecture from the About Distribution Checker page.
  2. Unpack the package:
     tar xzf lsb-dist-checker-<version>.<architecture>.tar.gz 
  3. Go to the subdirectory ./lsb-dist-checker created when unpacking, run the installation script:
     ./install.pl 
    and follow the instructions. You may need to enter the root password.
  4. Run the Distribution Checker:
    • To run LSB Distribution Checker type:
       /opt/lsb/test/manager/bin/dist-checker-start.pl [port-number] 
      The port-number argument is optional (by default 8888 is taken). This script will start a simple web server embedded in the Distribution Checker and will try to locate and open your web-browser with the proper address to this server.
    • Note: If the script could not find your web-browser and you wish to use Web-UI, please start the browser manually and specify the address http://localhost:8888/ (the port number should be the same as specified on the previous step).
    • Note: You may also connect to the Distribution Checker from any remote computer by specifying the URL http://<test-machine-name>:8888/ in your web-browser.

Using Web-UI

  1. In the browser you will see the main page of the LSB Distribution Checker. It allows you to choose whether to perform certification tests or custom set of tests.
  2. Depending on your choice either Get Certified or Custom Tests page will be opened.
    • On the Get Certified page you can see the following options:
      LSB DC Certify.png
      You should specify your name, organization and (if you wish) E-mail for sending the report. Also you may change the architecture, targeted standard and some other settings for the tests. Then just press the Run the Tests button.
    • The Custom Tests page contains the extended set of options:
      LSB DC CustomTests.png
      Specify necessary information in the edit fields, select the test suites you wish to execute (check boxes to the left), and press the Run Selected Tests button at the bottom of the page. You can also select the version of each test suite to run, customize the downloading and installing options and also fine-tune additional options for some of the test suites. See the detailed description on the Help page of the Distribution Checker.
    • Note: There are some prerequisites for the test suites to be able to run (listed in the /opt/lsb/test/manager/README file). If they are not met, an error message will be shown at the top of the page when you try to run the tests. In this case you will have to eliminate the problems and run the tests again.
  3. You will be redirected to the next page — Execution:
    LSB DC Execution.png
    On this page, you will see the general status of the execution and the terminal emulation that shows on-the-fly output of the tests. Also the table with individual test suite progress is displayed.
  4. After the automated tests are finished you are redirected to the Summary Report page. It contains just the general information about the status of the automatic and manual tests:
    LSB DC SummaryReport.png
    If the manual tests need to be performed, a link is provided to the Manual Tests page. Depending on the tests selected and their status some additional information is shown on this page: what to do with failing tests, how to apply for certification, where to find the journal files and how to return back to this page after closing it. Also you can open the detailed report by clicking the corresponding link.
    For a certification test run this page contains the Apply for certification link which redirects you to the LSB Certification System where you will be able to use the test results for certifying your distribution.
    For custom test run you will see the Upload the test results link instead. You cannot start certification with these results, but you can use them as additional data for the product already being certified.
  5. The Detailed Report page contains the exhaustive information about every test suite. Any tests you have failed that have already been waived will be marked as such in the report.
    LSB DC DetailedReport.png
  6. On the Manual Tests page you can perform the tests which cannot be automated.
    LSB DC ManualTests.png
    You need to go through each of the tests shown in the left table (that is for each test the result should become either Passed or Failed). Then just press the Finish button and you will be redirected to the updated Summary Report page with new status of the manual test.
    Note: You do not need to perform all the manual tests at once. You can go through just some of them (or even none), close the browser and return to these tests later. The link for continuing the manual tests can be found on the Results page (see below).
  7. The list of all the reports generated for every test run is shown on the Results page:
    LSB DC Results.png
    To view any particular summary report, just click the corresponding link in the Date/Time column. Additional icons in the right bottom corner allow you to quickly open the Summary Report page, Detailed Report page or, if you have not yet finished with the manual tests, to continue with them. To remove some of the reports, just select them with the check boxes and press the Remove Selected Entries button.

Using Command Line UI

Instead of using the web-based interface, you may use the command-line interface provided by the Distribution Checker.

  1. Go to the directory /opt/lsb/test/manager/utils.
    • To refresh the locally stored list of tests, run the following command:
       # ./dist-checker.pl --update 
      You should be connected to the Internet to update data from server.
    • To see all supported standards, architectures and tests run
       # ./dist-checker.pl --list | head -7 
    • To run certification tests for LSB 4.0, execute the command (with root privileges):
       # ./dist-checker.pl -D --cert -s 'LSB 4.0' 
    • To run all tests, execute the command (with root privileges):
       # ./dist_checker.pl -D -s 'LSB 4.0' all 
    • To run the custom set of tests, execute the command:
       # ./dist_checker.pl -D -s 'LSB 4.0' test1 test2 ... 
      test1, test2 etc. are the specific test suites you wish to run. To obtain the list of supported test suites, use the --list option.
  2. Description of Used Options:
    • -D: Automatically download the test packages needed.
    • -s <standard>: Specify the standard to test against (e.g. -s LSB4.0). The space between standard name and version number may be omited. If not specified then the standard is detected automatically.
  3. In addition, the following options may be useful:
    • -p <profile>: Allows to specify the LSB profile to test against. Possible values are: core,c++ and core,c++,desktop (default).
    • -v[0-2]: Specify verbose mode.
    • --comment text: Any comments for the test run.
  4. You can use the Command Line UI for nightly test runs. There is a detailed instruction on this topic.
  5. Distribution Checker can operate through an FTP proxy using the curl utility instead of wget. See the Command Line Options list for details. Note that HTTP-FTP proxies (ex. squid) are not supported.
  6. Please, see
     ./dist-checker.pl --help 
    for the full list of the options available in the current version.

Test Results Repository

The results for test runs are stored in the directory /var/opt/lsb/test/manager/results. All the files from each test run are stored in separate subdirectory named <arch>-<machine>-<date>-<time>. For the result to be visible on the Results page of the Web-UI it should be listed in the file /var/opt/lsb/test/manager/results/HISTORY.

If you are using Web-UI or Command Line UI for running the tests, the HISTORY file is managed automatically. If you copy the test results from another machine or another directory by hand, you will need to write the directory names into this file manually.

Finalizing

  1. To stop the web-server, you may either run the script
     /opt/lsb/test/manager/bin/dist-checker-stop.pl 
    or go to the Administration page in the web-interface and press the Stop server button.
  2. If you wish to deinstall the Distribution Checker at all, use your package manager (rpm or dpkg) to remove the package lsb-dist-checker or moblin-dist-checker. After that you may also wish to delete the package cache, old results and other data from the /var/opt/lsb/test/manager directory.
Personal tools