the Chromium logo

The Chromium Projects

Test Lab Setup

This page will walk you through duplicating the majority of the test lab set up that Chrome OS runs internally to validate builds on real hardware.

You will need:

Setting up SSH Access to your test device.

In order to run the automated tests against your device you need to ensure it is running a Test Image and you have password-less SSH Access.

Please follow: https://www.chromium.org/chromium-os/developer-library/guides/development/developer-guide/#Set-up-SSH-connection-between-chroot-and-DUT

Setting up an Autotest Server and Web Frontend

Autotest is the software that is used to run the tests on devices and also collect the results.

Please follow to install and configure the tools:

<https://sites.google.com/a/ch romium.org/dev/chromium-os/testing/autotest-developer-faq/setup-autotest-server>

After this is complete you should have an Autotest Frontend (AFE) running on your server, please go to http://localhost to verify.

Using the Autotest Server

Now that you have set up the Autotest Server, you need to import your tests, add test hosts and launch the scheduler. Please refer to https://www.chromium.org/chromium-os/testing/autotest-developer-faq/autotest-server-usage for more information.

Note: At this point you can run tests through the Web Interface. However you lack the ability to automatically have your devices be re-imaged by the test servers. The following steps will setup a Devserver to stage test images from Google Storage so that you can do automated updates. This process is currently for Internal Google Use and our Partners. If you are a Partner, please contact your Google Representative about requesting access to our images.

Devserver Prerequisites

Our images are stored in Google Storage and first you need to setup your machine to give you access to these builds.

You will need:

If you are a Chrome OS Googler you can verify everything is setup by running `gsutil ls gs://chromeos-image-archive` if you are an external partner test with the bucket you have been supplied.

Devserver Setup

*After you have installed the above dependencies:

cd [Your Chromium OS Checkout]/src/platform/dev
./devserver.py -t --production --archive_dir /some/path/images

Explanation of options above:

After running the above command you will see some information printed out by cherrypy and you should be able to browse tohttp://server_hostname:8080. There you will see a short index of the different operations that can be carried out similar to what is summarized in the "Services Provided by Devserver" paragraph above.

Running Test Suites

Now that everything is configured please refer to the Test Suite Documentation on how to the "lab" you just set up. You will likely want to pay attention to the sections involving test_that and run_suite.py

https://www.chromium.org/chromium-os/testing/test-suites