Adding Tests to the Main Waterfall

The main waterfall (https://chromium-build.appspot.com/) is policed by sheriffs to keep it green as possible. When adding a new test to these bots, it's important that the tests be free from flakiness and that the Try Server and CQ provide developers coverage for the test. See the design of the Chromium Commit Queue for details on how this works. Please coordinate with the Infra team and troopers while adding these tests.

Phase One - Try Server

Put the test on the chromium.fyi and tryserver.chromium master.cfgs for the platforms that make sense for the test. Watch these tests and eliminate any flakiness that arises.

Phase Two - Main Waterfall

When the test has been declared stable, it's time to land it on the main waterfall. As these parts depend on each other, try to land all the following simultaneously (with a trooper's help):
  1. Depending on which platforms your test runs on, add your test to the master.cfgs of the masters on the main waterfall (chromium.linux, chromium.mac, etc).
  2. Add your test to lkgr_finder.py and CQ's projects.py.
  3. Add your test to src/PRESUBMIT.py


Comments