aboutsummaryrefslogtreecommitdiffhomepage
path: root/infra/bots/recipe_modules/run
Commit message (Collapse)AuthorAge
* Reland "[recipes] Use named caches for git and workdirs"Gravatar Eric Boren2018-04-27
| | | | | | | | | | This reverts commit 01d3eb64e7b11b22cf206758f01b06a7ae0bbb20. Bug: skia: Change-Id: Ic05b89009eb59a231488bef382dd232a50d2b00f Reviewed-on: https://skia-review.googlesource.com/124260 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Eric Boren <borenet@google.com>
* Revert "[recipes] Use named caches for git and workdirs"Gravatar Ben Wagner2018-04-26
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This reverts commit e8615f969e92009551b70c85d1913202390e0b0d. Reason for revert: Causing CommandBuffer builds to time out Original change's description: > [recipes] Use named caches for git and workdirs > > Bug: skia: > Change-Id: Iaf3d190252c9483c8b9e58a3ab0305db4173cc1c > Reviewed-on: https://skia-review.googlesource.com/123929 > Commit-Queue: Eric Boren <borenet@google.com> > Reviewed-by: Ben Wagner <benjaminwagner@google.com> ---------------- Revert "[infra] Fix missing cache for Bookmaker" This reverts commit d19f039a16cc4ed29dc6f0ef7100125819ca291d. Reason for revert: Need to revert https://skia-review.googlesource.com/123929 Original change's description: > [infra] Fix missing cache for Bookmaker > > Bug: skia: > Change-Id: I12d42fa1bb364ea6c75865f72143daf92b8c12c3 > Reviewed-on: https://skia-review.googlesource.com/124052 > Reviewed-by: Ben Wagner <benjaminwagner@google.com> > Commit-Queue: Eric Boren <borenet@google.com> ---------------- Revert "Fix missing/duplicate named caches" This reverts commit 0820a6fb697be598b41b65c7645659e216b30bc5. Reason for revert: Need to revert https://skia-review.googlesource.com/123929 Original change's description: > Fix missing/duplicate named caches > > Fixes issue with https://skia-review.googlesource.com/c/skia/+/123929 > > No-Try: true > Change-Id: I582b2bba67b8b257f35c5b85ccfe6e6304ff7a7c > Reviewed-on: https://skia-review.googlesource.com/124180 > Commit-Queue: Ben Wagner <benjaminwagner@google.com> > Auto-Submit: Ben Wagner <benjaminwagner@google.com> > Reviewed-by: Ravi Mistry <rmistry@google.com> ---------------- TBR=borenet@google.com,benjaminwagner@google.com,rmistry@google.com Change-Id: Id8443ad9dc50f018251a6b6892b06fe256e6c578 No-Presubmit: true No-Tree-Checks: true No-Try: true Bug: skia: Reviewed-on: https://skia-review.googlesource.com/124203 Commit-Queue: Ben Wagner <benjaminwagner@google.com> Reviewed-by: Ben Wagner <benjaminwagner@google.com>
* [recipes] Use named caches for git and workdirsGravatar Eric Boren2018-04-26
| | | | | | | | Bug: skia: Change-Id: Iaf3d190252c9483c8b9e58a3ab0305db4173cc1c Reviewed-on: https://skia-review.googlesource.com/123929 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ben Wagner <benjaminwagner@google.com>
* [recipes] Add asset_version utility function.Gravatar Ben Wagner2018-03-20
| | | | | | | | Bug: skia:7720 Change-Id: I044ca5281354b21c9deffa408ad7ec20c51d2e2e Reviewed-on: https://skia-review.googlesource.com/115122 Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Ben Wagner <benjaminwagner@google.com>
* Test SKQP on Firebase Testlab and UploadGravatar Stephan Altmueller2018-03-07
| | | | | | | | | | | | | | - adds building the testlab driver (run_testlab) as a separate step - adds gcloud isolate necessary to run testlab - adds Testlab support and uploading a verified AKP to GCS (with meta data attached). Bug: skia: Change-Id: I1bf265f46c99360eb3a9eb684886f93de48085fe Reviewed-on: https://skia-review.googlesource.com/111603 Reviewed-by: Eric Boren <borenet@google.com> Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Stephan Altmueller <stephana@google.com>
* Do not copy vulkan-1.dll to Win bots.Gravatar Ben Wagner2018-02-14
| | | | | | | | | | | | | Previously, we needed vulkan-1.dll from the Vulkan runtime because some drivers did not include the Vulkan loader. Now, all drivers include this DLL and using the version from assets causes problems for newer Intel drivers. Bug: skia:7490 Change-Id: I7bd37fb0d2c88a4753f354ab2bc88761562ced2f Reviewed-on: https://skia-review.googlesource.com/107060 Reviewed-by: Greg Daniel <egdaniel@google.com> Commit-Queue: Ben Wagner <benjaminwagner@google.com>
* Store skiaserve binary in GS from Release Android compile botsGravatar Ravi Mistry2017-12-12
| | | | | | | | Bug: skia:7399 Change-Id: Id60773f77694b06a938f9a126f30ca56e4965d30 Reviewed-on: https://skia-review.googlesource.com/83981 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
* Add new Bookmaker bot that runs nightlyGravatar Ravi Mistry2017-12-08
| | | | | | | | | | | | | | | | | | | | The new bot: 1) Extracts all fiddles out of markdown files. 2) Forces fiddle.skia.org to compile all those fiddles and get output in JSON. 3) Scans the output and reports any compiletime/runtime errors. 4) Updates markdown in site/user/api/ using the new hashes (if any) from fiddle.skia.org. To ensure the bot does not check in unexpected changes: * upload_md.py makes sure that all modified files are under site/user/api/. It errors out if this is not the case. * CLs with docs only changes normally have 'NoTry: true' added to their descriptions. This is not done for the new bot because we want to run it through trybots to make sure nothing unexpected snuck in. * rmistry@ and caryclark@ are automatically CC'ed on all uploaded changes. I plan to watch the bot closely for at least a couple of weeks. Bug: skia:7310 Change-Id: I759fc8bae1e32a6f175e3b1a895947d14ca5fe3a Reviewed-on: https://skia-review.googlesource.com/79941 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
* Remove obsolete iOSShell references from infra scriptsGravatar Brian Osman2017-11-22
| | | | | | | | Bug: skia: Change-Id: I36cb94877d513fc81c211b0e58b5c4be0451ac91 Reviewed-on: https://skia-review.googlesource.com/74601 Commit-Queue: Brian Osman <brianosman@google.com> Reviewed-by: Eric Boren <borenet@google.com>
* VisualBench is not a thing anymoreGravatar Brian Osman2017-11-22
| | | | | | | | Bug: skia: Change-Id: I391cbc6cb2bf2ae88af0612964f4265788c8e771 Reviewed-on: https://skia-review.googlesource.com/74600 Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Brian Osman <brianosman@google.com>
* Switch most Win Vulkan jobs to Clang.Gravatar Ben Wagner2017-10-11
| | | | | | | | | Update examples in recipes. Change-Id: I096f259e8daa46af8626158a820fe226e99cd159 Reviewed-on: https://skia-review.googlesource.com/58200 Reviewed-by: Greg Daniel <egdaniel@google.com> Commit-Queue: Ben Wagner <benjaminwagner@google.com>
* Retry adb commands on flaky devices.Gravatar Ben Wagner2017-09-11
| | | | | | | | No-Try: true Change-Id: I3519131cf064d0a9676abd0fb9d7e946646ce27f Reviewed-on: https://skia-review.googlesource.com/43564 Reviewed-by: Kevin Lubick <kjlubick@google.com> Commit-Queue: Ben Wagner <benjaminwagner@google.com>
* [recipes] Switch to file module from recipe_engineGravatar Eric Boren2017-06-16
| | | | | | | | Bug: skia:6704 Change-Id: Id3cefa643316e5676d2038a75240e16d929d6d63 Reviewed-on: https://skia-review.googlesource.com/20146 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
* Rename example.py -> examples/full.py for all modulesGravatar Robert Iannucci2017-06-02
| | | | | | | | | | | | | `example.py` is going away; examples folder can now hold multiple example recipes. R=borenet@google.com Bug: skia: Change-Id: Ib28910987342217bc52040d4d966444174ce27a3 Reviewed-on: https://skia-review.googlesource.com/18432 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
* Roll recipe dependencies (nontrivial).Gravatar recipe-roller2017-06-01
| | | | | | | | | | | | | | | | | | | | | | | | | | | This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. depot_tools: https://crrev.com/fc1c6f4c1fac4de7647da83425f4398dde6e77ca Correct Git show's path format on Windows (manzagop@chromium.org) recipe_engine: https://crrev.com/458ce956c9d91d184e0107c5fa6b34a8267b8e9b [step_runner] run _merge_envs in simulation too. (iannucci@chromium.org) R=martiniss@chromium.org, tansell@chromium.org Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: Ic938b59f304189fdfb78a466e6a4a0e47f0548a6 Reviewed-on: https://skia-review.googlesource.com/18300 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Robbie Iannucci <iannucci@google.com> Reviewed-by: Eric Boren <borenet@google.com>
* [recipes] Copy file, isolate, swarming, swarming_client from build.gitGravatar Eric Boren2017-05-22
| | | | | | | | | | | | | | | | | Rename swarming -> skia_swarming. Some required heavy modification to remove other dependencies on modules in build.git. Expected changes: - RECIPE_MODULE[build::<module>] -> RECIPE_MODULE[skia::<module>] - No more runit; directly run through Python. Bug: skia:6628 Change-Id: I1b1370ed387966222ce10731771dbde9020cf542 Reviewed-on: https://skia-review.googlesource.com/17448 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
* [skia] convert recipes and module to new context moduleGravatar Robert Iannucci2017-05-15
| | | | | | | | | | | | | This is a syntax-only change to convert to the new (documented) context module. R=borenet@google.com Bug: skia: Change-Id: Id907c309d3cf38b85a46f6d8d7ce90ed58ba026f Reviewed-on: https://skia-review.googlesource.com/16840 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
* [recipes] Add env recipe moduleGravatar Eric Boren2017-04-24
| | | | | | | | | | | | | | | | Simplifies the process of nesting environments. Usage: with api.env({'myvar': 'myval'}): # do stuff Same as api.step.context but specialized for just environment and merges PATH variable intelligently. Bug: skia:6473 Change-Id: I5769c69cbbbcdab0c6298cee6c5e1fe9caf89c78 Reviewed-on: https://skia-review.googlesource.com/14189 Reviewed-by: Kevin Lubick <kjlubick@google.com> Commit-Queue: Eric Boren <borenet@google.com>
* Recipes: remove some pragma: no coverGravatar Eric Boren2017-04-19
| | | | | | | | | | | | | | | | These are the remaining instances, and they're harder to deal with: $ git grep pragma recipe_modules/swarming/api.py: except self.m.step.StepFailure as e: # pragma: no cover recipe_modules/swarming/api.py: if len(ids) > 1: # pragma: nocover recipes/ct_skps.py: if api.path.exists(version_file): # pragma: nocover recipes/ct_skps.py: if api.path.exists(blacklist_file): # pragma: nocover recipes/upload_nano_results.py: if len(results) != 1: # pragma: nocover Bug: skia:6473 Change-Id: If75e2ffcf39a944b513b9005bbc4bd9c4fb031f6 Reviewed-on: https://skia-review.googlesource.com/13867 Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
* Recipes: Use strict coverage, part 1Gravatar Eric Boren2017-04-19
| | | | | | | | | | Shouldn't change any behavior. Bug: skia: Change-Id: I953e0da886a6d61096eba7915101f245a6cec741 Reviewed-on: https://skia-review.googlesource.com/13765 Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
* Fix symbolization of ASAN crashesGravatar Kevin Lubick2017-04-11
| | | | | | | | Bug: skia: Change-Id: Id127a3c4a1a40bc6ddb0641c9d72f1a5960bbc6e Reviewed-on: https://skia-review.googlesource.com/13125 Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Kevin Lubick <kjlubick@google.com>
* Move iOS app packaging to the cloudGravatar Stephan Altmueller2017-04-05
| | | | | | | | | | | | | | | | | This moves the signing and packaging of ios apps from the host that drives the device to the cloud machine where the app is built. This is in preparation of moving to Raspberry Pi hosts. BUG=skia:5331 Change-Id: I4918272a6c734f5344351f0726b7721fde042234 Reviewed-on: https://skia-review.googlesource.com/9906 Commit-Queue: Stephan Altmueller <stephana@google.com> Reviewed-by: Eric Boren <borenet@google.com> Reviewed-by: Mike Klein <mtklein@chromium.org>
* Followup fixes for recipe rollGravatar Eric Boren2017-03-21
| | | | | | | | | | | | | | Simplifying some environment madness. Nobody gets to modify default_env. Always apply it in run.__call__(). Add depot_tools path to PATH in default_env. Result is simpler but now default_env is applied in many more places, which should be harmless. BUG=skia: Change-Id: I8299d50bde2bc3e2d47568a267d1d962a3fc3d56 Reviewed-on: https://skia-review.googlesource.com/9916 Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
* Roll Recipe DEPSGravatar Eric Boren2017-03-21
| | | | | | | | | BUG=skia: Change-Id: Ic89d1b49aba842fb41c82ad6fc8f5ebe787893bd Reviewed-on: https://skia-review.googlesource.com/9884 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
* Roll recipe DEPS againGravatar Eric Boren2017-02-21
| | | | | | | | | | | | This time with coverage bypass BUG=skia: Change-Id: I7f51dcad7bad53c7209ac512876a0d72c6181b8e Reviewed-on: https://skia-review.googlesource.com/8768 Reviewed-by: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
* Roll recipe DEPSGravatar Eric Boren2017-02-21
| | | | | | | | | | | Attempt 2. Lots of fixes due to upstream breaks. BUG=skia: Change-Id: Ie05b2da1790fbcce5c45ef09c4c832e09de6b5c5 Reviewed-on: https://skia-review.googlesource.com/8762 Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Eric Boren <borenet@google.com>
* Revert "Roll Recipe DEPS"Gravatar Eric Boren2017-02-17
| | | | | | | | | | | | | | | | | | | | | | | | | | | | This reverts commit 310f4d02c1e2d01181c1db18acf05f2846f94cd4. Reason for revert: Broke uploads Original change's description: > Roll Recipe DEPS > > BUG=skia: > > Change-Id: I3e32207e5809e126d53ee8ec2158eb855c1a26d2 > Reviewed-on: https://skia-review.googlesource.com/8671 > Commit-Queue: Eric Boren <borenet@google.com> > Reviewed-by: Ravi Mistry <rmistry@google.com> > TBR=borenet@google.com,rmistry@google.com,reviews@skia.org NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true BUG=skia: Change-Id: If6eed7a72aa7178afd23d0a4a7786e23b27c1ac2 Reviewed-on: https://skia-review.googlesource.com/8681 Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Eric Boren <borenet@google.com>
* Roll Recipe DEPSGravatar Eric Boren2017-02-17
| | | | | | | | | BUG=skia: Change-Id: I3e32207e5809e126d53ee8ec2158eb855c1a26d2 Reviewed-on: https://skia-review.googlesource.com/8671 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
* Clean up hack of run apiGravatar Kevin Lubick2017-02-13
| | | | | | | | | | | | Also fix such that the Nexus Players get kicked three times not one and a half times. BUG=skia:6045 Change-Id: Ie9142f809a979a46b17a8ad9a205279d6fcb9bd5 Reviewed-on: https://skia-review.googlesource.com/8266 Reviewed-by: Kevin Lubick <kjlubick@google.com> Commit-Queue: Kevin Lubick <kjlubick@google.com>
* Reboot NexusPlayers with adb and shut them down if install failsGravatar Kevin Lubick2017-02-09
| | | | | | | | | BUG=skia:6045 Change-Id: Ibd31e4cc44b71633377b05ad33c1bdab9024f78c Reviewed-on: https://skia-review.googlesource.com/8152 Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Kevin Lubick <kjlubick@google.com>
* Get linux vulkan running on Intel NUCGravatar Kevin Lubick2017-02-06
| | | | | | | | | | | | | | | | | | | | | | | | This CL includes a few things. First, it creates two CIPD assets, a Debug and Release version of the Linux Vulkan Intel Driver. The driver is still young, so the Debug version helps us submit better bugs to the developers. The current version is Mesa 13.04: ftp://ftp.freedesktop.org/pub/mesa/13.0.4/ Second, it fixes the GN flavor to not purge out all environment variables - a leftover from the GYP -> GN migration. Third, it sets environment variables on both Test and Perf such that the vulkan sdk, libraries and drivers all linked in from their homes in CIPD. BUG=skia:6133 Change-Id: I9a999e24a0203ab7a9f4733bee1110b79e616935 Reviewed-on: https://skia-review.googlesource.com/7994 Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Kevin Lubick <kjlubick@google.com>
* Copy modules back in from skia-recipes repoGravatar Eric Boren2017-02-02
| | | | | | | | | BUG=skia:6070 Change-Id: I86b3f039c27bd8287516c1db8bd1cae62888171b Reviewed-on: https://skia-review.googlesource.com/7890 Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
* Move recipe modules to shared repoGravatar Eric Boren2017-01-17
| | | | | | | | | | BUG=skia:6070 Change-Id: I6c487e77ddfddb6164b983981dff5ee8ae870376 Reviewed-on: https://skia-review.googlesource.com/6946 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> Reviewed-by: Stephan Altmueller <stephana@google.com>
* Roll recipe DEPSGravatar Ravi Mistry2016-11-22
| | | | | | | | | | | | | Looks like slave_build and cwd changed to start_dir in https://bugs.chromium.org/p/chromium/issues/detail?id=662586 BUG=skia:5979 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=5104 Change-Id: I46d080b9089ea9b4adc2ed45fc81fdc192bdb2b2 Reviewed-on: https://skia-review.googlesource.com/5104 Reviewed-by: Ben Wagner <benjaminwagner@google.com> Commit-Queue: Ravi Mistry <rmistry@google.com>
* Add skpbench jobGravatar Kevin Lubick2016-11-14
| | | | | | | | | | | | | | | | | | | | | | | | This entails a few parts: 1. Isolating tools/skpbench/ to be used by the perf task. 2. Adding skpbench to BUILD_PRODUCTS_ISOLATE_WHITELIST 3. Add recipe commands to run skpbench. While it is conceptually similar to nanobench, it doesn't support images nor svgs, only skps, so we don't need to copy those to devices or bring them in via CIPD. 4. Add recipe commands to parse skpbench output and upload to Perf. 5. Update gen_tasks.go to handle skpbench jobs and tasks. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4551 Change-Id: I09bf0b078067279e138e95eca9316e55539ec735 Reviewed-on: https://skia-review.googlesource.com/4551 Commit-Queue: Kevin Lubick <kjlubick@google.com> Reviewed-by: Eric Boren <borenet@google.com>
* Add infra recipe module, use for updating Go DEPSGravatar borenet2016-10-24
| | | | | | | BUG=skia:5879 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2444883002 Review-Url: https://codereview.chromium.org/2444883002
* GN: remove old Android recipe code.Gravatar mtklein2016-09-19
| | | | | | | | | | | All the Android builders, testers, and perfers are on gn_android_flavor now. Not as scary as it looks... all the big line count changes are deletes. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2352653002 Review-Url: https://codereview.chromium.org/2352653002
* Move ct_skps recipe from tools repo to Skia repo.Gravatar rmistry2016-08-09
| | | | | | | | | Also move the isolate file and script from Chromium repo to the Skia repo. BUG=skia:5620 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2221413002 Review-Url: https://codereview.chromium.org/2221413002
* Use slave_build instead of checkout in run/api.pyGravatar rmistry2016-08-09
| | | | | | | BUG=skia:5620 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2221423002 Review-Url: https://codereview.chromium.org/2221423002
* Move builder_spec, [dm|nanobench]_flags, builder_name_schema to recipesGravatar borenet2016-08-04
| | | | | | | | | | | | | | - builder_name_schema becomes its own recipe module. - builder_spec, dm, and nanobench flags move into vars module. - recipe expectation diffs include: - no more buildbot_spec.py step - "real" dm and nanobench flags, instead of --dummy-flags - some inconsequential stuff in visualbench, which is removed anyway. BUG=skia:5578 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2215803002 Review-Url: https://codereview.chromium.org/2215803002
* Re-organize Skia recipesGravatar borenet2016-08-03
Break Skia recipe module into: - skia_vars: defines and stores variables (eg. paths) - skia_step: utilities for running Skia steps - skia_flavor: flavor-specific stuff - skia: top-level setup, checkout, test/perf steps, etc etc This establishes a saner dependency structure for the recipes; skia_vars is at the bottom level, skia_step depends on it, skia_flavor depends on both of them, skia depends on all of the above, and the recipes themselves may depend on any or all of them. Next steps: - Merge buildbot_spec into skia_vars - Move test_steps and perf_steps from skia recipe_module into swarm_test and swarm_perf recipes - Cleaner checkout_steps process BUG=skia:5578 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2198173002 Review-Url: https://codereview.chromium.org/2198173002