aboutsummaryrefslogtreecommitdiffhomepage
path: root/tools/rebaseline.py
Commit message (Collapse)AuthorAge
* Add Win8 bots to rebaseline.py, add baselines for Win8Gravatar commit-bot@chromium.org2013-12-17
| | | | | | | | | | | | NOTRY=True BUG= R=epoger@google.com Author: borenet@google.com Review URL: https://codereview.chromium.org/117433003 git-svn-id: http://skia.googlecode.com/svn/trunk@12714 2bbb7eff-a529-9590-31e7-b0007b416f81
* More work to integrate skimage with rebaseline tools.Gravatar scroggo@google.com2013-10-22
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | tools/skimage_main.cpp: Add the ability to write the results to checksum based filenames, much like GM uses. This will allow using the skpdiff server to rebaseline images. Write the keys in the JSON file as <original image>_<pref config>.png, so it matches gm_json.IMAGE_FILENAME_PATTERN. Also replace '_' with '-' in the original file name, to avoid confusing the pattern matcher. The '_' to '-' replacement also happens on the output filename. Read the keys in a similar manner. In make_outname, no longer remove a suffix. This fixes a bug where subset decoding writes multiple subsets to the same file. tools/rebaseline.py: Since the filenames written to json files now match gm_json.IMAGE_FILENAME_PATTERN, enable the option to match based on configs/tests when rebaselining skimage. test json files: Update to match the new format of output. gm/gm_expectations: Add a constructor that takes a BitmapAndDigest as input. tools/tests/skimage_self_test.py: Test that reading the expectations file just created by skimage with the same file actually compares to the original file (rather than just succeeding because expectations were missing). Change the expectations files to match the new format. Will require a buildbot change to use the new flag: https://codereview.chromium.org/27389002/ BUG=1466 R=epoger@google.com Review URL: https://codereview.chromium.org/26297004 git-svn-id: http://skia.googlecode.com/svn/trunk@11902 2bbb7eff-a529-9590-31e7-b0007b416f81
* Add --add-ignored option to rebaseline.pyGravatar bsalomon@google.com2013-10-16
| | | | | | | | | R=senorblanco@chromium.org, epoger@google.com BUG=skia:1600 Review URL: https://codereview.chromium.org/27517002 git-svn-id: http://skia.googlecode.com/svn/trunk@11809 2bbb7eff-a529-9590-31e7-b0007b416f81
* Add ability to rebaseline skimage to rebaseline.pyGravatar scroggo@google.com2013-10-10
| | | | | | | | | | | | | | | | | | | | Skip pattern matching for skimage, since the skimage results do not match the pattern. Automatically fill in expectations_root and actuals_base_url when --skimage is specified. Requires a change to move the expectations files to the right place. Depends on https://codereview.chromium.org/26734006 (SkipBuildBotRuns) BUG=skia:1466 R=epoger@google.com Review URL: https://codereview.chromium.org/26666004 git-svn-id: http://skia.googlecode.com/svn/trunk@11717 2bbb7eff-a529-9590-31e7-b0007b416f81
* Document how to get a specific revision when rebaselining.Gravatar bungeman@google.com2013-10-07
| | | | | | | | | | This is helpful when using the trybots. R=epoger@google.com Review URL: https://codereview.chromium.org/25653008 git-svn-id: http://skia.googlecode.com/svn/trunk@11643 2bbb7eff-a529-9590-31e7-b0007b416f81
* Add an option to rebaseline.py to mark tests as ignore-failure.Gravatar senorblanco@chromium.org2013-09-18
| | | | | | | | R=epoger@google.com, epoger Review URL: https://codereview.chromium.org/24195018 git-svn-id: http://skia.googlecode.com/svn/trunk@11358 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: make builder names copy-pastable from --help outputGravatar epoger@google.com2013-09-18
| | | | | | | | | | | BUG=skia:1653 (SkipBuildbotRuns) R=bsalomon@google.com Review URL: https://codereview.chromium.org/23514068 git-svn-id: http://skia.googlecode.com/svn/trunk@11347 2bbb7eff-a529-9590-31e7-b0007b416f81
* Add --from-trybot flag in rebaseline.py to enable rebaselining from trybotsGravatar borenet@google.com2013-09-16
| | | | | | | | | | (SkipBuildbotRuns) R=epoger@google.com Review URL: https://codereview.chromium.org/24153003 git-svn-id: http://skia.googlecode.com/svn/trunk@11294 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: add bug-filing URL to error messageGravatar epoger@google.com2013-09-06
| | | | | | | | R=bsalomon@google.com Review URL: https://codereview.chromium.org/23968002 git-svn-id: http://skia.googlecode.com/svn/trunk@11133 2bbb7eff-a529-9590-31e7-b0007b416f81
* Revert r11102 (mistakenly committed)Gravatar epoger@google.com2013-09-05
| | | | git-svn-id: http://skia.googlecode.com/svn/trunk@11103 2bbb7eff-a529-9590-31e7-b0007b416f81
* whitespace-only fix to manually-modified GM expectationsGravatar epoger@google.com2013-09-05
| | | | git-svn-id: http://skia.googlecode.com/svn/trunk@11102 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: fix --add-new when there are no expectations at allGravatar epoger@google.com2013-09-03
| | | | | | | | | BUG=skia:1582 R=rmistry@google.com Review URL: https://codereview.chromium.org/23899003 git-svn-id: http://skia.googlecode.com/svn/trunk@11063 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: add --bugs and --unreviewed flagsGravatar epoger@google.com2013-09-03
| | | | | | | | | BUG=skia:1569 R=borenet@google.com Review URL: https://codereview.chromium.org/23478011 git-svn-id: http://skia.googlecode.com/svn/trunk@11058 2bbb7eff-a529-9590-31e7-b0007b416f81
* temporarily hard-code builder list in rebaseline.py, for quick startupGravatar epoger@google.com2013-08-24
| | | | | | | | | BUG=skia:1544 R=borenet@google.com Review URL: https://codereview.chromium.org/22866023 git-svn-id: http://skia.googlecode.com/svn/trunk@10908 2bbb7eff-a529-9590-31e7-b0007b416f81
* Update references to buildbot globals deprecated by r10856Gravatar epoger@google.com2013-08-21
| | | | | | | | R=borenet@google.com Review URL: https://codereview.chromium.org/23011035 git-svn-id: http://skia.googlecode.com/svn/trunk@10860 2bbb7eff-a529-9590-31e7-b0007b416f81
* Remove base-* directories from gm expected/actual paths; just use platform namesGravatar epoger@google.com2013-08-20
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | BUG=skia:1512 The buildbot master continues to set gm_image_subdir, but the slaves no longer use that component when building GM paths (they just use builder_name instead). But gm_image_subdir is still used for SKP storage paths under gs://chromium-skia-gm/playback/gm-actual , for now... Immediately before committing this CL, I will copy the actual-results.json files from their old locations to their new locations (within the skia-autogen repo) so that both old and new versions of rebaseline.py will be able to retrieve actual results, like so: svn cp base-android-galaxy-nexus/Test-Android-GalaxyNexus-SGX540-Arm7-Debug/base-android-galaxy-nexus Test-Android-GalaxyNexus-SGX540-Arm7-Debug svn cp base-android-galaxy-nexus/Test-Android-GalaxyNexus-SGX540-Arm7-Release/base-android-galaxy-nexus Test-Android-GalaxyNexus-SGX540-Arm7-Release svn cp base-android-nexus-10/Test-Android-Nexus10-MaliT604-Arm7-Debug/base-android-nexus-10 Test-Android-Nexus10-MaliT604-Arm7-Debug ... svn cp base-shuttle-win7-intel-float/Test-Win7-ShuttleA-HD2000-x86-Debug/base-shuttle-win7-intel-float Test-Win7-ShuttleA-HD2000-x86-Debug svn cp base-shuttle-win7-intel-float/Test-Win7-ShuttleA-HD2000-x86-Release/base-shuttle-win7-intel-float Test-Win7-ShuttleA-HD2000-x86-Release Once we see this CL land successfully, I will delete the actual-results.json files from their OLD location within skia-autogen, like so: svn rm base-android-galaxy-nexus svn rm base-android-nexus-10 ... svn rm base-shuttle-win7-intel-directwrite svn rm base-shuttle-win7-intel-float R=borenet@google.com, rmistry@google.com Review URL: https://codereview.chromium.org/23120002 git-svn-id: http://skia.googlecode.com/svn/trunk@10821 2bbb7eff-a529-9590-31e7-b0007b416f81
* Delete image-based rebaselining tool; we have switched to checksumsGravatar epoger@google.com2013-08-02
| | | | | | | | R=borenet@google.com Review URL: https://codereview.chromium.org/21901004 git-svn-id: http://skia.googlecode.com/svn/trunk@10524 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: add ability to write new expectations to a different fileGravatar epoger@google.com2013-07-24
| | | | | | | | | | (instead of overwriting the original expectations file) R=zachr@google.com Review URL: https://codereview.chromium.org/19805007 git-svn-id: http://skia.googlecode.com/svn/trunk@10333 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: set text mimetype for all .json files, so text diffs work Gravatar epoger@google.com2013-07-24
| | | | | | | | | BUG=https://code.google.com/p/skia/issues/detail?id=1442 R=fmalita@google.com Review URL: https://codereview.chromium.org/20017009 git-svn-id: http://skia.googlecode.com/svn/trunk@10311 2bbb7eff-a529-9590-31e7-b0007b416f81
* Move gm-expected to trunk/expectations/gm , and modify scripts that use it.Gravatar epoger@google.com2013-07-23
| | | | | | | | | | | Left dummy content in the old gm-expected dir to keep Update step happy, to avoid the breakages caused by r10281. R=borenet@google.com Review URL: https://codereview.chromium.org/19668009 git-svn-id: http://skia.googlecode.com/svn/trunk@10288 2bbb7eff-a529-9590-31e7-b0007b416f81
* Revert r10281 -- it broke the Update step on Test buildersGravatar epoger@google.com2013-07-23
| | | | git-svn-id: http://skia.googlecode.com/svn/trunk@10285 2bbb7eff-a529-9590-31e7-b0007b416f81
* Move gm-expected to trunk/expectations/gm , and modify scripts that use it.Gravatar epoger@google.com2013-07-23
| | | | | | | | R=borenet@google.com Review URL: https://codereview.chromium.org/19697017 git-svn-id: http://skia.googlecode.com/svn/trunk@10281 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: re-record already succeeding test results, just in caseGravatar epoger@google.com2013-07-17
| | | | | | | | TBR=borenet Review URL: https://codereview.chromium.org/19459002 git-svn-id: http://skia.googlecode.com/svn/trunk@10121 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: fix --add-new for JSON filesGravatar epoger@google.com2013-07-16
| | | | | | | | TBR=borenet Review URL: https://codereview.chromium.org/19415002 git-svn-id: http://skia.googlecode.com/svn/trunk@10117 2bbb7eff-a529-9590-31e7-b0007b416f81
* svndiff.py: add ability to compare before-and-after JSON files, not just raw ↵Gravatar epoger@google.com2013-07-16
| | | | | | | | | | | | images This should complete step 3 of https://goto.google.com/ChecksumTransitionDetail ! R=borenet@google.com Review URL: https://codereview.chromium.org/19112002 git-svn-id: http://skia.googlecode.com/svn/trunk@10113 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: add --keep-going-on-failure option, off by defaultGravatar epoger@google.com2013-07-16
| | | | | | | | R=borenet@google.com Review URL: https://codereview.chromium.org/18092004 git-svn-id: http://skia.googlecode.com/svn/trunk@10109 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: skip any platforms we don't have actual results for, with ↵Gravatar epoger@google.com2013-07-11
| | | | | | | | | | warning message R=borenet@google.com Review URL: https://codereview.chromium.org/19052007 git-svn-id: http://skia.googlecode.com/svn/trunk@10022 2bbb7eff-a529-9590-31e7-b0007b416f81
* Fix Housekeeper bot after r9961Gravatar epoger@google.com2013-07-10
| | | | git-svn-id: http://skia.googlecode.com/svn/trunk@9965 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: error out early if --expectations-root not pointing at ↵Gravatar epoger@google.com2013-07-10
| | | | | | | | | | | gm-expected dir BUG=https://code.google.com/p/skia/issues/detail?id=1403 R=senorblanco@chromium.org Review URL: https://codereview.chromium.org/18416005 git-svn-id: http://skia.googlecode.com/svn/trunk@9961 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: use specified configs/tests as a FILTER over actually-run testsGravatar epoger@google.com2013-07-10
| | | | | | | | | | | | | Now that we have the actual-results.json file for every bot type, we know the full set of tests that actual results are available for. If configs and/or tests are specified, just use those as FILTERS over the actually available results. R=senorblanco@chromium.org Review URL: https://codereview.chromium.org/18324018 git-svn-id: http://skia.googlecode.com/svn/trunk@9956 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: if expectations dir contains JSON format results, update ↵Gravatar epoger@google.com2013-07-08
| | | | | | | | | | | | those instead of image files Part of Step 3 in https://goto.google.com/ChecksumTransitionDetail R=senorblanco@chromium.org Review URL: https://codereview.chromium.org/18348018 git-svn-id: http://skia.googlecode.com/svn/trunk@9910 2bbb7eff-a529-9590-31e7-b0007b416f81
* Add N4 to rebaseline.pyGravatar robertphillips@google.com2013-07-02
| | | | | | | | | https://codereview.chromium.org/18023014/ (SkipBuildbotRuns) git-svn-id: http://skia.googlecode.com/svn/trunk@9859 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: split image-based rebaselining, which will go away soon, into ↵Gravatar epoger@google.com2013-06-19
| | | | | | | | | | | | | | its own script (part of step 3 in https://goto.google.com/ChecksumTransitionDetail ) also adds new --expectations-root option R=scroggo@google.com, senorblanco@chromium.org Review URL: https://codereview.chromium.org/17379004 git-svn-id: http://skia.googlecode.com/svn/trunk@9689 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: keep going if we encounter an "INVALID" entry in the JSON fileGravatar epoger@google.com2013-06-12
| | | | | | Review URL: https://codereview.chromium.org/16826003 git-svn-id: http://skia.googlecode.com/svn/trunk@9543 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: try to download images from Google Storage before skia-autogenGravatar epoger@google.com2013-06-12
| | | | | | | | | | This will allow us to complete Step 1 of https://goto.google.com/ChecksumTransitionDetail R=scroggo@google.com Review URL: https://codereview.chromium.org/16311011 git-svn-id: http://skia.googlecode.com/svn/trunk@9534 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: add --add-new option, and only add new expectations if it is setGravatar epoger@google.com2013-06-12
| | | | | | | | R=senorblanco@chromium.org Review URL: https://codereview.chromium.org/16363006 git-svn-id: http://skia.googlecode.com/svn/trunk@9527 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: improve readability of dry-run outputGravatar epoger@google.com2013-06-11
| | | | | | | | Split off of already-reviewed https://codereview.chromium.org/15789010/ ('rebaseline.py: --tests and --configs are now FILTERS within json results') Review URL: https://codereview.chromium.org/16509006 git-svn-id: http://skia.googlecode.com/svn/trunk@9507 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: if rebaselining all platforms (not listing them explicitly), ↵Gravatar epoger@google.com2013-06-11
| | | | | | | | | | allow missing platforms TBR=any-reviewer Review URL: https://codereview.chromium.org/16782003 git-svn-id: http://skia.googlecode.com/svn/trunk@9506 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: in option names, replace underscores with hyphensGravatar epoger@google.com2013-06-11
| | | | | | | | Split off of already-reviewed https://codereview.chromium.org/15789010/ ('rebaseline.py: --tests and --configs are now FILTERS within json results') Review URL: https://codereview.chromium.org/15904018 git-svn-id: http://skia.googlecode.com/svn/trunk@9504 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: if --tests is not specified, get test list from ↵Gravatar epoger@google.com2013-06-05
| | | | | | | | | | actual-results.json R=scroggo@google.com Review URL: https://codereview.chromium.org/16093025 git-svn-id: http://skia.googlecode.com/svn/trunk@9443 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py : add self-testsGravatar epoger@google.com2013-06-04
| | | | | | | | R=senorblanco@chromium.org Review URL: https://codereview.chromium.org/15660014 git-svn-id: http://skia.googlecode.com/svn/trunk@9426 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: use argparse command-line flags for more flexibilityGravatar epoger@google.com2013-05-30
| | | | | | | | | | | | | | | | | | | | --tests is the only mandatory argument. If you used to run this: rebaseline.py aaclip bigmatrix Run this instead: rebaseline.py --tests aaclip bigmatrix That's the only change you NEED to make. And then, if you WANT to specify --configs, --subdirs, etc. you CAN. R=senorblanco@chromium.org Review URL: https://codereview.chromium.org/15675010 git-svn-id: http://skia.googlecode.com/svn/trunk@9348 2bbb7eff-a529-9590-31e7-b0007b416f81
* Refactor rebaseline.py into functions ; no behavioral changes.Gravatar epoger@google.com2013-05-29
| | | | | | | | R=senorblanco@chromium.org Review URL: https://codereview.chromium.org/16160008 git-svn-id: http://skia.googlecode.com/svn/trunk@9318 2bbb7eff-a529-9590-31e7-b0007b416f81
* Make rebaseline.py pull msaa imagesGravatar bsalomon@google.com2013-05-17
| | | | | | | | R=robertphillips@google.com Review URL: https://codereview.chromium.org/15299005 git-svn-id: http://skia.googlecode.com/svn/trunk@9179 2bbb7eff-a529-9590-31e7-b0007b416f81
* Update rebaseline.py for N10.Gravatar bsalomon@google.com2013-05-14
| | | | | | | | R=jvanverth@google.com Review URL: https://codereview.chromium.org/14581014 git-svn-id: http://skia.googlecode.com/svn/trunk@9126 2bbb7eff-a529-9590-31e7-b0007b416f81
* Make rebaseline.py pull GN Debug images.Gravatar bsalomon@google.com2013-05-03
| | | | | | | | R=senorblanco@chromium.org Review URL: https://codereview.chromium.org/14743004 git-svn-id: http://skia.googlecode.com/svn/trunk@8999 2bbb7eff-a529-9590-31e7-b0007b416f81
* Fix builder name referencesGravatar borenet@google.com2013-04-30
| | | | | | | | | | | ... as a result of https://codereview.chromium.org/14517004/ (SkipBuildbotRuns) R=bensong@google.com, rmistry@google.com, senorblanco@chromium.org Review URL: https://codereview.chromium.org/14544003 git-svn-id: http://skia.googlecode.com/svn/trunk@8921 2bbb7eff-a529-9590-31e7-b0007b416f81
* Rebaseline script: check for .git and .svn in the current directory as ↵Gravatar senorblanco@chromium.org2012-12-07
| | | | | | | | | | well. Add mesa to list of configs to update. R=bsalomon@google.com Review URL: https://codereview.appspot.com/6908050 git-svn-id: http://skia.googlecode.com/svn/trunk@6707 2bbb7eff-a529-9590-31e7-b0007b416f81
* No longer generating 4444, remove from rebaseline tool.Gravatar bungeman@google.com2012-12-06
| | | | | | | https://codereview.appspot.com/6886048/ git-svn-id: http://skia.googlecode.com/svn/trunk@6692 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: Allow multiple testnames on the command line.Gravatar senorblanco@chromium.org2012-11-29
| | | | | | Review URL: https://codereview.appspot.com/6856118 git-svn-id: http://skia.googlecode.com/svn/trunk@6623 2bbb7eff-a529-9590-31e7-b0007b416f81
generated by cgit v1.2.3 (git 2.39.1) at 2024-07-03 00:14:18 +0000