aboutsummaryrefslogtreecommitdiffhomepage
path: root/tools/tests/run.sh
Commit message (Collapse)AuthorAge
* create tools/tests/run_all.py to run all our Python self-tests within toolsGravatar commit-bot@chromium.org2013-12-19
| | | | | | | | | | | | | | | | Eventually, we want all of these self-tests to be written in Python; this change makes it easier for us to add new Python self-tests, and discourages the addition of bash self-tests. BUG=skia:677,skia:1943 NOTRY=True R=rmistry@google.com, scroggo@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/112163004 git-svn-id: http://skia.googlecode.com/svn/trunk@12775 2bbb7eff-a529-9590-31e7-b0007b416f81
* Changes bench_graph_svg.py test to check_bench_regressions.py test; deletes ↵Gravatar bensong@google.com2013-10-24
| | | | | | | | deprecated chunks in syn_bucket_subdir. Review URL: https://codereview.chromium.org/27377002 git-svn-id: http://skia.googlecode.com/svn/trunk@11952 2bbb7eff-a529-9590-31e7-b0007b416f81
* Suppresses failing test due to change of bench_graph_svg. Will fix later.Gravatar bensong@google.com2013-10-15
| | | | | | Review URL: https://codereview.chromium.org/26894004 git-svn-id: http://skia.googlecode.com/svn/trunk@11766 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: fix --add-new when there are no expectations at allGravatar epoger@google.com2013-09-03
| | | | | | | | | BUG=skia:1582 R=rmistry@google.com Review URL: https://codereview.chromium.org/23899003 git-svn-id: http://skia.googlecode.com/svn/trunk@11063 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: add --bugs and --unreviewed flagsGravatar epoger@google.com2013-09-03
| | | | | | | | | BUG=skia:1569 R=borenet@google.com Review URL: https://codereview.chromium.org/23478011 git-svn-id: http://skia.googlecode.com/svn/trunk@11058 2bbb7eff-a529-9590-31e7-b0007b416f81
* Remove temporary workaround TODOs from tools/tests/run.shGravatar epoger@google.com2013-08-28
| | | | | | | | R=rmistry@google.com Review URL: https://codereview.chromium.org/23490009 git-svn-id: http://skia.googlecode.com/svn/trunk@10989 2bbb7eff-a529-9590-31e7-b0007b416f81
* Remove base-* directories from gm expected/actual paths; just use platform namesGravatar epoger@google.com2013-08-20
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | BUG=skia:1512 The buildbot master continues to set gm_image_subdir, but the slaves no longer use that component when building GM paths (they just use builder_name instead). But gm_image_subdir is still used for SKP storage paths under gs://chromium-skia-gm/playback/gm-actual , for now... Immediately before committing this CL, I will copy the actual-results.json files from their old locations to their new locations (within the skia-autogen repo) so that both old and new versions of rebaseline.py will be able to retrieve actual results, like so: svn cp base-android-galaxy-nexus/Test-Android-GalaxyNexus-SGX540-Arm7-Debug/base-android-galaxy-nexus Test-Android-GalaxyNexus-SGX540-Arm7-Debug svn cp base-android-galaxy-nexus/Test-Android-GalaxyNexus-SGX540-Arm7-Release/base-android-galaxy-nexus Test-Android-GalaxyNexus-SGX540-Arm7-Release svn cp base-android-nexus-10/Test-Android-Nexus10-MaliT604-Arm7-Debug/base-android-nexus-10 Test-Android-Nexus10-MaliT604-Arm7-Debug ... svn cp base-shuttle-win7-intel-float/Test-Win7-ShuttleA-HD2000-x86-Debug/base-shuttle-win7-intel-float Test-Win7-ShuttleA-HD2000-x86-Debug svn cp base-shuttle-win7-intel-float/Test-Win7-ShuttleA-HD2000-x86-Release/base-shuttle-win7-intel-float Test-Win7-ShuttleA-HD2000-x86-Release Once we see this CL land successfully, I will delete the actual-results.json files from their OLD location within skia-autogen, like so: svn rm base-android-galaxy-nexus svn rm base-android-nexus-10 ... svn rm base-shuttle-win7-intel-directwrite svn rm base-shuttle-win7-intel-float R=borenet@google.com, rmistry@google.com Review URL: https://codereview.chromium.org/23120002 git-svn-id: http://skia.googlecode.com/svn/trunk@10821 2bbb7eff-a529-9590-31e7-b0007b416f81
* Delete image-based rebaselining tool; we have switched to checksumsGravatar epoger@google.com2013-08-02
| | | | | | | | R=borenet@google.com Review URL: https://codereview.chromium.org/21901004 git-svn-id: http://skia.googlecode.com/svn/trunk@10524 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: error out early if --expectations-root not pointing at ↵Gravatar epoger@google.com2013-07-10
| | | | | | | | | | | gm-expected dir BUG=https://code.google.com/p/skia/issues/detail?id=1403 R=senorblanco@chromium.org Review URL: https://codereview.chromium.org/18416005 git-svn-id: http://skia.googlecode.com/svn/trunk@9961 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: use specified configs/tests as a FILTER over actually-run testsGravatar epoger@google.com2013-07-10
| | | | | | | | | | | | | Now that we have the actual-results.json file for every bot type, we know the full set of tests that actual results are available for. If configs and/or tests are specified, just use those as FILTERS over the actually available results. R=senorblanco@chromium.org Review URL: https://codereview.chromium.org/18324018 git-svn-id: http://skia.googlecode.com/svn/trunk@9956 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: if expectations dir contains JSON format results, update ↵Gravatar epoger@google.com2013-07-08
| | | | | | | | | | | | those instead of image files Part of Step 3 in https://goto.google.com/ChecksumTransitionDetail R=senorblanco@chromium.org Review URL: https://codereview.chromium.org/18348018 git-svn-id: http://skia.googlecode.com/svn/trunk@9910 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py self-tests: prepare to add tests of JSON-format rebaseliningGravatar epoger@google.com2013-07-03
| | | | | | | | | | | | For now, rebaseline.py still does not support JSON-format rebaselining, so the one self-test reports failure. But this change will allow us to test the JSON-format rebaselining once rebaseline.py supports it. R=scroggo@google.com Review URL: https://codereview.chromium.org/18348015 git-svn-id: http://skia.googlecode.com/svn/trunk@9896 2bbb7eff-a529-9590-31e7-b0007b416f81
* Create jsondiff tool to capture diffs between two JSON expectations files.Gravatar epoger@google.com2013-07-02
| | | | | | | | | | | | | This will be used to view diffs before committing rebaselines, or to review exactly what changed between two baseline revisions in the past. Part of Step 3 in https://goto.google.com/ChecksumTransitionDetail R=scroggo@google.com Review URL: https://codereview.chromium.org/18103005 git-svn-id: http://skia.googlecode.com/svn/trunk@9878 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: split image-based rebaselining, which will go away soon, into ↵Gravatar epoger@google.com2013-06-19
| | | | | | | | | | | | | | its own script (part of step 3 in https://goto.google.com/ChecksumTransitionDetail ) also adds new --expectations-root option R=scroggo@google.com, senorblanco@chromium.org Review URL: https://codereview.chromium.org/17379004 git-svn-id: http://skia.googlecode.com/svn/trunk@9689 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: try to download images from Google Storage before skia-autogenGravatar epoger@google.com2013-06-12
| | | | | | | | | | This will allow us to complete Step 1 of https://goto.google.com/ChecksumTransitionDetail R=scroggo@google.com Review URL: https://codereview.chromium.org/16311011 git-svn-id: http://skia.googlecode.com/svn/trunk@9534 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: add --add-new option, and only add new expectations if it is setGravatar epoger@google.com2013-06-12
| | | | | | | | R=senorblanco@chromium.org Review URL: https://codereview.chromium.org/16363006 git-svn-id: http://skia.googlecode.com/svn/trunk@9527 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: in option names, replace underscores with hyphensGravatar epoger@google.com2013-06-11
| | | | | | | | Split off of already-reviewed https://codereview.chromium.org/15789010/ ('rebaseline.py: --tests and --configs are now FILTERS within json results') Review URL: https://codereview.chromium.org/15904018 git-svn-id: http://skia.googlecode.com/svn/trunk@9504 2bbb7eff-a529-9590-31e7-b0007b416f81
* Run skimage as part of run.shGravatar scroggo@google.com2013-06-07
| | | | | | | | | | | | | Test skimage to ensure that it does not break. Split off from https://codereview.chromium.org/15813016/ BUG=http://code.google.com/p/skia/issues/detail?id=1241 R=epoger@google.com Review URL: https://codereview.chromium.org/15774017 git-svn-id: http://skia.googlecode.com/svn/trunk@9473 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py self-tests: split test inputs and outputs into completely ↵Gravatar epoger@google.com2013-06-06
| | | | | | | | separate directories Review URL: https://codereview.chromium.org/16557002 git-svn-id: http://skia.googlecode.com/svn/trunk@9459 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py: if --tests is not specified, get test list from ↵Gravatar epoger@google.com2013-06-05
| | | | | | | | | | actual-results.json R=scroggo@google.com Review URL: https://codereview.chromium.org/16093025 git-svn-id: http://skia.googlecode.com/svn/trunk@9443 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline.py : add self-testsGravatar epoger@google.com2013-06-04
| | | | | | | | R=senorblanco@chromium.org Review URL: https://codereview.chromium.org/15660014 git-svn-id: http://skia.googlecode.com/svn/trunk@9426 2bbb7eff-a529-9590-31e7-b0007b416f81
* bench_graph_svg: add r7618 results (NOT per-tile) to self-test source dataGravatar epoger@google.com2013-02-17
| | | | | | Review URL: https://codereview.appspot.com/7305098 git-svn-id: http://skia.googlecode.com/svn/trunk@7760 2bbb7eff-a529-9590-31e7-b0007b416f81
* bench_graph_svg self-test: add non-tile bench dataGravatar epoger@google.com2013-02-15
| | | | | | | TBR=benchen Review URL: https://codereview.appspot.com/7317048 git-svn-id: http://skia.googlecode.com/svn/trunk@7750 2bbb7eff-a529-9590-31e7-b0007b416f81
* tools/tests/run.sh: download test bench data from Google Storage rather than SVNGravatar epoger@google.com2013-02-15
| | | | | | Review URL: https://codereview.appspot.com/7343045 git-svn-id: http://skia.googlecode.com/svn/trunk@7749 2bbb7eff-a529-9590-31e7-b0007b416f81
* bench_graph_svg: generate output in consistently sorted order, to make diffs ↵Gravatar epoger@google.com2013-02-14
| | | | | | | | | more useful TBR=benchen Review URL: https://codereview.appspot.com/7330044 git-svn-id: http://skia.googlecode.com/svn/trunk@7744 2bbb7eff-a529-9590-31e7-b0007b416f81
* disable new bench_graph_svg test in tools/tests/run.sh that fails on housekeeperGravatar epoger@google.com2013-02-14
| | | | | | | TBR=bensong Review URL: https://codereview.appspot.com/7303092 git-svn-id: http://skia.googlecode.com/svn/trunk@7739 2bbb7eff-a529-9590-31e7-b0007b416f81
* tools/tests/run.sh: add self-test for bench_graph_svg.pyGravatar epoger@google.com2013-02-14
| | | | | | Review URL: https://codereview.appspot.com/7319044 git-svn-id: http://skia.googlecode.com/svn/trunk@7735 2bbb7eff-a529-9590-31e7-b0007b416f81
* Add more warnings about https://code.google.com/p/skia/issues/detail?id=677 ↵Gravatar epoger@google.com2013-01-02
| | | | | | ('make tools/tests/run.sh work cross-platform') git-svn-id: http://skia.googlecode.com/svn/trunk@6965 2bbb7eff-a529-9590-31e7-b0007b416f81
* Update skdiff.Gravatar bungeman@google.com2012-12-05
| | | | | | | https://codereview.appspot.com/6850115/ git-svn-id: http://skia.googlecode.com/svn/trunk@6681 2bbb7eff-a529-9590-31e7-b0007b416f81
* Add a self-test for gm, similar to our self-test for skdiff.Gravatar epoger@google.com2012-11-12
| | | | | | Review URL: https://codereview.appspot.com/6827068 git-svn-id: http://skia.googlecode.com/svn/trunk@6380 2bbb7eff-a529-9590-31e7-b0007b416f81
* skdiff: replace --failonmismatches with repeatable --failonresult optionGravatar epoger@google.com2012-07-13
| | | | | | Review URL: https://codereview.appspot.com/6392064 git-svn-id: http://skia.googlecode.com/svn/trunk@4611 2bbb7eff-a529-9590-31e7-b0007b416f81
* skdiff: add --failonmismatches and --listfilename options, plus cleanupGravatar epoger@google.com2012-07-12
| | | | | | | These changes are needed in order to switch the buildbots from using "gm -r" to "skdiff" to compare gm results, and should be generally good for humans too. Review URL: https://codereview.appspot.com/6392054 git-svn-id: http://skia.googlecode.com/svn/trunk@4579 2bbb7eff-a529-9590-31e7-b0007b416f81
* test-only: add test coverage of skdiff over input with identical bits or pixelsGravatar epoger@google.com2012-05-30
| | | | | | Review URL: https://codereview.appspot.com/6260055 git-svn-id: http://skia.googlecode.com/svn/trunk@4084 2bbb7eff-a529-9590-31e7-b0007b416f81
* skdiff test-only change: add test of --nodiffs mode, make tests validate ↵Gravatar epoger@google.com2012-05-18
| | | | | | | | return value Review URL: https://codereview.appspot.com/6206085 git-svn-id: http://skia.googlecode.com/svn/trunk@3999 2bbb7eff-a529-9590-31e7-b0007b416f81
* test-only change: update run.sh and rearrange dirs to ease addition of more ↵Gravatar epoger@google.com2012-05-17
| | | | | | | | tests Review URL: https://codereview.appspot.com/6220044 git-svn-id: http://skia.googlecode.com/svn/trunk@3995 2bbb7eff-a529-9590-31e7-b0007b416f81
* skdiff: only write out diff images that are included in index.htmlGravatar epoger@google.com2012-05-16
| | | | | | | Not only are those files unnecessary, in some different-image-size cases, their contents are nondeterministic! Review URL: https://codereview.appspot.com/6208073 git-svn-id: http://skia.googlecode.com/svn/trunk@3975 2bbb7eff-a529-9590-31e7-b0007b416f81
* Add self-test for skdiff, and remove date/time from skdiff output so it passes.Gravatar epoger@google.com2012-05-15
BUG=http://code.google.com/p/skia/issues/detail?id=612 Review URL: https://codereview.appspot.com/6198074 git-svn-id: http://skia.googlecode.com/svn/trunk@3938 2bbb7eff-a529-9590-31e7-b0007b416f81
generated by cgit v1.2.3 (git 2.39.1) at 2024-08-30 15:25:55 +0000