aboutsummaryrefslogtreecommitdiffhomepage
path: root/gm/tests
Commit message (Collapse)AuthorAge
* gm: add self-test to confirm that ignore-failure field is respectedGravatar epoger@google.com2013-08-30
| | | | | | | | | BUG=skia:1578 R=scroggo@google.com Review URL: https://codereview.chromium.org/23799004 git-svn-id: http://skia.googlecode.com/svn/trunk@11047 2bbb7eff-a529-9590-31e7-b0007b416f81
* Update expectations for Mac PDFGravatar vandebo@chromium.org2013-08-21
| | | | | | | | R=epoger@google.com, vandebo@chromium.org Review URL: https://codereview.chromium.org/22865029 git-svn-id: http://skia.googlecode.com/svn/trunk@10863 2bbb7eff-a529-9590-31e7-b0007b416f81
* Support multiple PDF rendering backends in the GMGravatar vandebo@chromium.org2013-08-20
| | | | | | | | R=epoger@google.com, vandebo@chromium.org Review URL: https://codereview.chromium.org/21669004 git-svn-id: http://skia.googlecode.com/svn/trunk@10841 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: stop recording all *_pdf.png results as "INVALID" on non-Mac platformsGravatar epoger@google.com2013-07-08
| | | | | | | | | BUG=https://code.google.com/p/skia/issues/detail?id=1352 R=edisonn@google.com Review URL: https://codereview.chromium.org/17366003 git-svn-id: http://skia.googlecode.com/svn/trunk@9912 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: add --missingExpectationsPath option, similar to --mismatchPathGravatar epoger@google.com2013-06-21
| | | | | | | | | | | This will allow us to make the buildbots record all images EXCEPT those which match expectations to Google Storage. R=borenet@google.com Review URL: https://codereview.chromium.org/17552012 git-svn-id: http://skia.googlecode.com/svn/trunk@9725 2bbb7eff-a529-9590-31e7-b0007b416f81
* Reland r9682, using new SkString::appendU64()Gravatar epoger@google.com2013-06-19
| | | | | | Review URL: https://codereview.chromium.org/17157005 git-svn-id: http://skia.googlecode.com/svn/trunk@9687 2bbb7eff-a529-9590-31e7-b0007b416f81
* Reverting r9682, which broke on some compilersGravatar epoger@google.com2013-06-19
| | | | git-svn-id: http://skia.googlecode.com/svn/trunk@9684 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: add --writeChecksumBasedFilenames option Gravatar epoger@google.com2013-06-19
| | | | | | | | | | | as needed for Step 2 of https://goto.google.com/ChecksumTransitionDetail : make GenerateGMs upload actual images to Google Storage instead of skia-autogen R=scroggo@google.com Review URL: https://codereview.chromium.org/17365002 git-svn-id: http://skia.googlecode.com/svn/trunk@9682 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: create GmResultDigest that encapsulates digest type ("bitmap-64bitMD5") ↵Gravatar epoger@google.com2013-05-24
| | | | | | | | | | and value (12345) R=scroggo@google.com Review URL: https://codereview.chromium.org/15883004 git-svn-id: http://skia.googlecode.com/svn/trunk@9271 2bbb7eff-a529-9590-31e7-b0007b416f81
* Improve tool that analyzes gm JSON summaryGravatar epoger@google.com2013-05-21
| | | | | | | | | BUG=https://code.google.com/p/skia/issues/detail?id=1300 R=borenet@google.com Review URL: https://codereview.chromium.org/15298010 git-svn-id: http://skia.googlecode.com/svn/trunk@9217 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM self-tests: add testing for non --hierarchy caseGravatar epoger@google.com2013-05-21
| | | | | | | | R=scroggo@google.com Review URL: https://codereview.chromium.org/15397007 git-svn-id: http://skia.googlecode.com/svn/trunk@9214 2bbb7eff-a529-9590-31e7-b0007b416f81
* Add gm/confirm_no_failures_in_json.pyGravatar epoger@google.com2013-05-14
| | | | | | | | | | | The CompareGMs step will use this (instead of running skdiff over the image files) to decide whether to go red or green. R=rmistry@google.com Review URL: https://codereview.chromium.org/15100003 git-svn-id: http://skia.googlecode.com/svn/trunk@9127 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: include filename extension (.png) of each output file in JSON summaryGravatar epoger@google.com2013-05-14
| | | | | | | | | | | | Doing this so that, once we *do* start writing PDF checksums into the JSON summary, we'll be able to distinguish those from the PNG checksums. Otherwise, we could have naming collisions. R=scroggo@google.com Review URL: https://codereview.chromium.org/14890017 git-svn-id: http://skia.googlecode.com/svn/trunk@9119 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM self-test: add --writePath and --mismatchPath , but in a way that works ↵Gravatar epoger@google.com2013-05-09
| | | | | | | | | | cross-platform R=scroggo@google.com Review URL: https://codereview.chromium.org/15085007 git-svn-id: http://skia.googlecode.com/svn/trunk@9077 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM self-test: add option to exercise --writePath and --mismatchPath, but not ↵Gravatar epoger@google.com2013-05-08
| | | | | | | | | | | | on bots (individual developers can set WRITE_IMAGE_FILES=1 for local testing) R=rmistry@google.com Review URL: https://codereview.chromium.org/14863009 git-svn-id: http://skia.googlecode.com/svn/trunk@9056 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: now that we use MD5 instead of CityHash, the JSON should say soGravatar epoger@google.com2013-05-07
| | | | | | | | | | (this should have been part of https://code.google.com/p/skia/source/detail?r=8992 ) R=bungeman@google.com Review URL: https://codereview.chromium.org/14758003 git-svn-id: http://skia.googlecode.com/svn/trunk@9038 2bbb7eff-a529-9590-31e7-b0007b416f81
* SkBitmapHasher: use 64-bit-truncated MD5 instead of 64-bit CityHashGravatar epoger@google.com2013-05-03
| | | | | | | | | | | | | | BUG=https://code.google.com/p/skia/issues/detail?id=1257 (if we change our mind within the next few days, we can toggle the BITMAPHASHER_USES_TRUNCATED_MD5 #ifdef ; at some point, we'll remove that option so we can delete our CityHash implementation entirely) R=bungeman@google.com Review URL: https://codereview.chromium.org/14054012 git-svn-id: http://skia.googlecode.com/svn/trunk@8992 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM self-tests: always run all tests (don't stop at first failure)Gravatar epoger@google.com2013-04-26
| | | | | | | | | and make rebaseline.sh rebaseline all tests in one go. (RunBuilders:Skia_PerCommit_House_Keeping) Review URL: https://codereview.chromium.org/13979017 git-svn-id: http://skia.googlecode.com/svn/trunk@8881 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: specify that currently used checksums are CityHashes of SkBitmapsGravatar epoger@google.com2013-04-26
| | | | | | | | | (distinct from other hash algorithms we may switch to, or hashes of files such as PDFs that cannot be read into an SkBitmap) Review URL: https://codereview.chromium.org/14284018 git-svn-id: http://skia.googlecode.com/svn/trunk@8877 2bbb7eff-a529-9590-31e7-b0007b416f81
* Add option to specify defaults configs to --config flag in gm. This makes it ↵Gravatar bsalomon@google.com2013-04-24
| | | | | | | | easier to run gm defaults configs with a delta. Also make ~ exclude a config. Review URL: https://codereview.chromium.org/13842014 git-svn-id: http://skia.googlecode.com/svn/trunk@8842 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: add self-test that sets --readPath to a nonexistent directory pathGravatar epoger@google.com2013-04-12
| | | | | | Review URL: https://codereview.chromium.org/13844011 git-svn-id: http://skia.googlecode.com/svn/trunk@8664 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: allow caller to specify which result types trigger an errorGravatar epoger@google.com2013-04-12
| | | | | | Review URL: https://codereview.chromium.org/14187007 git-svn-id: http://skia.googlecode.com/svn/trunk@8652 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: print list of GMs run, even in non-verbose mode (rolls back part of r8600)Gravatar epoger@google.com2013-04-12
| | | | | | Review URL: https://codereview.chromium.org/14052003 git-svn-id: http://skia.googlecode.com/svn/trunk@8638 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: remove enableMissingWarning in favor of verbose flag, and trim output in ↵Gravatar epoger@google.com2013-04-10
| | | | | | | | nonverbose mode Review URL: https://codereview.chromium.org/14080003 git-svn-id: http://skia.googlecode.com/svn/trunk@8600 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm: hide list of tests with ignored errors, by defaultGravatar epoger@google.com2013-04-10
| | | | | | Review URL: https://codereview.chromium.org/13811031 git-svn-id: http://skia.googlecode.com/svn/trunk@8591 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm: record IntentionallySkipped testsGravatar epoger@google.com2013-04-10
| | | | | | Review URL: https://codereview.chromium.org/13663003 git-svn-id: http://skia.googlecode.com/svn/trunk@8586 2bbb7eff-a529-9590-31e7-b0007b416f81
* re-land r8535, now that src.chromium.org is back upGravatar epoger@google.com2013-04-04
| | | | | | Review URL: https://codereview.chromium.org/13662002 git-svn-id: http://skia.googlecode.com/svn/trunk@8538 2bbb7eff-a529-9590-31e7-b0007b416f81
* Revert r8535Gravatar epoger@google.com2013-04-04
| | | | git-svn-id: http://skia.googlecode.com/svn/trunk@8536 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm: report ExpectationsMismatch and RenderModeMismatch results separatelyGravatar epoger@google.com2013-04-04
| | | | | | Review URL: https://codereview.chromium.org/13650002 git-svn-id: http://skia.googlecode.com/svn/trunk@8535 2bbb7eff-a529-9590-31e7-b0007b416f81
* re-land r8514 without breaking 32-bit Mac compilersGravatar epoger@google.com2013-04-03
| | | | | | Review URL: https://codereview.chromium.org/13427004 git-svn-id: http://skia.googlecode.com/svn/trunk@8518 2bbb7eff-a529-9590-31e7-b0007b416f81
* roll out r8514Gravatar epoger@google.com2013-04-03
| | | | | | Review URL: https://codereview.chromium.org/13503003 git-svn-id: http://skia.googlecode.com/svn/trunk@8515 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm: display summary of all results by ErrorTypeGravatar epoger@google.com2013-04-03
| | | | | | | as discussed in https://codereview.chromium.org/12825005/#msg14 Review URL: https://codereview.chromium.org/12851022 git-svn-id: http://skia.googlecode.com/svn/trunk@8514 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm refactor: extract run_multiple_configs() and run_multiple_modes()Gravatar epoger@google.com2013-03-20
| | | | | | Review URL: https://codereview.chromium.org/12536007 git-svn-id: http://skia.googlecode.com/svn/trunk@8269 2bbb7eff-a529-9590-31e7-b0007b416f81
* Reland r8235 "Switch gm to use SkFlags."Gravatar scroggo@google.com2013-03-20
| | | | | | | | | | | | This time, using #if guards for gpuCacheSize consistently. Also fix some warnings. BUG=https://code.google.com/p/skia/issues/detail?id=1094 Review URL: https://codereview.chromium.org/12440052 git-svn-id: http://skia.googlecode.com/svn/trunk@8254 2bbb7eff-a529-9590-31e7-b0007b416f81
* Revert "Make gm use SkFlags."Gravatar scroggo@google.com2013-03-19
| | | | | | | | | | Fix the build. This reverts commit 6f1fe2aee39308fc56854b062be244a904c209e7. Review URL: https://codereview.chromium.org/12709005 git-svn-id: http://skia.googlecode.com/svn/trunk@8236 2bbb7eff-a529-9590-31e7-b0007b416f81
* Make gm use SkFlags.Gravatar scroggo@google.com2013-03-19
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | Make flag parser its own project. It is still in the tools folder, but can now be used by other projects. Some changes to behavior in order to work with SkFlags: enable-missing-warning and disable-missing-warning have become enableMissingWarning and noenableMissingWarning. exclude-config is now excludeConfig --config now can only be listed once, but all configs listed after it will be included (same with excludeConfig and match). In addition, writeJsonSummary has been changed to writeJsonSummaryPath for consistency with other path flags. Provide an option to SkFlags to provide a short name, and use it for the flags which have short names. --tileGridReplayScales now takes space separated arguments, like other inputs. BUG=https://code.google.com/p/skia/issues/detail?id=1094 Review URL: https://codereview.chromium.org/12632015 git-svn-id: http://skia.googlecode.com/svn/trunk@8235 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm: write all messages to stdout/stderr with "GM:" preamble to distinguish ↵Gravatar epoger@google.com2013-03-13
| | | | | | | | from various debug messages coming from elsewhere Review URL: https://codereview.chromium.org/12691009 git-svn-id: http://skia.googlecode.com/svn/trunk@8126 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm self-test: make all test cases exercise transparencyGravatar epoger@google.com2013-03-02
| | | | | | | BUG=https://code.google.com/p/skia/issues/detail?id=1142 Review URL: https://codereview.chromium.org/12379047 git-svn-id: http://skia.googlecode.com/svn/trunk@7943 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm self-test: disable spuriously-failing aaclip testsGravatar epoger@google.com2013-03-01
| | | | | | Review URL: https://codereview.chromium.org/12377049 git-svn-id: http://skia.googlecode.com/svn/trunk@7927 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm self-test: fix results that break housekeeping botGravatar epoger@google.com2013-03-01
| | | | | | Review URL: https://codereview.chromium.org/12393011 git-svn-id: http://skia.googlecode.com/svn/trunk@7926 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm self-test: use a pathologically simple test case instead of dashing2Gravatar commit-bot@chromium.org2013-03-01
| | | | | | | | BUG=https://code.google.com/p/skia/issues/detail?id=677 Review URL: https://chromiumcodereview.appspot.com/12381038 git-svn-id: http://skia.googlecode.com/svn/trunk@7922 2bbb7eff-a529-9590-31e7-b0007b416f81
* Fix GM self-test expectations, mkIIGravatar borenet@google.com2013-02-21
| | | | | | Review URL: https://codereview.appspot.com/7393046 git-svn-id: http://skia.googlecode.com/svn/trunk@7815 2bbb7eff-a529-9590-31e7-b0007b416f81
* Fix GM self-test expectationsGravatar borenet@google.com2013-02-21
| | | | | | Review URL: https://codereview.appspot.com/7386048 git-svn-id: http://skia.googlecode.com/svn/trunk@7814 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm: Add ability to compare against checksums (as opposed to image files)Gravatar epoger@google.com2013-02-13
| | | | | | Review URL: https://codereview.appspot.com/7306071 git-svn-id: http://skia.googlecode.com/svn/trunk@7724 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm self-tests: generate JSON expectations, in addition to image expectationsGravatar epoger@google.com2013-02-06
| | | | | | Review URL: https://codereview.appspot.com/7310050 git-svn-id: http://skia.googlecode.com/svn/trunk@7624 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm self-tests: add 565 mode testing, in addition to 8888 modeGravatar epoger@google.com2013-01-31
| | | | | | Review URL: https://codereview.appspot.com/7229061 git-svn-id: http://skia.googlecode.com/svn/trunk@7489 2bbb7eff-a529-9590-31e7-b0007b416f81
* Fix bugs in r7291Gravatar epoger@google.com2013-01-19
| | | | | | | TBR=reed Review URL: https://codereview.appspot.com/7129057 git-svn-id: http://skia.googlecode.com/svn/trunk@7292 2bbb7eff-a529-9590-31e7-b0007b416f81
* re-land r7258 with fixes and testsGravatar epoger@google.com2013-01-19
| | | | | | | | BUG=http://code.google.com/p/skia/issues/detail?id=1079 TBR=reed Review URL: https://codereview.appspot.com/7132060 git-svn-id: http://skia.googlecode.com/svn/trunk@7291 2bbb7eff-a529-9590-31e7-b0007b416f81
* Roll out r7258Gravatar epoger@google.com2013-01-18
| | | | | | | | BUG=http://code.google.com/p/skia/issues/detail?id=1079 TBR=robertphillips Review URL: https://codereview.appspot.com/7138065 git-svn-id: http://skia.googlecode.com/svn/trunk@7289 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm self-test: followup to r7284Gravatar epoger@google.com2013-01-18
| | | | | | | TBR=rmistry Review URL: https://codereview.appspot.com/7128056 git-svn-id: http://skia.googlecode.com/svn/trunk@7286 2bbb7eff-a529-9590-31e7-b0007b416f81