aboutsummaryrefslogtreecommitdiffhomepage
path: root/gm/tests
Commit message (Collapse)AuthorAge
* make gm self-tests launch python unittests automaticallyGravatar epoger2014-07-16
| | | | | | | | | | | | | | | | (not just within the rebaseline_server subdirectory) Generally useful, but needed asap for my work on http://skbug.com/2752 ('split existing "gpu" GM results into "gl" and "gles"') BUG=skia:677 NOTREECHECKS=True NOTRY=True R=rmistry@google.com TBR=rmistry Author: epoger@google.com Review URL: https://codereview.chromium.org/398043002
* add some .gitignores related to gm and toolsGravatar commit-bot@chromium.org2014-04-11
| | | | | | | | | | | | | NOTREECHECKS=True NOTRY=True R=scroggo@google.com TBR=scroggo Author: epoger@google.com Review URL: https://codereview.chromium.org/234603004 git-svn-id: http://skia.googlecode.com/svn/trunk@14150 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm self-test: stop checking stdout and stderrGravatar commit-bot@chromium.org2014-02-05
| | | | | | | | | | | | BUG=skia:1568 NOTRY=True R=bsalomon@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/156023002 git-svn-id: http://skia.googlecode.com/svn/trunk@13324 2bbb7eff-a529-9590-31e7-b0007b416f81
* make GM self-test run gm/rebaseline_server unittestsGravatar commit-bot@chromium.org2014-01-24
| | | | | | | | | | R=borenet@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/143983017 git-svn-id: http://skia.googlecode.com/svn/trunk@13170 2bbb7eff-a529-9590-31e7-b0007b416f81
* make ignored-tests.txt specify full test name, not partial nameGravatar commit-bot@chromium.org2014-01-14
| | | | | | | | | | | BUG=skia:2022 R=bsalomon@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/136883006 git-svn-id: http://skia.googlecode.com/svn/trunk@13060 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: run mode comparisons for all raster configs.Gravatar commit-bot@chromium.org2014-01-13
| | | | | | | | | | | | | | | | | | | | | | GM works like this today: - Test all enabled configs directly - Render into 8888 - Test all enabled modes against that 8888. This change makes it do this: - Test all enabled configs directly - for each config, if it's raster, test all enabled modes against its output. Upshot is, we now check that picture draws identically to raster for 565 too, not just 8888. optimizations-565 is correctly failing. BUG=skia:1994 R=epoger@google.com, reed@google.com Author: mtklein@google.com Review URL: https://codereview.chromium.org/129203002 git-svn-id: http://skia.googlecode.com/svn/trunk@13050 2bbb7eff-a529-9590-31e7-b0007b416f81
* fix gm self-testGravatar commit-bot@chromium.org2014-01-08
| | | | | | | | | | | | | | BUG=skia:1971 NOTREECHECKS=True NOTRY=True R=caryclark@google.com TBR=caryclark Author: epoger@google.com Review URL: https://codereview.chromium.org/128793002 git-svn-id: http://skia.googlecode.com/svn/trunk@12964 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline gm self-tests after ↵Gravatar commit-bot@chromium.org2014-01-03
| | | | | | | | | | | | | | | | | https://code.google.com/p/skia/source/detail?r=12850 The GM self-test's fragility is already noted in https://code.google.com/p/skia/issues/detail?id=1068 ('make gm self-test more robust') NOTRY=True NOTREECHECKS=True R=mtklein@google.com TBR=mtklein Author: epoger@google.com Review URL: https://codereview.chromium.org/112203006 git-svn-id: http://skia.googlecode.com/svn/trunk@12885 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: remove deprecated --ignoreTests flagGravatar epoger@google.com2013-10-21
| | | | | | | | | BUG=skia:1730 R=borenet@google.com Review URL: https://codereview.chromium.org/27983004 git-svn-id: http://skia.googlecode.com/svn/trunk@11887 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: add --ignoreFailuresFile as an alternative to --ignoreTestsGravatar epoger@google.com2013-10-18
| | | | | | | | | | | | | | (moved from old review at https://codereview.chromium.org/27752002/ ) This will allow the user to specify the tests to ignore failure on as a file, rather than listing them out in the command line (and thus busting the line length limit on Android). BUG=skia:1730 R=scroggo@google.com Review URL: https://codereview.chromium.org/29203002 git-svn-id: http://skia.googlecode.com/svn/trunk@11855 2bbb7eff-a529-9590-31e7-b0007b416f81
* Update Housekeeper-PerCommit after adding a new type of gm result.Gravatar edisonn@google.com2013-10-14
| | | | | | | | R=epoger@google.com Review URL: https://codereview.chromium.org/27191002 git-svn-id: http://skia.googlecode.com/svn/trunk@11753 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm: if test has no expectations, record its result as no-expectations ↵Gravatar epoger@google.com2013-10-10
| | | | | | | | | | | | | | | | regardless of ignoreFailure After https://code.google.com/p/skia/source/detail?r=11640 ('Ignore any pdf-poppler GM failures'), there are a bunch of pdf-poppler tests showing up as failure-ignored at http://c128.i.corp.google.com/production-gm-diffs/latest/view.html Make them go away. R=scroggo@google.com Review URL: https://codereview.chromium.org/26650005 git-svn-id: http://skia.googlecode.com/svn/trunk@11703 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: Allow ignored-tests.txt to list configs as well as tests (and ↵Gravatar epoger@google.com2013-10-07
| | | | | | | | | | | | | | | combinations too) BUG=skia:1657 This will allow us to ignore poppler failures until bug 1657 is resolved (but this CL doesn't actually make that change to ignored-tests.txt yet) R=scroggo@google.com Review URL: https://codereview.chromium.org/26294004 git-svn-id: http://skia.googlecode.com/svn/trunk@11639 2bbb7eff-a529-9590-31e7-b0007b416f81
* revert temporary r11517Gravatar epoger@google.com2013-09-30
| | | | | | Review URL: https://codereview.chromium.org/25215002 git-svn-id: http://skia.googlecode.com/svn/trunk@11518 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm: temporarily re-enable multiple rendermodes, to make sure they haven't ↵Gravatar epoger@google.com2013-09-30
| | | | | | | | regressed Review URL: https://codereview.chromium.org/25213002 git-svn-id: http://skia.googlecode.com/svn/trunk@11517 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm: add --ignoreTests flagGravatar epoger@google.com2013-09-19
| | | | | | | | | BUG=skia:1600 R=scroggo@google.com Review URL: https://codereview.chromium.org/23526065 git-svn-id: http://skia.googlecode.com/svn/trunk@11374 2bbb7eff-a529-9590-31e7-b0007b416f81
* revert temporary r11371Gravatar epoger@google.com2013-09-19
| | | | | | | | BUG=skia:1641 Review URL: https://codereview.chromium.org/24256003 git-svn-id: http://skia.googlecode.com/svn/trunk@11373 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm: temporarily re-enable multiple rendermodes, to make sure they haven't ↵Gravatar epoger@google.com2013-09-19
| | | | | | | | | | regressed BUG=skia:1641 Review URL: https://codereview.chromium.org/24153020 git-svn-id: http://skia.googlecode.com/svn/trunk@11371 2bbb7eff-a529-9590-31e7-b0007b416f81
* Speed up GM ~50% by NOT running most renderModes by defaultGravatar epoger@google.com2013-09-13
| | | | | | | | | BUG=skia:1566 R=borenet@google.com, bsalomon@google.com Review URL: https://codereview.chromium.org/23889030 git-svn-id: http://skia.googlecode.com/svn/trunk@11265 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm: add self-test to confirm that ignore-failure field is respectedGravatar epoger@google.com2013-08-30
| | | | | | | | | BUG=skia:1578 R=scroggo@google.com Review URL: https://codereview.chromium.org/23799004 git-svn-id: http://skia.googlecode.com/svn/trunk@11047 2bbb7eff-a529-9590-31e7-b0007b416f81
* Update expectations for Mac PDFGravatar vandebo@chromium.org2013-08-21
| | | | | | | | R=epoger@google.com, vandebo@chromium.org Review URL: https://codereview.chromium.org/22865029 git-svn-id: http://skia.googlecode.com/svn/trunk@10863 2bbb7eff-a529-9590-31e7-b0007b416f81
* Support multiple PDF rendering backends in the GMGravatar vandebo@chromium.org2013-08-20
| | | | | | | | R=epoger@google.com, vandebo@chromium.org Review URL: https://codereview.chromium.org/21669004 git-svn-id: http://skia.googlecode.com/svn/trunk@10841 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: stop recording all *_pdf.png results as "INVALID" on non-Mac platformsGravatar epoger@google.com2013-07-08
| | | | | | | | | BUG=https://code.google.com/p/skia/issues/detail?id=1352 R=edisonn@google.com Review URL: https://codereview.chromium.org/17366003 git-svn-id: http://skia.googlecode.com/svn/trunk@9912 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: add --missingExpectationsPath option, similar to --mismatchPathGravatar epoger@google.com2013-06-21
| | | | | | | | | | | This will allow us to make the buildbots record all images EXCEPT those which match expectations to Google Storage. R=borenet@google.com Review URL: https://codereview.chromium.org/17552012 git-svn-id: http://skia.googlecode.com/svn/trunk@9725 2bbb7eff-a529-9590-31e7-b0007b416f81
* Reland r9682, using new SkString::appendU64()Gravatar epoger@google.com2013-06-19
| | | | | | Review URL: https://codereview.chromium.org/17157005 git-svn-id: http://skia.googlecode.com/svn/trunk@9687 2bbb7eff-a529-9590-31e7-b0007b416f81
* Reverting r9682, which broke on some compilersGravatar epoger@google.com2013-06-19
| | | | git-svn-id: http://skia.googlecode.com/svn/trunk@9684 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: add --writeChecksumBasedFilenames option Gravatar epoger@google.com2013-06-19
| | | | | | | | | | | as needed for Step 2 of https://goto.google.com/ChecksumTransitionDetail : make GenerateGMs upload actual images to Google Storage instead of skia-autogen R=scroggo@google.com Review URL: https://codereview.chromium.org/17365002 git-svn-id: http://skia.googlecode.com/svn/trunk@9682 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: create GmResultDigest that encapsulates digest type ("bitmap-64bitMD5") ↵Gravatar epoger@google.com2013-05-24
| | | | | | | | | | and value (12345) R=scroggo@google.com Review URL: https://codereview.chromium.org/15883004 git-svn-id: http://skia.googlecode.com/svn/trunk@9271 2bbb7eff-a529-9590-31e7-b0007b416f81
* Improve tool that analyzes gm JSON summaryGravatar epoger@google.com2013-05-21
| | | | | | | | | BUG=https://code.google.com/p/skia/issues/detail?id=1300 R=borenet@google.com Review URL: https://codereview.chromium.org/15298010 git-svn-id: http://skia.googlecode.com/svn/trunk@9217 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM self-tests: add testing for non --hierarchy caseGravatar epoger@google.com2013-05-21
| | | | | | | | R=scroggo@google.com Review URL: https://codereview.chromium.org/15397007 git-svn-id: http://skia.googlecode.com/svn/trunk@9214 2bbb7eff-a529-9590-31e7-b0007b416f81
* Add gm/confirm_no_failures_in_json.pyGravatar epoger@google.com2013-05-14
| | | | | | | | | | | The CompareGMs step will use this (instead of running skdiff over the image files) to decide whether to go red or green. R=rmistry@google.com Review URL: https://codereview.chromium.org/15100003 git-svn-id: http://skia.googlecode.com/svn/trunk@9127 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: include filename extension (.png) of each output file in JSON summaryGravatar epoger@google.com2013-05-14
| | | | | | | | | | | | Doing this so that, once we *do* start writing PDF checksums into the JSON summary, we'll be able to distinguish those from the PNG checksums. Otherwise, we could have naming collisions. R=scroggo@google.com Review URL: https://codereview.chromium.org/14890017 git-svn-id: http://skia.googlecode.com/svn/trunk@9119 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM self-test: add --writePath and --mismatchPath , but in a way that works ↵Gravatar epoger@google.com2013-05-09
| | | | | | | | | | cross-platform R=scroggo@google.com Review URL: https://codereview.chromium.org/15085007 git-svn-id: http://skia.googlecode.com/svn/trunk@9077 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM self-test: add option to exercise --writePath and --mismatchPath, but not ↵Gravatar epoger@google.com2013-05-08
| | | | | | | | | | | | on bots (individual developers can set WRITE_IMAGE_FILES=1 for local testing) R=rmistry@google.com Review URL: https://codereview.chromium.org/14863009 git-svn-id: http://skia.googlecode.com/svn/trunk@9056 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: now that we use MD5 instead of CityHash, the JSON should say soGravatar epoger@google.com2013-05-07
| | | | | | | | | | (this should have been part of https://code.google.com/p/skia/source/detail?r=8992 ) R=bungeman@google.com Review URL: https://codereview.chromium.org/14758003 git-svn-id: http://skia.googlecode.com/svn/trunk@9038 2bbb7eff-a529-9590-31e7-b0007b416f81
* SkBitmapHasher: use 64-bit-truncated MD5 instead of 64-bit CityHashGravatar epoger@google.com2013-05-03
| | | | | | | | | | | | | | BUG=https://code.google.com/p/skia/issues/detail?id=1257 (if we change our mind within the next few days, we can toggle the BITMAPHASHER_USES_TRUNCATED_MD5 #ifdef ; at some point, we'll remove that option so we can delete our CityHash implementation entirely) R=bungeman@google.com Review URL: https://codereview.chromium.org/14054012 git-svn-id: http://skia.googlecode.com/svn/trunk@8992 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM self-tests: always run all tests (don't stop at first failure)Gravatar epoger@google.com2013-04-26
| | | | | | | | | and make rebaseline.sh rebaseline all tests in one go. (RunBuilders:Skia_PerCommit_House_Keeping) Review URL: https://codereview.chromium.org/13979017 git-svn-id: http://skia.googlecode.com/svn/trunk@8881 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: specify that currently used checksums are CityHashes of SkBitmapsGravatar epoger@google.com2013-04-26
| | | | | | | | | (distinct from other hash algorithms we may switch to, or hashes of files such as PDFs that cannot be read into an SkBitmap) Review URL: https://codereview.chromium.org/14284018 git-svn-id: http://skia.googlecode.com/svn/trunk@8877 2bbb7eff-a529-9590-31e7-b0007b416f81
* Add option to specify defaults configs to --config flag in gm. This makes it ↵Gravatar bsalomon@google.com2013-04-24
| | | | | | | | easier to run gm defaults configs with a delta. Also make ~ exclude a config. Review URL: https://codereview.chromium.org/13842014 git-svn-id: http://skia.googlecode.com/svn/trunk@8842 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: add self-test that sets --readPath to a nonexistent directory pathGravatar epoger@google.com2013-04-12
| | | | | | Review URL: https://codereview.chromium.org/13844011 git-svn-id: http://skia.googlecode.com/svn/trunk@8664 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: allow caller to specify which result types trigger an errorGravatar epoger@google.com2013-04-12
| | | | | | Review URL: https://codereview.chromium.org/14187007 git-svn-id: http://skia.googlecode.com/svn/trunk@8652 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: print list of GMs run, even in non-verbose mode (rolls back part of r8600)Gravatar epoger@google.com2013-04-12
| | | | | | Review URL: https://codereview.chromium.org/14052003 git-svn-id: http://skia.googlecode.com/svn/trunk@8638 2bbb7eff-a529-9590-31e7-b0007b416f81
* GM: remove enableMissingWarning in favor of verbose flag, and trim output in ↵Gravatar epoger@google.com2013-04-10
| | | | | | | | nonverbose mode Review URL: https://codereview.chromium.org/14080003 git-svn-id: http://skia.googlecode.com/svn/trunk@8600 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm: hide list of tests with ignored errors, by defaultGravatar epoger@google.com2013-04-10
| | | | | | Review URL: https://codereview.chromium.org/13811031 git-svn-id: http://skia.googlecode.com/svn/trunk@8591 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm: record IntentionallySkipped testsGravatar epoger@google.com2013-04-10
| | | | | | Review URL: https://codereview.chromium.org/13663003 git-svn-id: http://skia.googlecode.com/svn/trunk@8586 2bbb7eff-a529-9590-31e7-b0007b416f81
* re-land r8535, now that src.chromium.org is back upGravatar epoger@google.com2013-04-04
| | | | | | Review URL: https://codereview.chromium.org/13662002 git-svn-id: http://skia.googlecode.com/svn/trunk@8538 2bbb7eff-a529-9590-31e7-b0007b416f81
* Revert r8535Gravatar epoger@google.com2013-04-04
| | | | git-svn-id: http://skia.googlecode.com/svn/trunk@8536 2bbb7eff-a529-9590-31e7-b0007b416f81
* gm: report ExpectationsMismatch and RenderModeMismatch results separatelyGravatar epoger@google.com2013-04-04
| | | | | | Review URL: https://codereview.chromium.org/13650002 git-svn-id: http://skia.googlecode.com/svn/trunk@8535 2bbb7eff-a529-9590-31e7-b0007b416f81
* re-land r8514 without breaking 32-bit Mac compilersGravatar epoger@google.com2013-04-03
| | | | | | Review URL: https://codereview.chromium.org/13427004 git-svn-id: http://skia.googlecode.com/svn/trunk@8518 2bbb7eff-a529-9590-31e7-b0007b416f81
* roll out r8514Gravatar epoger@google.com2013-04-03
| | | | | | Review URL: https://codereview.chromium.org/13503003 git-svn-id: http://skia.googlecode.com/svn/trunk@8515 2bbb7eff-a529-9590-31e7-b0007b416f81