aboutsummaryrefslogtreecommitdiffhomepage
path: root/gm/rebaseline_server
Commit message (Collapse)AuthorAge
* rebaseline_server: force checksumValue to an integer to prevent spurious ↵Gravatar epoger2014-08-20
| | | | | | | | | | | | | | | | | | comparison failures Without this change, SKP tests *appeared* to fail because the actuals reported their checksumValues as integers, while the expectations recorded their checksumValues as strings. NOTREECHECKS=true NOTRY=true R=stephana@google.com TBR=stephana (SkipBuildbotRuns) Author: epoger@google.com Review URL: https://codereview.chromium.org/489023003
* rebaseline_server: if creating brand new expectations files, include the headerGravatar epoger2014-08-20
| | | | | | | | | | | | | | Otherwise, the first time you compare against these expectations, you get failures. NOTREECHECKS=true NOTRY=true R=stephana@google.com TBR=stephana Author: epoger@google.com Review URL: https://codereview.chromium.org/491063002
* rebaseline_server: add download link for SKP diff patchfileGravatar epoger2014-08-20
| | | | | | | | | | | | | BUG=skia:1918 NOTREECHECKS=true NOTRY=true R=stephana@google.com TBR=stephana (SkipBuildbotRuns) Author: epoger@google.com Review URL: https://codereview.chromium.org/489183002
* rebaseline_server: allow users to generate SKP diff patches on a shared instanceGravatar epoger2014-08-20
| | | | | | | | | | | | | | | | | This will allow developers to maintain SKP baselines without ever running their own rebaseline_server instance! For now, the developer must manually apply the resulting patchset to his local Skia checkout to actually modify expectations; in the near future, we hope to make the UI upload the patchset to Rietveld on the user's behalf. BUG=skia:1918 NOTRY=true R=stephana@google.com, rmistry@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/487853004
* rebaseline_server: in Pending Approval tab, change expected/actual labels to ↵Gravatar epoger2014-08-19
| | | | | | | | | | | | | | old/new BUG=skia:1918 NOTREECHECKS=true NOTRY=true R=stephana@google.com TBR=stephana Author: epoger@google.com Review URL: https://codereview.chromium.org/484763004
* rebaseline_server: constrain setADir/setBDir to consistently refer to single ↵Gravatar epoger2014-08-18
| | | | | | | | | | | | | | | directories, not lists Before this CL, we supported multiple setADirs/setBDirs for some operations but not others... now we consistently support a single pair of directories. NOTRY=true R=stephana@google.com TBR=stephana Author: epoger@google.com Review URL: https://codereview.chromium.org/480293002
* This adds renderMode and builder as columns to the front end when looking at ↵Gravatar stephana2014-08-18
| | | | | | | | | | | | SKPs. BUG=skia:2833 NOTRY=true R=epoger@google.com Author: stephana@google.com Review URL: https://codereview.chromium.org/480153002
* This passes the URL of the diff image to the front-end, thus removing the ↵Gravatar stephana2014-08-15
| | | | | | | | | | | | | need to keep frontend code for URL generation in sync with the backend. BUG=skia: NOTREECHECKS=true NOTRY=true R=epoger@google.com Author: stephana@google.com Review URL: https://codereview.chromium.org/471033003
* rebaseline_server: show Pending Approval tab if viewing SKP expectations vs ↵Gravatar epoger2014-08-14
| | | | | | | | | | | | | actuals BUG=skia:1918 NOTREECHECKS=true NOTRY=true R=stephana@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/473973002
* rebaseline_server: include setA/setB descriptions in output JSONGravatar epoger2014-08-14
| | | | | | | | | | | | | | | | | | This is needed for rebaselining using the shared rebaseline_server instance: by telling the client which git revision was used to fetch expectations, we allow the client to pass that back along with new baselines (so the server knows which revision to patch). This is also handy in that it allows the server to tell the client more about the different result sets (which files they were generated from). BUG=skia:1918 NOTRY=true R=rmistry@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/474813002
* rebaseline_server UI: add link to raw JSONGravatar epoger2014-08-13
| | | | | | | | | | | | | patchset 3 from https://codereview.chromium.org/467843002 NOTREECHECKS=true NOTRY=true R=stephana@google.com TBR=stephana Author: epoger@google.com Review URL: https://codereview.chromium.org/475623002
* rebaseline_server: move more code into common path for GET_live_results and ↵Gravatar epoger2014-08-13
| | | | | | | | | | | | | | | | GET_prefetch_results patchset 1 from issue 467843002 BUG=skia:1918 NOTREECHECKS=true NOTRY=true R=stephana@google.com TBR=stephana Author: epoger@google.com Review URL: https://codereview.chromium.org/465143004
* This is a bit of a hack, but will work. I have a cleaner fix ready (but ↵Gravatar stephana2014-08-13
| | | | | | | | | | | | still need to fix some broken tests). BUG=skia: NOTRY=true R=epoger@google.com Author: stephana@google.com Review URL: https://codereview.chromium.org/472703002
* This eliminates the need to copy the generated images from a temporary ↵Gravatar stephana2014-08-13
| | | | | | | | | | | directory to the directory that is served by the rebaseline_server. BUG=skia:2815, skia:2818 R=epoger@google.com Author: stephana@google.com Review URL: https://codereview.chromium.org/457203003
* rebaseline_server: add some live-view.html links to index.htmlGravatar epoger2014-08-13
| | | | | | | | | | NOTREECHECKS=true NOTRY=true R=stephana@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/463213002
* rebaseline_server: periodically log tasks_queue sizeGravatar epoger2014-08-12
| | | | | | | | | | | Without this, it's hard to tell whether the server is stuck (or why it's taking so long). NOTRY=true R=stephana@google.com, rmistry@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/454953002
* change setA/setB labels if viewing actuals vs expectationsGravatar epoger2014-08-12
| | | | | | | | | NOTRY=true R=rmistry@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/451053004
* Rebaseline-server: sorting of columns in asc/desc order in frontend.Gravatar stephana2014-08-08
| | | | | | | | | | | NOTRY=true BUG=skia:1907 R=epoger@google.com Author: stephana@google.com Review URL: https://codereview.chromium.org/449843002
* don't list out all sourceSkpFile names in the rebaseline_server UIGravatar epoger2014-08-07
| | | | | | | | | | | | | | (the list is long and crowds out the results themselves; better to use a text filter to select the sourceSkpFiles of interest) R=stephana@google.com TBR=stephana NOTREECHECKS=true NOTRY=true Author: epoger@google.com Review URL: https://codereview.chromium.org/451853002
* make rebaseline_server properly handle unescaped URLsGravatar epoger2014-08-07
| | | | | | | | | | | R=rmistry@google.com TBR=rmistry NOTREECHECKS=true NOTRY=true Author: epoger@google.com Review URL: https://codereview.chromium.org/445753005
* rebaseline_server: allow live queries to examine JSONKEY_EXPECTEDRESULTS or ↵Gravatar epoger2014-08-07
| | | | | | | | | | | | | | JSONKEY_ACTUALRESULTS See https://goto.google.com/CorrectnessTestingBigIssues for full context BUG=skia:1942 NOTRY=true R=rmistry@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/453433004
* make the action buttons for rebaseline server stick to the top of the window ↵Gravatar humper2014-08-06
| | | | | | | | | | | | | as you scroll NOTRY=true BUG=skia:1912 R=stephana@google.com, epoger@google.com Author: humper@google.com Review URL: https://codereview.chromium.org/446933002
* rebaseline_server: add "prefetch" directive that just warms the cache ↵Gravatar epoger2014-08-06
| | | | | | | | | | | | | | | | | | without awaiting results This will allow the buildbots to warn the production rebaseline_server: "I just generated some new results; here's a comparison that a human might ask for soon. Download whatever images and generate whatever diffs you would need to provide those results." BUG=skia:1942 NOTREECHECKS=true NOTRY=true R=rmistry@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/443013002
* rebaseline_server live queries: allow comparison against summary files ↵Gravatar epoger2014-08-06
| | | | | | | | | | | | | | | | | | within the Skia repo This is a step towards providing SKP comparisons against expectations, not just other actual results... we still need to allow the user to select JSONKEY_EXPECTEDRESULTS vs JSONKEY_ACTUALRESULTS within the summary files found. BUG=skia:1942 NOTREECHECKS=true NOTRY=true R=rmistry@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/442203002
* teach rebaseline_server to generate diffs of rendered SKPsGravatar epoger2014-08-05
| | | | | | | | | | | | Creates a new live-view.html page, served by the rebaseline_server, that will display diffs between two sets of rendered SKP images. BUG=skia:1942 NOTRY=true R=rmistry@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/424263005
* combine base_unittest.py modules from gm and toolsGravatar epoger2014-07-17
| | | | | | | | | | general cleanup, which will also help with http://skbug.com/2752 ('split existing "gpu" GM results into "gl" and "gles"') R=rmistry@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/397103003
* roll common DEPS, now using recursedepsGravatar epoger2014-07-16
| | | | | | | | | BUG=skia:2618 R=borenet@google.com, cmp@chromium.org Author: epoger@google.com Review URL: https://codereview.chromium.org/392353003
* make gm self-tests launch python unittests automaticallyGravatar epoger2014-07-16
| | | | | | | | | | | | | | | | (not just within the rebaseline_server subdirectory) Generally useful, but needed asap for my work on http://skbug.com/2752 ('split existing "gpu" GM results into "gl" and "gles"') BUG=skia:677 NOTREECHECKS=True NOTRY=True R=rmistry@google.com TBR=rmistry Author: epoger@google.com Review URL: https://codereview.chromium.org/398043002
* roll "common" DEPS, and replace tools/pyutils with itGravatar epoger2014-07-11
| | | | | | | | | BUG=skia:2682 R=borenet@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/385783002
* rebaseline_server: cache results in long-running ImageDiffDB instanceGravatar epoger2014-07-09
| | | | | | | | | | | | | | Rather than rebuilding the ImageDiffDB from scratch every time we update expected/actual results, keep the same ImageDiffDB instance around and add image pairs to it. This makes updating results within a long-running server.py *much* faster, and tests out an idea I'm ruminating in https://goto.google.com/LongRunningImageDiffDBServer : we could run an ImageDiffDB server that developers could connect to from their locally running rebaseline_server instances, for much faster launch times. BUG=skia:2414 NOTRY=True R=rmistry@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/379563005
* rebaseline_server: allow JSON to control column filteringGravatar epoger2014-07-09
| | | | | | | | | | | | | | | | Makes the rebaseline_server client more generic, allowing the server to tweak display properties by writing directives into the JSON file. Adds two new fields to the rebaseline_server JSON file (and thus increments VALUE__HEADER__SCHEMA_VERSION): 1. KEY__ROOT__EXTRACOLUMNORDER: order in which the client should display columns 2. KEY__EXTRACOLUMNHEADERS__USE_FREEFORM_FILTER: whether a column should be filtered using a freeform text field or checkboxes BUG=skia:2230 NOTRY=True R=rmistry@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/376623002
* rebaseline_server: handle column filtering more genericallyGravatar epoger2014-07-07
| | | | | | | | | | | This is a step towards making rebaseline_server more flexible, and useful for displaying output of the cluster telemetry server as well as actuals-on-configA-vs-actuals-on-configB. BUG=skia:2230 R=rmistry@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/369133004
* rebaseline_server: if urlSchemaVersion is not specified, assume currentGravatar epoger2014-07-03
| | | | | | | | | | | | | | | Modification to https://codereview.chromium.org/368933002/ ('rebaseline_server: add urlSchemaVersion parameter') Means we don't need https://codereview.chromium.org/367173002/ ('add urlSchemaVersion to rebaseline_server link on buildbot console page') NOTREECHECKS=True NOTRY=True R=borenet@google.com TBR=borenet Author: epoger@google.com Review URL: https://codereview.chromium.org/364253003
* rebaseline_server: add urlSchemaVersion parameterGravatar epoger2014-07-02
| | | | | | | | | | | | In https://codereview.chromium.org/369473005 ('rebaseline_server: handle category filtering more generically'), I am changing the meaning of some URL parameters. If a user pastes an old URL into an updated rebaseline_server instance, they may get unexpected results. Adding a urlSchemaVersion parameter allows us to automatically convert the URL, or at least warn the user. BUG=skia:2230 NOTRY=True R=jcgregorio@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/368933002
* rebaseline_server: use just skpdiff, not Python Image LibraryGravatar epoger2014-07-02
| | | | | | | | | BUG=skia:2414 R=djsollen@google.com, borenet@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/325413003
* Drop --clone from commands in skia repo.Gravatar Mike Klein2014-06-27
| | | | | | | | | | | --clone, and SkPicture::clone(), are no longer. CQ_EXTRA_TRYBOTS=tryserver.skia:Housekeeper-PerCommit-Trybot BUG=skia: R=rmistry@google.com Review URL: https://codereview.chromium.org/343813006
* rebaseline_server: delete no-longer-used weightedDiffMeasureGravatar epoger2014-06-11
| | | | | | | | | | | | (replaced by perceptual diff) NOTRY=True R=rmistry@google.com TBR=rmistry Author: epoger@google.com Review URL: https://codereview.chromium.org/334533003
* rebaseline_server: change 2 image expectations within unittestsGravatar epoger2014-06-11
| | | | | | | | | | NOTRY=True R=rmistry@google.com TBR=rmistry Author: epoger@google.com Review URL: https://codereview.chromium.org/329933002
* rebaseline_server: merge identical results (across multiple ↵Gravatar epoger2014-06-11
| | | | | | | | | | | builders/configs) into a single row BUG=skia:2534 R=jcgregorio@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/326013002
* reland "rebaseline_server: download actual-results.json files from GCS ↵Gravatar epoger2014-06-05
| | | | | | | | | | | | | instead of SVN" relands https://codereview.chromium.org/310093003 with modifications. BUG=skia:2641 R=jcgregorio@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/313343003
* Revert "rebaseline_server: download actual-results.json files from GCS ↵Gravatar epoger2014-06-04
| | | | | | | | | | | | | | | | instead of SVN" This reverts commit f4666045f378dee22ce40108e90bf5195634ebfc. BUG=skia:2641 NOTREECHECKS=True NOTRY=True R=jcgregorio@google.com TBR=jcgregorio Author: epoger@google.com Review URL: https://codereview.chromium.org/317783004
* rebaseline_server: download actual-results.json files from GCS instead of SVNGravatar epoger2014-06-04
| | | | | | | | | BUG=skia:553 R=borenet@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/310093003
* download_actuals.py: download JSON files from Google Storage instead of ↵Gravatar epoger2014-06-03
| | | | | | | | | | | | | skia-autogen uses google-api-python-client instead of gsutil binary to interact with Google Storage BUG=skia:553 R=rmistry@google.com, bensong@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/309653005
* rebaseline_server: apply ignored-tests.txt within rebaseline_server, not ↵Gravatar commit-bot@chromium.org2014-05-14
| | | | | | | | | | | | | | | | just on the bots (SkipBuildbotRuns) BUG=skia:2514 NOTREECHECKS=True NOTRY=True R=rmistry@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/287623006 git-svn-id: http://skia.googlecode.com/svn/trunk@14740 2bbb7eff-a529-9590-31e7-b0007b416f81
* rename rebaseline_server JSON constants to be more consistentGravatar commit-bot@chromium.org2014-05-12
| | | | | | | | | | | | | | | (no behavioral change, no change to JSON file format) (SkipBuildbotRuns) NOTREECHECKS=True NOTRY=True R=rmistry@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/287473002 git-svn-id: http://skia.googlecode.com/svn/trunk@14701 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline_server JSON: pass category values as values, not keysGravatar commit-bot@chromium.org2014-05-08
| | | | | | | | | | | | BUG=skia:1758 NOTRY=True R=borenet@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/270413002 git-svn-id: http://skia.googlecode.com/svn/trunk@14658 2bbb7eff-a529-9590-31e7-b0007b416f81
* rebaseline_server: add link to other result sets from main UIGravatar commit-bot@chromium.org2014-05-08
| | | | | | | | | | | | | | | BUG=skia:2529 NOTREECHECKS=True NOTRY=True (SkipBuildbotRuns) R=caryclark@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/267363010 git-svn-id: http://skia.googlecode.com/svn/trunk@14648 2bbb7eff-a529-9590-31e7-b0007b416f81
* make compare_rendered_pictures_test.py run end-to-end testGravatar commit-bot@chromium.org2014-05-07
| | | | | | | | | | | | | | | | 1. generate test SKPs using skpmaker 2. render those SKPs using render_pictures 3. compare results using compare_rendered_pictures.py BUG=skia:1942,skia:2230 NOTRY=True R=borenet@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/274623002 git-svn-id: http://skia.googlecode.com/svn/trunk@14624 2bbb7eff-a529-9590-31e7-b0007b416f81
* make compare_rendered_pictures process render_pictures's new JSON output formatGravatar commit-bot@chromium.org2014-05-06
| | | | | | | | | | | | BUG=skia:1942,skia:2230 NOTRY=True R=borenet@google.com Author: epoger@google.com Review URL: https://codereview.chromium.org/265793013 git-svn-id: http://skia.googlecode.com/svn/trunk@14591 2bbb7eff-a529-9590-31e7-b0007b416f81
* tweaks to tab CSS for rebaseline server page; moar prettyGravatar commit-bot@chromium.org2014-05-01
| | | | | | | | | | | BUG=skia: R=epoger@google.com Author: humper@google.com Review URL: https://codereview.chromium.org/264853004 git-svn-id: http://skia.googlecode.com/svn/trunk@14512 2bbb7eff-a529-9590-31e7-b0007b416f81