aboutsummaryrefslogtreecommitdiffhomepage
path: root/tools/skpbench/skpbench.py
Commit message (Collapse)AuthorAge
* skpbench: Support .svg filesGravatar Chris Dalton2018-06-26
| | | | | | | | Bug: skia: Change-Id: I0337757f635c631870c02a65f8784fc190d1435e Reviewed-on: https://skia-review.googlesource.com/137540 Commit-Queue: Chris Dalton <csmartdalton@google.com> Reviewed-by: Robert Phillips <robertphillips@google.com>
* Add --gpuThreads support to skpbench.py (take 2)Gravatar Robert Phillips2018-06-26
| | | | | | | Change-Id: Ie946ff339c4e04bb866545ad60c2ab77bae85417 Reviewed-on: https://skia-review.googlesource.com/136175 Reviewed-by: Chris Dalton <csmartdalton@google.com> Commit-Queue: Robert Phillips <robertphillips@google.com>
* Revert "Add --gpuThreads support to skpbench.py"Gravatar Robert Phillips2018-06-13
| | | | | | | | | | | | | | | | | | | | | | | | This reverts commit 2f14f21acbd291933e13e8eef822fd222d20c677. Reason for revert: python Original change's description: > Add --gpuThreads support to skpbench.py > > Change-Id: Ib5c7ed0fd28ebf734168bc0377d643bbddf70e65 > Reviewed-on: https://skia-review.googlesource.com/134601 > Reviewed-by: Greg Daniel <egdaniel@google.com> > Commit-Queue: Robert Phillips <robertphillips@google.com> TBR=egdaniel@google.com,robertphillips@google.com Change-Id: I428a8b6d7cf945c8609a36cf5c912d6ebc517201 No-Presubmit: true No-Tree-Checks: true No-Try: true Reviewed-on: https://skia-review.googlesource.com/134640 Reviewed-by: Robert Phillips <robertphillips@google.com> Commit-Queue: Robert Phillips <robertphillips@google.com>
* Add --gpuThreads support to skpbench.pyGravatar Robert Phillips2018-06-13
| | | | | | | Change-Id: Ib5c7ed0fd28ebf734168bc0377d643bbddf70e65 Reviewed-on: https://skia-review.googlesource.com/134601 Reviewed-by: Greg Daniel <egdaniel@google.com> Commit-Queue: Robert Phillips <robertphillips@google.com>
* Add DDL skpbench bot for just DDL recording timeGravatar Robert Phillips2018-05-31
| | | | | | | | Change-Id: If75799bfd719ccc47c2064571723e6852c07bfaa Reviewed-on: https://skia-review.googlesource.com/131144 Commit-Queue: Robert Phillips <robertphillips@google.com> Reviewed-by: Eric Boren <borenet@google.com> Reviewed-by: Kevin Lubick <kjlubick@google.com>
* Add DDL parameters to skpbench.pyGravatar Robert Phillips2018-05-31
| | | | | | | | | This needs to land before https://skia-review.googlesource.com/c/skia/+/130923 (Add a DDL Skpbench bot) Change-Id: I50a6308350fd62c696eedd0fdccd42dd7dfb0d53 Reviewed-on: https://skia-review.googlesource.com/131102 Commit-Queue: Robert Phillips <robertphillips@google.com> Reviewed-by: Eric Boren <borenet@google.com>
* skpbench: Add support for Pixel 2Gravatar Chris Dalton2018-04-30
| | | | | | | | Bug: skia: Change-Id: Ic0901ca84bf8e3fda29b3bd7a0504396445ca0f4 Reviewed-on: https://skia-review.googlesource.com/124282 Reviewed-by: Kevin Lubick <kjlubick@google.com> Commit-Queue: Chris Dalton <csmartdalton@google.com>
* skpbench: always reboot instead of unlocking clocksGravatar Chris Dalton2017-10-24
| | | | | | | | Bug: skia: Change-Id: I2589c672823f1da8ea136e90fa083431b4f2e3b2 Reviewed-on: https://skia-review.googlesource.com/62945 Reviewed-by: Kevin Lubick <kjlubick@google.com> Commit-Queue: Chris Dalton <csmartdalton@google.com>
* skpbench: support pixel phoneGravatar Chris Dalton2017-10-20
| | | | | | | | | | Adds a script for pixel hardware with conservatively low clocks. Bug: skia: Change-Id: I1ade703ab9f0b4aefc9cf630e3d2efb996afd69f Reviewed-on: https://skia-review.googlesource.com/62343 Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Chris Dalton <csmartdalton@google.com>
* skpbench: add arguments for path renderer and path cacheGravatar Chris Dalton2017-10-20
| | | | | | | | Bug: skia: Change-Id: If31d040b0560c23bfad31e06ef247428bf5bdb6d Reviewed-on: https://skia-review.googlesource.com/62106 Reviewed-by: Kevin Lubick <kjlubick@google.com> Commit-Queue: Chris Dalton <csmartdalton@google.com>
* Modify skpbench to use newer adb versionGravatar Kevin Lubick2017-10-13
| | | | | | | | | Bug: skia: NOTRY=true Change-Id: Ib630d352b6922280ef5772e6843f8f031baeffaf Reviewed-on: https://skia-review.googlesource.com/59161 Reviewed-by: Eric Boren <borenet@google.com> Commit-Queue: Kevin Lubick <kjlubick@google.com>
* Be explicit on test and perf bots about GL vs GLESGravatar Brian Salomon2017-03-17
| | | | | | | | | | This changes the names of several shorthand names for gpu configs to be prefixed either with "gl" or "gles" and makes the bots only use such configs. It adds some missing named configs. Change-Id: Iea4e0e2ddafe0ac08e623111a15be7335156957c Reviewed-on: https://skia-review.googlesource.com/9833 Commit-Queue: Brian Salomon <bsalomon@google.com> Reviewed-by: Brian Osman <brianosman@google.com> Reviewed-by: Ben Wagner <benjaminwagner@google.com>
* skpbench: add utility to format results for Skia PerfGravatar Kevin Lubick2016-11-10
| | | | | | | | | | | | | | Adds skiaperf.py for formatting skpbench.py outputs for Skia Perf. Also renames parseskpbench.py to sheet.py. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4657 Change-Id: I758678e1c589b15ec2d07c43e4921663e919b47b Reviewed-on: https://skia-review.googlesource.com/4657 Commit-Queue: Kevin Lubick <kjlubick@google.com> Reviewed-by: Kevin Lubick <kjlubick@google.com>
* skpbench: add "resultsfile" optionGravatar csmartdalton2016-11-10
| | | | | | | | | | | BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4654 Change-Id: I1a26eddb40de1398cad5348d3fe0ba397a87dbb0 Reviewed-on: https://skia-review.googlesource.com/4654 Reviewed-by: Kevin Lubick <kjlubick@google.com> Commit-Queue: Chris Dalton <csmartdalton@google.com>
* skpbench: remove --path flagGravatar csmartdalton2016-11-10
| | | | | | | | | | | | | | Replaces the confusing --path flag with a positional argument that gives the path to the skpbench binary. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4635 Change-Id: I2b5eeca61ec85e7fe45fd3370625eddf34a2fd0e Reviewed-on: https://skia-review.googlesource.com/4635 Reviewed-by: Kevin Lubick <kjlubick@google.com> Commit-Queue: Kevin Lubick <kjlubick@google.com>
* skpbench: call adb wait-for-device after rootGravatar csmartdalton2016-11-09
| | | | | | | | | | | BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=4632 Change-Id: I310600e79141d2eafd668c76b97a017b151ac0fd Reviewed-on: https://skia-review.googlesource.com/4632 Reviewed-by: Kevin Lubick <kjlubick@google.com> Commit-Queue: Chris Dalton <csmartdalton@google.com>
* skpbench: filter out junk spewed by Pixel C driverGravatar csmartdalton2016-11-09
| | | | | | | BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2488043003 Review-Url: https://codereview.chromium.org/2488043003
* skpbench: simplify adb and reduce number of invocationsGravatar csmartdalton2016-11-09
| | | | | | | | | | This change reduces a bit of startup overhead by condensing more bash into fewer invocations of 'adb shell'. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2481413003 Review-Url: https://codereview.chromium.org/2481413003
* skpbench: suppot Nexus 6PGravatar csmartdalton2016-10-18
| | | | | | | BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2415033002 Review-Url: https://codereview.chromium.org/2415033002
* skpbench: add warmup runGravatar csmartdalton2016-10-11
| | | | | | | | | | Does actual work while waiting for hardware settings to kick in, rather than just sleeping. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2410373002 Review-Url: https://codereview.chromium.org/2410373002
* skpbench: add debug prints for thermal trip pointsGravatar csmartdalton2016-10-11
| | | | | | | | | | | | Prints thermal trip points that have been exceeded when a HardwareException is raised, and verbosity is set to debug. This can help us correlate thermal trip points with throttling and detect future throttling before it occurs. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2408893002 Review-Url: https://codereview.chromium.org/2408893002
* skpbench: add option for gpu timingGravatar csmartdalton2016-10-05
| | | | | | | | | | Adds a gpu timing option with a GL implementation. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2388433003 Committed: https://skia.googlesource.com/skia/+/c06720d06faab3b01eba1b8693e0ac791f06dc96 Review-Url: https://codereview.chromium.org/2388433003
* Revert of skpbench: add option for gpu timing (patchset #7 id:120001 of ↵Gravatar mtklein2016-10-04
| | | | | | | | | | | | | | | | | | | | | | | | | | https://codereview.chromium.org/2388433003/ ) Reason for revert: many bots failing Original issue's description: > skpbench: add option for gpu timing > > Adds a gpu timing option with a GL implementation. > > BUG=skia: > GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2388433003 > > Committed: https://skia.googlesource.com/skia/+/c06720d06faab3b01eba1b8693e0ac791f06dc96 TBR=egdaniel@google.com,bsalomon@google.com,csmartdalton@google.com # Skipping CQ checks because original CL landed less than 1 days ago. NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true BUG=skia: Review-Url: https://codereview.chromium.org/2390383002
* skpbench: add option for gpu timingGravatar csmartdalton2016-10-04
| | | | | | | | | Adds a gpu timing option with a GL implementation. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2388433003 Review-Url: https://codereview.chromium.org/2388433003
* skpbench: use accumulative result as the defaultGravatar csmartdalton2016-09-29
| | | | | | | | | | | Uses accum instead of median for the first column in skpbench.cpp, and the default result for parseskpbench.py. The accum is empirically proving to be more repeatable than the median. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2378383002 Review-Url: https://codereview.chromium.org/2378383002
* skpbench: run for a fixed durationGravatar csmartdalton2016-09-28
| | | | | | | | | Runs for a fixed amount of time instead of a fixed amount of samples. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2374093002 Review-Url: https://codereview.chromium.org/2374093002
* Add Pixel C knobs to skpbenchGravatar csmartdalton2016-09-23
| | | | | | | BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2369533002 Review-Url: https://codereview.chromium.org/2369533002
* skpbench fixes for linuxGravatar csmartdalton2016-09-22
| | | | | | | BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2354273004 Review-Url: https://codereview.chromium.org/2354273004
* Add hardware monitoring to skpbenchGravatar csmartdalton2016-09-22
| | | | | | | | | | | | | | | Adds a Hardware class with hooks for entering and exiting "benchmarking" mode (e.g. locking clocks, etc.) as well as periodic polling of hardware to verify the environment is stable. Adds a partial implementation for generic Android hardware, but ultimately we will need to write specific classes tailored to each unique platform we need to test. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2360473002 Review-Url: https://codereview.chromium.org/2360473002
* Add adb support to skpbenchGravatar csmartdalton2016-09-19
| | | | | | | BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2350003002 Review-Url: https://codereview.chromium.org/2350003002
* skpbenchGravatar csmartdalton2016-09-19
skpbench is a benchmarking suite for skps that aims to generate 100% repeatable results. The initial commit consists of three parts: skpbench A minimalist program whose sole purpose is to open an skp file, benchmark it on a single config, and exit. No tiling, looping, or other fanciness is used; it just draws the skp whole into a size- matched render target and syncs the GPU after each draw. Limiting the entire process to a single config/skp pair helps to keep the results repeatable. skpbench.py A wrapper to execute the skpbench binary with various configs and skps. It also monitors the output in order to filter out and re-run results with an unacceptable stddev. In the future this script will lock down and monitor clocks and temperatures. parseskpbench.py A utility for parsing skpbench output into a spreadsheet. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2341823002 Review-Url: https://codereview.chromium.org/2341823002