aboutsummaryrefslogtreecommitdiffhomepage
path: root/tools/nanobench_flags.py
Commit message (Collapse)AuthorAge
* Add test configs for instanced renderingGravatar csmartdalton2016-07-29
| | | | | | | | | | | | | | | Adds the following configs and enables them on select bots: glinst, glinst4, glinstdit4, glinst16, glinstdit16, esinst, esinst4, esinstdit4 Makes general changes to GrContextOptions, GrCaps, etc. to facilitate this. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2182783004 Review-Url: https://codereview.chromium.org/2182783004
* Make coverage.py optional for dm and nanobench _flags.pyGravatar mtklein2016-07-28
| | | | | | | | | It is better to test partially than not test at all. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2184423002 Review-Url: https://codereview.chromium.org/2184423002
* Start measuring f16 and srgb speed.Gravatar mtklein2016-07-26
| | | | | | | BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2181073003 Review-Url: https://codereview.chromium.org/2181073003
* Turn back on nanobench on Debug trybots.Gravatar mtklein2016-07-13
| | | | | | | | | | | Swarming makes the extra wall-clock cost negligible. TBR= BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2142223004 Review-Url: https://codereview.chromium.org/2142223004
* Run the Vulkan config on nanobench for Vulkan botsGravatar borenet2016-07-12
| | | | | | | BUG=skia:5513 GOLD_TRYBOT_URL= https://gold.skia.org/search?issue=2145633002 Review-Url: https://codereview.chromium.org/2145633002
* Add exclusion for keymobi_shop_mobileweb_ebay_com.skp on N5Gravatar bsalomon2016-04-06
| | | | | | | BUG=skia:5178 GOLD_TRYBOT_URL= https://gold.skia.org/search2?unt=true&query=source_type%3Dgm&master=false&issue=1857123005 Review URL: https://codereview.chromium.org/1857123005
* Add predfined configs for msaa4, nvpr4, nvpr4dit, and srgb that explictly ↵Gravatar bsalomon2016-04-05
| | | | | | | | | | use OpenGL rather than GLES and use them on the X1 bot GOLD_TRYBOT_URL= https://gold.skia.org/search2?unt=true&query=source_type%3Dgm&master=false&issue=1853103003 Committed: https://skia.googlesource.com/skia/+/74cb44dee50b5db94c1374cbcf0b0a1babd09d89 Review URL: https://codereview.chromium.org/1853103003
* Revert of Add predfined configs for msaa4, nvpr4, nvpr4dit, and srgb that ↵Gravatar bsalomon2016-04-05
| | | | | | | | | | | | | | | | | | | | | explictly use OpenGL rather than GL… (patchset #3 id:40001 of https://codereview.chromium.org/1853103003/ ) Reason for revert: causing crashes on win8 bot? Original issue's description: > Add predfined configs for msaa4, nvpr4, nvpr4dit, and srgb that explictly use OpenGL rather than GLES and use them on the X1 bot > GOLD_TRYBOT_URL= https://gold.skia.org/search2?unt=true&query=source_type%3Dgm&master=false&issue=1853103003 > > Committed: https://skia.googlesource.com/skia/+/74cb44dee50b5db94c1374cbcf0b0a1babd09d89 TBR=egdaniel@google.com,jvanverth@google.com # Skipping CQ checks because original CL landed less than 1 days ago. NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true Review URL: https://codereview.chromium.org/1857233002
* Add predfined configs for msaa4, nvpr4, nvpr4dit, and srgb that explictly ↵Gravatar bsalomon2016-04-05
| | | | | | | | use OpenGL rather than GLES and use them on the X1 bot GOLD_TRYBOT_URL= https://gold.skia.org/search2?unt=true&query=source_type%3Dgm&master=false&issue=1853103003 Review URL: https://codereview.chromium.org/1853103003
* Blacklist shapes benchmarks on Mali400 bot.Gravatar brianosman2016-03-30
| | | | | | | BUG=skia:4966 GOLD_TRYBOT_URL= https://gold.skia.org/search2?unt=true&query=source_type%3Dgm&master=false&issue=1839193002 Review URL: https://codereview.chromium.org/1839193002
* Add test configs for nvpr with atlas textGravatar cdalton2016-03-29
| | | | | | | | | | | | Adds nvpr4 and nvpr16, which use nvpr for paths and atlas for text. Renames nvprmsaa4 and nvprmsaa16 to nvprdit4, nvprdit16. These use nvpr for both paths and text. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search2?unt=true&query=source_type%3Dgm&master=false&issue=1834693002 Review URL: https://codereview.chromium.org/1834693002
* Revert of nanobench: turn on f16 and sRGB on the bots (patchset #1 id:1 of ↵Gravatar mtklein2016-03-08
| | | | | | | | | | | | | | | | | | | | | | | | | | | https://codereview.chromium.org/1769163006/ ) Reason for revert: Debug bots failing at Running writepix_RGBA_UPM f16 ../../../src/core/SkBitmap.cpp:558: fatal error: ""false && \"Can't return addr for config\""" Original issue's description: > nanobench: turn on f16 and sRGB on the bots > > BUG=skia: > GOLD_TRYBOT_URL= https://gold.skia.org/search2?unt=true&query=source_type%3Dgm&master=false&issue=1769163006 > > Committed: https://skia.googlesource.com/skia/+/6b5c5cc7b7bdffb4882706b915b544aba8714961 TBR=reed@google.com,mtklein@chromium.org # Skipping CQ checks because original CL landed less than 1 days ago. NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true BUG=skia: Review URL: https://codereview.chromium.org/1780463003
* nanobench: turn on f16 and sRGB on the botsGravatar mtklein2016-03-08
| | | | | | | BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search2?unt=true&query=source_type%3Dgm&master=false&issue=1769163006 Review URL: https://codereview.chromium.org/1769163006
* Run no CPU benches in Debug trybots.Gravatar mtklein2016-02-22
| | | | | | | | | | | They seem to just be wasting time on the CQ. Hacking this into nanobench_flags.py makes it easy to back out. BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search2?unt=true&query=source_type%3Dgm&master=false&issue=1720223002 Review URL: https://codereview.chromium.org/1720223002
* enable ThermalManager on AndroidGravatar joshualitt2016-02-11
| | | | | | | BUG=skia: GOLD_TRYBOT_URL= https://gold.skia.org/search2?unt=true&query=source_type%3Dgm&master=false&issue=1684653002 Review URL: https://codereview.chromium.org/1684653002
* Add pre_log option to nanobench; make this option default true in ↵Gravatar benjaminwagner2016-01-25
| | | | | | | | | | nanobench_flags.py and dm_flags.py. BUG=skia:4826 BUG=skia:4827 GOLD_TRYBOT_URL= https://gold.skia.org/search2?unt=true&query=source_type%3Dgm&master=false&issue=1612483002 Review URL: https://codereview.chromium.org/1612483002
* On Valgrind bots, print a message every 20 minutesGravatar msarett2016-01-04
| | | | | | | | | | | | | I believe that the timeout failure on the Valgrind bot occurs because we skip many tests consecutively without printing any output. Skipping these tests requires non-trivial work. Printing a message every 20 minutes will avoid timeouts. BUG=skia:4740 GOLD_TRYBOT_URL= https://gold.skia.org/search2?unt=true&query=source_type%3Dgm&master=false&issue=1554193002 Review URL: https://codereview.chromium.org/1554193002
* Blacklist GLInstancedArraysBench on ipadGravatar joshualitt2015-12-16
| | | | | | | TBR=jvanverth@google.com BUG=skia:4714 Review URL: https://codereview.chromium.org/1522273006
* Add gpuStatsDump to nanobench GPU botsGravatar joshualitt2015-12-02
| | | | | | BUG=skia: Review URL: https://codereview.chromium.org/1497533002
* Disable incomplete image tests in nanobenchGravatar msarett2015-11-16
| | | | | | BUG=skia: Review URL: https://codereview.chromium.org/1448893003
* Comments Style: s/skbug.com/bug.skia.org/Gravatar halcanary2015-11-07
| | | | | | DOCS_PREVIEW= https://skia.org/?cl=1432503003 Review URL: https://codereview.chromium.org/1432503003
* Renable image benchmarkingGravatar scroggo2015-10-15
| | | | | | | | | | | | | | | - Remove --images '' to renable image benchmarking - Add a flag to disable testing JPEG's buildTileIndex, since it also leaks memory - Do not run images on GPU - Do not run large interlaced images on 32 bit bots - When buildTileIndex is not being used in the subset benches, do not use it for BRD BUG=skia:3418 BUG=skia:4469 BUG=skia:4471 BUG=skia:4360 Review URL: https://codereview.chromium.org/1396113002
* Reland of Pass --images '' to nanobench to disable image benchmarking. ↵Gravatar scroggo2015-10-08
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | (patchset #1 id:1 of https://codereview.chromium.org/1400633002/ ) Reason for revert: Still breaking. e.g. http://build.chromium.org/p/client.skia/builders/Test-iOS-Clang-iPad4-GPU-SGX554-Arm7-Debug/builds/1466/steps/nanobench/logs/stdio http://build.chromium.org/p/client.skia.android/builders/Perf-Android-GCC-Nexus7-GPU-Tegra3-Arm7-Release/builds/2280/steps/nanobench/logs/stdio Original issue's description: > Revert of Pass --images '' to nanobench to disable image benchmarking. (patchset #1 id:1 of https://codereview.chromium.org/1381703003/ ) > > Reason for revert: > I have attempted to fix the problems that caused running nanobench with images to fail, so testing to see if they are in fact fixed. > > Original issue's description: > > Pass --images '' to nanobench to disable image benchmarking. > > > > Enabling image benchmarking has caused most nanobench runs to fail, > > both Debug and Release. > > > > BUG=skia:3418 > > NOTREECHECKS=true > > TBR=scroggo@google.com > > > > Committed: https://skia.googlesource.com/skia/+/1f7039c6c5f0f118b629994b0bac255345e5abd6 > > BUG=skia:3418 > > Committed: https://skia.googlesource.com/skia/+/c2e59caa0a466040f4b4f08cb5604c86b2615efa TBR=mtklein@chromium.org NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true BUG=skia:3418 Review URL: https://codereview.chromium.org/1396843003
* Revert of Pass --images '' to nanobench to disable image benchmarking. ↵Gravatar scroggo2015-10-08
| | | | | | | | | | | | | | | | | | | | | | | (patchset #1 id:1 of https://codereview.chromium.org/1381703003/ ) Reason for revert: I have attempted to fix the problems that caused running nanobench with images to fail, so testing to see if they are in fact fixed. Original issue's description: > Pass --images '' to nanobench to disable image benchmarking. > > Enabling image benchmarking has caused most nanobench runs to fail, > both Debug and Release. > > BUG=skia:3418 > NOTREECHECKS=true > TBR=scroggo@google.com > > Committed: https://skia.googlesource.com/skia/+/1f7039c6c5f0f118b629994b0bac255345e5abd6 BUG=skia:3418 Review URL: https://codereview.chromium.org/1400633002
* Pass --images '' to nanobench to disable image benchmarking.Gravatar mtklein2015-10-05
| | | | | | | | | | | Enabling image benchmarking has caused most nanobench runs to fail, both Debug and Release. BUG=skia:3418 NOTREECHECKS=true TBR=scroggo@google.com Review URL: https://codereview.chromium.org/1381703003
* Revert of Blacklist GLVertexAttributesBench and GLVec4ScalarBench for ↵Gravatar joshualitt2015-10-02
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | GalaxyS4 due to skia:4373 (patchset #1 id:1 of https://codereview.chromium.org/1375733003/ ) Reason for revert: Reverting, optimistically fixed Original issue's description: > Reland of Blacklist GLVertexAttributesBench and GLVec4ScalarBench for GalaxyS4 due to skia:4373 (patchset #1 id:1 of https://codereview.chromium.org/1382933002/ ) > > Reason for revert: > Not fixed. :-( > > Original issue's description: > > Revert of Blacklist GLVertexAttributesBench and GLVec4ScalarBench for GalaxyS4 due to skia:4373 (patchset #1 id:1 of https://codereview.chromium.org/1365683003/ ) > > > > Reason for revert: > > should hopefully be fixed, please reland if not. > > > > Original issue's description: > > > Blacklist GLVertexAttributesBench and GLVec4ScalarBench for GalaxyS4 due to skia:4373 > > > > > > BUG=skia:4373 > > > > > > Committed: https://skia.googlesource.com/skia/+/3420d2796bad5ce553efb9909790ea72e578dc47 > > > > TBR=borenet@google.com,benjaminwagner@google.com > > NOPRESUBMIT=true > > NOTREECHECKS=true > > NOTRY=true > > BUG=skia:4373 > > > > Committed: https://skia.googlesource.com/skia/+/52f8deba607fd67558b57551cd43406c8b743072 > > TBR=borenet@google.com,joshualitt@google.com > NOPRESUBMIT=true > NOTREECHECKS=true > NOTRY=true > BUG=skia:4373 > > Committed: https://skia.googlesource.com/skia/+/9442ab8a40dd0effde253e3b2d166bcf47222e92 TBR=borenet@google.com,benjaminwagner@google.com NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true BUG=skia:4373 Review URL: https://codereview.chromium.org/1385633002
* Reland of Blacklist GLVertexAttributesBench and GLVec4ScalarBench for ↵Gravatar benjaminwagner2015-10-01
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | GalaxyS4 due to skia:4373 (patchset #1 id:1 of https://codereview.chromium.org/1382933002/ ) Reason for revert: Not fixed. :-( Original issue's description: > Revert of Blacklist GLVertexAttributesBench and GLVec4ScalarBench for GalaxyS4 due to skia:4373 (patchset #1 id:1 of https://codereview.chromium.org/1365683003/ ) > > Reason for revert: > should hopefully be fixed, please reland if not. > > Original issue's description: > > Blacklist GLVertexAttributesBench and GLVec4ScalarBench for GalaxyS4 due to skia:4373 > > > > BUG=skia:4373 > > > > Committed: https://skia.googlesource.com/skia/+/3420d2796bad5ce553efb9909790ea72e578dc47 > > TBR=borenet@google.com,benjaminwagner@google.com > NOPRESUBMIT=true > NOTREECHECKS=true > NOTRY=true > BUG=skia:4373 > > Committed: https://skia.googlesource.com/skia/+/52f8deba607fd67558b57551cd43406c8b743072 TBR=borenet@google.com,joshualitt@google.com NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true BUG=skia:4373 Review URL: https://codereview.chromium.org/1375733003
* Revert of Blacklist GLVertexAttributesBench and GLVec4ScalarBench for ↵Gravatar joshualitt2015-10-01
| | | | | | | | | | | | | | | | | | | | | | GalaxyS4 due to skia:4373 (patchset #1 id:1 of https://codereview.chromium.org/1365683003/ ) Reason for revert: should hopefully be fixed, please reland if not. Original issue's description: > Blacklist GLVertexAttributesBench and GLVec4ScalarBench for GalaxyS4 due to skia:4373 > > BUG=skia:4373 > > Committed: https://skia.googlesource.com/skia/+/3420d2796bad5ce553efb9909790ea72e578dc47 TBR=borenet@google.com,benjaminwagner@google.com NOPRESUBMIT=true NOTREECHECKS=true NOTRY=true BUG=skia:4373 Review URL: https://codereview.chromium.org/1382933002
* Blacklist GLVertexAttributesBench and GLVec4ScalarBench for GalaxyS4 due to ↵Gravatar benjaminwagner2015-09-23
| | | | | | | | skia:4373 BUG=skia:4373 Review URL: https://codereview.chromium.org/1365683003
* Blacklist GLInstancedArraysBench for GalaxyS4 due to skia:4371Gravatar benjaminwagner2015-09-23
| | | | | | BUG=skia:4371 Review URL: https://codereview.chromium.org/1363963002
* Appurify bot: don't use flags that visualbench doesn't supportGravatar borenet2015-09-03
| | | | | | | Depends on https://codereview.chromium.org/1320423005/ BUG=skia:4277 Review URL: https://codereview.chromium.org/1310903006
* Try enabling all nanobenches on Nexus7Gravatar egdaniel2015-08-18
| | | | | | BUG=skia:2774 Review URL: https://codereview.chromium.org/1290223005
* nanobench: split CPU and GPU .SKP tile sizes.Gravatar mtklein2015-06-16
| | | | | | | | | Let's make CPU-bound .SKP benching mimic Chrome's tiles. Unfortunately, the CPU code also performs a lot better with those big wide tiles... BUG=skia: Review URL: https://codereview.chromium.org/1189863002
* Disabling ~path_hairline in iOS nanobenchGravatar stephana2015-05-26
| | | | | | | | | Temporary measure to make nanobench succeed. TBR=borenet BUG=skia: Review URL: https://codereview.chromium.org/1144173004
* Temporarily disable nanobench to see what else is in the way of the bots ↵Gravatar stephana2015-05-21
| | | | | | | | | going green. NOTRY=true BUG=skia: Review URL: https://codereview.chromium.org/1147333002
* Blacklist desk_unicodetable SKP on Nexus PlayerGravatar borenet2015-04-23
| | | | | | | | It's getting us killed for OOM. BUG=skia:3240 Review URL: https://codereview.chromium.org/1104693002
* Update [dm|nanobench]_flags for CPU/GPU splitGravatar borenet2015-03-27
| | | | | | | | TBR=mtklein NOTREECHECKS=true BUG=skia:2073 Review URL: https://codereview.chromium.org/1036223002
* Only use 256x256 tiles on hd2000 nanobench botsGravatar egdaniel2015-03-20
| | | | | | | | | | | Initial experiments did show that the 256 tile size fixed the hd2000 win7 nanobot failures. However it did not have any effect on other bots, so this change is to move back to the larger tile size on all bots expect for the hd2000. BUG=skia: Review URL: https://codereview.chromium.org/1022083002
* Fix bug in Valgrind flags config.Gravatar mtklein2015-03-10
| | | | | | | | | | | 'GPU' is in 'Test-Ubuntu14-GCE-NoGPU-x86_64-Release-Valgrind_CPU' too. This means we're building it in no-GPU mode, and running it in no-CPU mode. At least it finishes quite quickly this way (~10 seconds). BUG=skia: Review URL: https://codereview.chromium.org/992203004
* Run Valgrind bots with --nogpu and --nocpu as appropriateGravatar borenet2015-03-09
| | | | | | | BUG=skia:3506 NOPRESUBMIT=true Review URL: https://codereview.chromium.org/986583004
* Add msaa runs to nanobenchGravatar bsalomon2015-02-28
| | | | | | TBR=mtklein@google.com Review URL: https://codereview.chromium.org/964053002
* Add tools/nanobench_flags.py.Gravatar mtklein2015-02-24
This should look suspiciously similar to tools/dm_flags.py. In fact, I tweaked tools/dm_flags.py a bit to make it even more suspiciously similar. I'll leave actually deduping this to future me. I noticed we have an opportunity to make our Valgrind run of nanobench faster, by not only making it not auto-calibrate (--loops 1) but also take only one measurement (--samples 1). Should be 5-10x faster than the default. BUG=skia: Review URL: https://codereview.chromium.org/957503002