aboutsummaryrefslogtreecommitdiffhomepage
path: root/tools/tests
diff options
context:
space:
mode:
authorGravatar commit-bot@chromium.org <commit-bot@chromium.org@2bbb7eff-a529-9590-31e7-b0007b416f81>2014-03-28 17:55:51 +0000
committerGravatar commit-bot@chromium.org <commit-bot@chromium.org@2bbb7eff-a529-9590-31e7-b0007b416f81>2014-03-28 17:55:51 +0000
commitcb3f07940c11beaf2ccd3bfe76c18994f0cc4154 (patch)
tree79bf9db893092f00db5e69c15ddb38b0079aa179 /tools/tests
parentcd00b9a74122d4a306840124179f576389d6a241 (diff)
Adds bench expectations to expectations/bench; fixes bench alert test's dependency on script line number.
BUG=skia:2307 NOTRY=true R=borenet@google.com Author: bensong@google.com Review URL: https://codereview.chromium.org/214913005 git-svn-id: http://skia.googlecode.com/svn/trunk@13979 2bbb7eff-a529-9590-31e7-b0007b416f81
Diffstat (limited to 'tools/tests')
-rw-r--r--tools/tests/benchalerts/Perf-Android-Nexus7-Tegra3-Arm7-Release/output-expected/stderr11
1 files changed, 3 insertions, 8 deletions
diff --git a/tools/tests/benchalerts/Perf-Android-Nexus7-Tegra3-Arm7-Release/output-expected/stderr b/tools/tests/benchalerts/Perf-Android-Nexus7-Tegra3-Arm7-Release/output-expected/stderr
index 9b8efd3454..1edf4ba04e 100644
--- a/tools/tests/benchalerts/Perf-Android-Nexus7-Tegra3-Arm7-Release/output-expected/stderr
+++ b/tools/tests/benchalerts/Perf-Android-Nexus7-Tegra3-Arm7-Release/output-expected/stderr
@@ -1,14 +1,9 @@
-Traceback (most recent call last):
- File "bench/check_bench_regressions.py", line 232, in <module>
- main()
- File "bench/check_bench_regressions.py", line 228, in main
- check_expectations(bench_dict, bench_expectations, platform_and_alg)
- File "bench/check_bench_regressions.py", line 178, in check_expectations
- raise Exception('\n'.join(outputs))
-Exception:
+Exception:
+
2 benches got slower (sorted by % difference):
Bench desk_blogger.skp_record_,Perf-Android-Nexus7-Tegra3-Arm7-Release-25th out of range [0.4, 0.6] (1.794 vs 0.5, 258.8%).
Bench desk_amazon.skp_record_,Perf-Android-Nexus7-Tegra3-Arm7-Release-25th out of range [-1.0, 1.2] (1.213 vs 1.1, 10.2727272727%).
1 benches got faster (sorted by % difference):
Bench desk_baidu.skp_record_,Perf-Android-Nexus7-Tegra3-Arm7-Release-25th out of range [0.9, 1.0] (0.83 vs 0.939, -11.6080937167%).
+