| Commit message (Collapse) | Author | Age |
|---|
| |
|
|
|
|
|
|
|
| |
It turns out to be inconvenient to delete the downloaded datafiles with
distclean, so I propose a new target which does that instead.
The closest conventional target is 'maintainer-clean'; the difference
here is that having the original source tarball is not enough to
reconstruct these files.
|
| |
|
|
|
| |
This might have worked once for some fixed order of including
makefiles, but it is clearly wrong now.
|
| |
|
|
|
|
| |
It seems that between version 1.26 and 1.27 of gnu tar, directories to
be extracted read with --files-from are no longer recursively extacted.
This patch puts them on the command line instead.
|
| |
|
|
|
| |
The new revision of the performance test includes manifests for each corpus,
so update the support library to use these manifests at the same time.
|
| |
|
|
|
|
|
|
| |
Previously, we cleaned the downloaded performance corpus and the
cached indexes on 'make clean'. This seems heavy-handed, since these
take a long time to download, unpack, and index. They also aren't
make targets to begin with. Move cleaning these to 'make distclean'.
This isn't exactly the right meaning of "distclean", but it's closer.
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Support for out-of-tree builds was added in
commit 3e4a9d60a9419621b08c647a306843d76c47c2cb
Author: Carl Worth <cworth@cworth.org>
Date: Wed Mar 9 15:02:42 2011 -0800
build: Add support for non-source-directory builds.
and broken in
commit 7beeb8c88a014ecbc53d8241f10683b3c4c16228
Author: David Bremner <bremner@debian.org>
Date: Sat Nov 17 12:28:15 2012 -0400
test: initial performance testing infrastructure
Fix the build breakage.
Out-of-tree 'make test' has been broken since earlier than the above,
and remains broken, as does out-of-tree perf test, but at least the
build now works.
|
| |
|
|
|
|
| |
Somehow this file was not added to the patch set which split the tests
into time and memory tests. Take advantage of the the "new" way of
running tests to avoid listing the explicitly.
|
| |
|
|
| |
This avoids hassle with manually adding every test to the master list.
|
| |
|
|
| |
This will simplify notmuch time tests
|
| |
|
|
| |
The common suffix will help running them all automatically.
|
| |
|
|
|
| |
As with the valgrind logs, we print a (very) brief summary and leave
the log for inspection.
|
| |
|
|
|
|
| |
In id:87vcc2q5n2.fsf@nikula.org, Jani points out a memory leak in the
current version of the sup restore code. Among other things, this test
is intended to verify a fix for that leak.
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
The idea is run some code under valgrind --leak-check=full and report
a summary, leaving the user to peruse the log file if they want.
We go to some lengths to preserve the log files from accidental
overwriting; the full corpus takes about 3 hours to run under valgrind
on my machine.
The naming of the log directories may be slightly controversial; in
the unlikely event of two runs in less than a second, the log will be
overwritten. A previous version with mktemp+timestamp was dismissed as
overkill; just mktemp alone does not sort nicely.
One new test is included, to check notmuch new for memory leaks.
|
| |
|
|
|
|
|
|
| |
This is almost entirely renaming files, except for updating a few
references to those file names, and changing the makefile target.
A new set of memory tests will be run separately because they take
much longer.
|
| |
|
|
|
| |
The initial notmuch-new and caching are now done automatically by
time_start
|
| |
|
|
|
|
|
|
|
|
|
| |
This makes the tag set a bit less trivial.
Note that if you use the small corpus, this is not so interesting (and
is also a bit noisy) since the messages will not be found. In the
future this could be checked for.
Conflicts:
performance-test/01-dump-restore
|
| |
|
|
|
| |
We use the new "time_start" function to restore the database from cache
if possible.
|
| |
|
|
|
| |
There is only one set of tags, independant of the size of message
corpus chosen.
|
| |
|
|
|
| |
The new version ships with some tags, and an updated archive of the
notmuch mailing list.
|
| |
|
|
| |
Describe new argument parsing and mention cache handling routines.
|
| |
|
|
|
| |
The caching and uncaching seem to be necessarily manual, as timing the
initial notmuch new is one of our goals with this suite.
|
| |
|
|
|
| |
Unpacking is not really the expensive step (compared to the initial
notmuch new), but this is a pre-requisite to caching the database.
|
| |
|
|
|
| |
Output from tests is indented slightly in the same style as the
correctness tests.
|
| |
|
|
|
|
|
|
|
| |
Austin suggested a while ago that the corpus size be printed in the
header. In the end it seems the corpus will be fixed per test script,
so this suggestion indeed makes sense.
The tabbing was wrapping on my usual 80 column terminal, so I joined
the input and output columns together.
|
| |
|
|
|
| |
This patch just sets (non-exported) variables. The variable $debug is
already used, and $corpus_size will be used in following commits.
|
| |
|
|
|
|
| |
Unlike in the correctness tests, the most common cause of non-zero
return seems to be the user interrupting, so killing the run seems
like the friendly thing to do.
|
| |
|
|
|
| |
Austin Read enough Fine Manuals to figure out this is in multiples of
512 bytes.
|
| |
|
|
| |
It turns out not everybody on the planet has my gpg key.
|
|
|
This is not near as fancy as as the unit tests, on the theory that
the code should typically be crashing when performance tuning.
Nonetheless, there is plenty of room for improvement. Several more of
the pieces of the test infrastructure (e.g. the option parsing) could
be factored out into test/test-lib-common.sh
|
David Bremner
Austin Clements
Jani Nikula
David Bremner