diff options
author | 2013-05-03 10:31:45 -0400 | |
---|---|---|
committer | 2013-05-03 10:31:45 -0400 | |
commit | 581942d5c17b45d545e4a90ae488593a3236cee3 (patch) | |
tree | 13016d2638c86301e353c268fc3f9c684a512c02 | |
parent | 27c4a680b4776837b3b74bdb614e834aa6f6f61f (diff) | |
parent | dff45740dcf624d3d136349f335556e8fd5469fc (diff) |
Merge branch 'master' of ssh://git-annex.branchable.com
-rw-r--r-- | doc/bugs/Stress_test/comment_8_a01995bdca7ade7dde9842b53fbc4e0c._comment | 57 | ||||
-rw-r--r-- | doc/tips/finding_duplicate_files/comment_6_a6e88c93b31f67c933523725ff61b287._comment | 16 |
2 files changed, 73 insertions, 0 deletions
diff --git a/doc/bugs/Stress_test/comment_8_a01995bdca7ade7dde9842b53fbc4e0c._comment b/doc/bugs/Stress_test/comment_8_a01995bdca7ade7dde9842b53fbc4e0c._comment new file mode 100644 index 000000000..d12b7ebfe --- /dev/null +++ b/doc/bugs/Stress_test/comment_8_a01995bdca7ade7dde9842b53fbc4e0c._comment @@ -0,0 +1,57 @@ +[[!comment format=mdwn + username="https://www.google.com/accounts/o8/id?id=AItOawm5iosFbL2By7UFeViqkc6v-hoAtqILeDA" + nickname="Laszlo" + subject="Definite improvement" + date="2013-05-03T06:27:12Z" + content=""" +Hi, + +I have just tried it out again with the latest (20130501) version. + +It is really nice to see you have been working on it, and it have improved tremendously! +The logging issue solved, and logrotates even, and it finished importing without crashing! + +Remaining polishing things: + +a) +The import time is not as good (as you write), it slowes itself down. +It is true the first 10000 files import in about an hour, but it finishes with everything +in 9 hours 20 minutes. +(on a normal laptop, the last 5000 file portion took more then 2 hours) + +b) +Every startup means rechecksuming everything, so it means the second start took also around 8-12 hours. +(I don't know exactly because it finished somewhere during the night, but it was longer then 8 hours) +I don't think rechecksuming is necessary at all, if the filename, size and date have not modified, +then why rechecksuming (sha) it? + + +c) +It is leaking. +At the second startup, it reported it successfully added: + Added 2375 files 5 files probe25366.txt + +I have not touched the directory. ls confirms leaking: + + After first start (importing): + annex_many/.git$ ls -lR |wc -l + 770199 + + After second startup: + annex_many/.git$ ls -lR |wc -l + 788351 + +d) Without ulimit raise, it does not work at all. +I think it could be solved by not watching each and every directory all the time. +Every users will likely have a working directory and some which he don't intend to touch/modify at all. +Some usecases: photo archiving, video archiving, finished work archiving, etc + +All the above results with the stress test script. +I would love to have a confirmation by a thirdparty. + +Overall I'm impressed with the work you have done. + +Best, + Laszlo + +"""]] diff --git a/doc/tips/finding_duplicate_files/comment_6_a6e88c93b31f67c933523725ff61b287._comment b/doc/tips/finding_duplicate_files/comment_6_a6e88c93b31f67c933523725ff61b287._comment new file mode 100644 index 000000000..31601a989 --- /dev/null +++ b/doc/tips/finding_duplicate_files/comment_6_a6e88c93b31f67c933523725ff61b287._comment @@ -0,0 +1,16 @@ +[[!comment format=mdwn + username="https://www.google.com/accounts/o8/id?id=AItOawnkBYpLu_NOj7Uq0-acvLgWhxF8AUEIJbo" + nickname="Chris" + subject="Find files by key" + date="2013-05-03T04:14:55Z" + content=""" +Is there any simple way to search for files with a given key? + +At the moment, the best I've come up with is this: + +```` +git annex find --include '*' --format='${key} ${file}' | grep <KEY> +```` + +where `<KEY>` is the key. This seems like an awfully longwinded approach, but I don't see anything in the docs indicating a simpler way to do it. Am I missing something? +"""]] |