diff options
Diffstat (limited to 'doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace')
14 files changed, 0 insertions, 274 deletions
diff --git a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_0._comment b/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_0._comment deleted file mode 100644 index 87bec8530..000000000 --- a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_0._comment +++ /dev/null @@ -1,34 +0,0 @@ -[[!comment format=mdwn - username="https://www.google.com/accounts/o8/id?id=AItOawm5iosFbL2By7UFeViqkc6v-hoAtqILeDA" - nickname="Laszlo" - subject="Tried to add a bug, but website fails" - date="2013-03-01T14:40:18Z" - content=""" -@joeyh: I tried to add a comment to my bugreport: -http://git-annex.branchable.com/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace.Makefile/ - -I get this error: -Error: failed to create directory /home/b-git-annex/source/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace.Makefile/: File exists - -The comment I tried to add: -Seems like the logging is the culprit: - -user@usermachine:~/down/annex$ du -ak . | sort -nr | cut -f2 | xargs -d '\n' du -sh |head -n 30 - -8,2G . -7,5G ./.git -6,5G ./.git/annex -2,7G ./.git/annex/daemon.log -1,8G ./.git/annex/daemon.log.1 -1,5G ./.git/annex/daemon.log.5 -980M ./.git/objects -742M ./mydir -640M ./mydir/wp -616M ./mydir/wp/wd -314M ./mydir/wp/wd/2012 -278M ./.git/annex/daemon.log.4 -226M ./mydir/wp/wd/2011 -154M ./.git/annex/daemon.log.6 -109M ./.git/annex/objects - - -"""]] diff --git a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_10_037a6dd6e15ef5f789a1f364f7507b53._comment b/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_10_037a6dd6e15ef5f789a1f364f7507b53._comment deleted file mode 100644 index f973238d8..000000000 --- a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_10_037a6dd6e15ef5f789a1f364f7507b53._comment +++ /dev/null @@ -1,45 +0,0 @@ -[[!comment format=mdwn - username="https://www.google.com/accounts/o8/id?id=AItOawm5iosFbL2By7UFeViqkc6v-hoAtqILeDA" - nickname="Laszlo" - subject="comment 10" - date="2013-03-03T18:31:24Z" - content=""" -The problem with restarting, that it seems, it puts everything one more time into .git. -(if we ignore the logging problem). - -Right now, here is the: - $ du -ak . | sort -nr | cut -f2 | xargs -d '\n' du -sh |head -n 30 - -output: - 8,7G . - 8,0G ./.git - 6,3G ./.git/annex - 3,5G ./.git/annex/daemon.log.2 - 2,5G ./.git/annex/daemon.log - 1,7G ./.git/objects - 742M ./mydir - 640M ./mydir/wp - 616M ./mydir/wp/wd - 314M ./mydir/wp/wd/2012 - 226M ./mydir/wp/wd/2011 - 227M ./.git/annex/daemon.log.1 - 109M ./.git/annex/objects - -If you observe ./.git/objects dir, is 1,7G, -while yesterday it was 742M (see my first comment). - -Other problem, that once it runs out of space, threads crashes: - Pusher crashed: user error (git [\"--git-dir=/home/user/down/annex/.git\",\"--work-tree=/home/user/down/annex\",\"update-index\",\"-z\",\"--index-info\"] exited 128) - NetWatcherFallback crashed: fd:28: hGetLine: end of file - DaemonStatus crashed: /home/user/down/annex/.git/annex/daemon.status.tmp7564: hClose: resource exhausted (No space left on device) - -Right now, I think I tested everything I could. - -Where is the autobuild? This one still is 2013 feb 27: -http://downloads.kitenet.net/git-annex/linux/current/git-annex-standalone-i386.tar.gz - -Anyway, once the new version is out, I will retest this experiment. - -Best, - Laszlo - -"""]] diff --git a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_11_614e4110188fc6474e7da50fc4281e13._comment b/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_11_614e4110188fc6474e7da50fc4281e13._comment deleted file mode 100644 index 38d9bb621..000000000 --- a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_11_614e4110188fc6474e7da50fc4281e13._comment +++ /dev/null @@ -1,10 +0,0 @@ -[[!comment format=mdwn - username="http://joeyh.name/" - nickname="joey" - subject="comment 11" - date="2013-03-03T18:36:31Z" - content=""" -The autobuild is linked to on [[install/Linux_standalone]] - -I don't understand how you're \"restarting\" and not deleting the old .git repository. The right way would be to stop the assistant, run \"git annex uninit\", and then remove \".git\" -"""]] diff --git a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_12_dcb74fb91e1c2f0db4efd68c8bcbc96c._comment b/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_12_dcb74fb91e1c2f0db4efd68c8bcbc96c._comment deleted file mode 100644 index 8bf20fc18..000000000 --- a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_12_dcb74fb91e1c2f0db4efd68c8bcbc96c._comment +++ /dev/null @@ -1,20 +0,0 @@ -[[!comment format=mdwn - username="https://www.google.com/accounts/o8/id?id=AItOawm5iosFbL2By7UFeViqkc6v-hoAtqILeDA" - nickname="Laszlo" - subject="comment 12" - date="2013-03-03T21:24:18Z" - content=""" -restarting == Stop git-annex using the gui (Confirm shutdown daemon). Then check if there are running git process (ps -e |grep git), -if there are kill it, if (defunct) process present, then restart computer. Then launch git-annex using \"git-annex-webapp\" script). - -So its a normal program usage (start-stop cycle). - -The .git directory is growing. Without a single file moving/deleting/renaming/editing in the working directory. - -So the .git directory just grows, and I think it is a bug, and a bad one. (if we ignore the logging problem, the slow startup, the failing of disk full). - -I'll give it a spin to the autobuild (http://downloads.kitenet.net/git-annex/autobuild/i386/git-annex-standalone-i386.tar.gz), and report back. It will take at least 2 day, to repeat my whole experience. So expect update from me wednesday the soonest. - -Best, Laszlo - -"""]] diff --git a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_14_38671ba8d302f4d32460d1478abd2111._comment b/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_14_38671ba8d302f4d32460d1478abd2111._comment deleted file mode 100644 index cb9abcf72..000000000 --- a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_14_38671ba8d302f4d32460d1478abd2111._comment +++ /dev/null @@ -1,45 +0,0 @@ -[[!comment format=mdwn - username="https://www.google.com/accounts/o8/id?id=AItOawm5iosFbL2By7UFeViqkc6v-hoAtqILeDA" - nickname="Laszlo" - subject="version 20130314, still not improved" - date="2013-03-16T10:01:27Z" - content=""" -Hi, - -I promised you a feedback, once a newer version comes out. - -I started fresh (from the gui), created a new directory, and copied my files over it, -deleted the old one (git-annex-webapp just silently quite, when I tried to use the old directory). - -Problems: -> 1. each starts costs me an hour at least - -> 2. when computer starts git-annex starts too, and try to eat all the resources. - Resulting a 10 minute bootup. Would be nice to kick in, when computer idle, -and others already finished booting up. (ie. I had a chance to start a webbrowser) - -> 3. .git objects still going. -find `pwd` >../gitannexstartup[TIME].txt - -Some results: -gitannexstartup1034.txt -91179 -gitannexstartup1035.txt -91566 -gitannexstartup1040.txt -91938 - - diff between 1034 and 1035 (only 1 minute difference when the file created), - shows many entries like this: - /home/user/Desktop/down/annexnew/.git/objects/52/1ba05331f99585923f1724bb97c18a8f22837444843a45232 - /home/user/Desktop/down/annexnew/.git/objects/52/7457c478a19f8f85c73b9f17c5640378cf307044868a45258 - -So git objects keeps still adding. -As I have many duplicates in my directory -(backup of backups, I'm kind of paranoid, when comes to daily job), so it may be related to this bug: - -http://git-annex.branchable.com/bugs/Direct_mode_keeps_re-checksuming_duplicated_files/ - -It is just a hunch. Please tell me what else to test. - -"""]] diff --git a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_14_483244b1ed5744308022465f45c091fd._comment b/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_14_483244b1ed5744308022465f45c091fd._comment deleted file mode 100644 index 8594e5d75..000000000 --- a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_14_483244b1ed5744308022465f45c091fd._comment +++ /dev/null @@ -1,14 +0,0 @@ -[[!comment format=mdwn - username="https://www.google.com/accounts/o8/id?id=AItOawm5iosFbL2By7UFeViqkc6v-hoAtqILeDA" - nickname="Laszlo" - subject="comment 14" - date="2013-04-18T05:54:09Z" - content=""" -Hi, these bugs (too detailed logging) and duplicated files issues are both solved in the latest (2013.04.17) release. - -Thank you very much, you can close this issue. - -Best, - Laszlo - -"""]] diff --git a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_1_d2c63723fa4bf828873770a42ffaab20._comment b/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_1_d2c63723fa4bf828873770a42ffaab20._comment deleted file mode 100644 index 3096e596a..000000000 --- a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_1_d2c63723fa4bf828873770a42ffaab20._comment +++ /dev/null @@ -1,8 +0,0 @@ -[[!comment format=mdwn - username="http://joeyh.name/" - nickname="joey" - subject="comment 1" - date="2013-03-01T16:44:17Z" - content=""" -Can you please post a representative sample of the logs? -"""]] diff --git a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_3_52f0db73dc38c3e3a73f6c7a420bf016._comment b/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_3_52f0db73dc38c3e3a73f6c7a420bf016._comment deleted file mode 100644 index b7b866dc6..000000000 --- a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_3_52f0db73dc38c3e3a73f6c7a420bf016._comment +++ /dev/null @@ -1,8 +0,0 @@ -[[!comment format=mdwn - username="http://joeyh.name/" - nickname="joey" - subject="comment 3" - date="2013-03-01T17:31:31Z" - content=""" -I have made the assistant check hourly if its logs are larger than one megabyte, and trim old logs. -"""]] diff --git a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_4_93596b4d5a48ffcf4bc11ba9c83cf7ca._comment b/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_4_93596b4d5a48ffcf4bc11ba9c83cf7ca._comment deleted file mode 100644 index 7efe77303..000000000 --- a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_4_93596b4d5a48ffcf4bc11ba9c83cf7ca._comment +++ /dev/null @@ -1,9 +0,0 @@ -[[!comment format=mdwn - username="https://www.google.com/accounts/o8/id?id=AItOawm5iosFbL2By7UFeViqkc6v-hoAtqILeDA" - nickname="Laszlo" - subject="comment 4" - date="2013-03-01T19:52:13Z" - content=""" -Here is the last 300 lines of a 3.3GB daemon.log file: -http://pastebin.com/TF35H5gu -"""]] diff --git a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_5_de94e80dde6d12485140bb079d74d775._comment b/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_5_de94e80dde6d12485140bb079d74d775._comment deleted file mode 100644 index 16f8cf65a..000000000 --- a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_5_de94e80dde6d12485140bb079d74d775._comment +++ /dev/null @@ -1,14 +0,0 @@ -[[!comment format=mdwn - username="http://joeyh.name/" - nickname="joey" - subject="comment 5" - date="2013-03-01T20:20:21Z" - content=""" -Aha, so it's a direct mode repository and all this \"typechange\" stuff git outputs in such repositories is presumably the main culprit for log bloat. I have made it suppress that output. - -Excessive repacking may also explain a lot of the CPU usage and slowness. What does this say? - -`grep \"Auto packing the repository for optimum performance.\" .git/annex/*.log |wc -l` - -It may make sense for the assistant to tune `gc.auto` to avoid repacks. You might try disabling repacking altogether and see if it helps: `git config gc.auto 0` -"""]] diff --git a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_6_5f34c3d449247b4bce4665b3ea4d054c._comment b/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_6_5f34c3d449247b4bce4665b3ea4d054c._comment deleted file mode 100644 index 8da24d60f..000000000 --- a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_6_5f34c3d449247b4bce4665b3ea4d054c._comment +++ /dev/null @@ -1,25 +0,0 @@ -[[!comment format=mdwn - username="https://www.google.com/accounts/o8/id?id=AItOawm5iosFbL2By7UFeViqkc6v-hoAtqILeDA" - nickname="Laszlo" - subject="comment 6" - date="2013-03-02T10:05:38Z" - content=""" - $ ls -lah daemon.log - -rw-r--r-- 1 user user 3,3G 2013-03-02 10:54 daemon.log - - $ cat daemon.log |wc -l - 30746274 - - $ grep \"Auto packing the repository for optimum performance.\" daemon.log |wc -l - 568 - - $ grep \"typechange: \" daemon.log |wc -l - 30713158 - -I'm not sure where should I issue the git command. Inside the annex/.git directory? -The useful data is also in git repository locally. -I try to RTFM over the internet, thanks for the pointer! - - - -"""]] diff --git a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_7_b43ae8aec23ba3acaf70edc0de058710._comment b/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_7_b43ae8aec23ba3acaf70edc0de058710._comment deleted file mode 100644 index 4f53dedd1..000000000 --- a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_7_b43ae8aec23ba3acaf70edc0de058710._comment +++ /dev/null @@ -1,17 +0,0 @@ -[[!comment format=mdwn - username="https://www.google.com/accounts/o8/id?id=AItOawm5iosFbL2By7UFeViqkc6v-hoAtqILeDA" - nickname="Laszlo" - subject="comment 7" - date="2013-03-02T11:03:46Z" - content=""" - Ok, quick question: Should I issue git config gc.auto 0, in both repositories? - (it puts variable inside .git/config) - - With this gc.auto 0, should the \"typechange: \" logging change? (because it still in the log) - - I'm testing the whole experience, and report back, - also when new build is available i will switch to it, to report about the logging size. - -Thank you for your fast response! - -"""]] diff --git a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_8_13b8e0a62f6b6d02960687e206a8b016._comment b/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_8_13b8e0a62f6b6d02960687e206a8b016._comment deleted file mode 100644 index 4d3f11f36..000000000 --- a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_8_13b8e0a62f6b6d02960687e206a8b016._comment +++ /dev/null @@ -1,15 +0,0 @@ -[[!comment format=mdwn - username="https://www.google.com/accounts/o8/id?id=AItOawm5iosFbL2By7UFeViqkc6v-hoAtqILeDA" - nickname="Laszlo" - subject="comment 8" - date="2013-03-02T12:54:14Z" - content=""" -The startup time is somewhere between 4-5 hours -(dunno exactly, its only running about 3 hours) with this gc.auto 0. - -I will try to relaunch git-annex-assistant once it finishes startup, -but I can report back only tomorrow because it may take 5 hours/try. - -Laszlo - -"""]] diff --git a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_9_818b94a74b01a210d1106dd35bc932d8._comment b/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_9_818b94a74b01a210d1106dd35bc932d8._comment deleted file mode 100644 index 11b3efec0..000000000 --- a/doc/bugs/When_syncing_two_repositories__44___git_annex_uses_9x_times_diskspace/comment_9_818b94a74b01a210d1106dd35bc932d8._comment +++ /dev/null @@ -1,10 +0,0 @@ -[[!comment format=mdwn - username="http://joeyh.name/" - nickname="joey" - subject="comment 9" - date="2013-03-03T17:45:34Z" - content=""" -Well, that sounds like an improvement for sure with gc.auto=0. I have made that be done by default when committing. - -The typechange fix is available in the autobuilds already. -"""]] |