diff options
author | Joey Hess <joeyh@joeyh.name> | 2015-04-14 14:24:42 -0400 |
---|---|---|
committer | Joey Hess <joeyh@joeyh.name> | 2015-04-14 14:24:42 -0400 |
commit | 47bd6a31b4e204d6a8d32be059feaf68d6d39bfb (patch) | |
tree | b6e0b0827e150f3fde3b3817e427ca45d8c4b2c7 /doc | |
parent | 745c2c4cbf466b6ea6419ecd7e7586970195274e (diff) | |
parent | 7743895f9975293e9c605277d54918d9c0156b0a (diff) |
Merge branch 'master' of ssh://git-annex.branchable.com
Diffstat (limited to 'doc')
-rw-r--r-- | doc/forum/__34__git_annex_sync__34___synced_after_8_hours.mdwn | 40 | ||||
-rw-r--r-- | doc/forum/__34__git_annex_sync__34___synced_after_8_hours/comment_1_e815ac48a17cc4296473d61e712d95e0._comment | 13 |
2 files changed, 53 insertions, 0 deletions
diff --git a/doc/forum/__34__git_annex_sync__34___synced_after_8_hours.mdwn b/doc/forum/__34__git_annex_sync__34___synced_after_8_hours.mdwn new file mode 100644 index 000000000..2804828f5 --- /dev/null +++ b/doc/forum/__34__git_annex_sync__34___synced_after_8_hours.mdwn @@ -0,0 +1,40 @@ +Hi, + +The git annex seem has problem with many files. + +For synchronize, the operation lasts 8 hours. Here the sample for synchronizing to my local remote server (sbackup) + +start at **20:12** / end at **04:13** / total time = ~ **8 hours** + + git annex sync sbackup + + [2015-04-13 20:12:26 CEST] call: git ["--git-dir=.git","--work-tree=.","push","sbackup","+git-annex:synced/git-annex","master:synced/master"] + Counting objects: 792155, done. + Delta compression using up to 4 threads. + Compressing objects: 100% (789727/789727), done. + Writing objects: 100% (792155/792155), 75.73 MiB | 2.35 MiB/s, done. + Total 792155 (delta 449604), reused 1 (delta 0) + To partage@192.168.253.53:/data/samba/git-annex/docshare + ae182f0..fad3aca git-annex -> synced/git-annex + e0e67fe..5226a6f master -> synced/master + [2015-04-14 04:13:05 CEST] read: git ["--git-dir=.git","--work-tree=.","push","sbackup","git-annex","master"] + ok + +Another problem, I do not know exactly how many files I own (i use **find . | wc -l** ) + +.git = 1250633 + +documents = 61124 + +medias = 199504 + +it seem i own ~250000 files, but in the .git **1.2 millions files**. + +The following command also very slow + + git annex info + + +What the best pratices for use git annex with many files > 500 000 or maintenance & reduction/cleaning method + +Thanks diff --git a/doc/forum/__34__git_annex_sync__34___synced_after_8_hours/comment_1_e815ac48a17cc4296473d61e712d95e0._comment b/doc/forum/__34__git_annex_sync__34___synced_after_8_hours/comment_1_e815ac48a17cc4296473d61e712d95e0._comment new file mode 100644 index 000000000..4cc665e04 --- /dev/null +++ b/doc/forum/__34__git_annex_sync__34___synced_after_8_hours/comment_1_e815ac48a17cc4296473d61e712d95e0._comment @@ -0,0 +1,13 @@ +[[!comment format=mdwn + username="CandyAngel" + subject="comment 1" + date="2015-04-14T08:40:33Z" + content=""" +If you want a file count: + + git annex find | wc -l + +is probably the best measure. + +I have an annex with about several million files in it and it is slow, but not as slow as you are describing. Have you done a repack/gc cycle? +"""]] |