summaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorGravatar Joey Hess <joeyh@joeyh.name>2015-04-14 14:24:42 -0400
committerGravatar Joey Hess <joeyh@joeyh.name>2015-04-14 14:24:42 -0400
commit47bd6a31b4e204d6a8d32be059feaf68d6d39bfb (patch)
treeb6e0b0827e150f3fde3b3817e427ca45d8c4b2c7
parent745c2c4cbf466b6ea6419ecd7e7586970195274e (diff)
parent7743895f9975293e9c605277d54918d9c0156b0a (diff)
Merge branch 'master' of ssh://git-annex.branchable.com
-rw-r--r--doc/forum/__34__git_annex_sync__34___synced_after_8_hours.mdwn40
-rw-r--r--doc/forum/__34__git_annex_sync__34___synced_after_8_hours/comment_1_e815ac48a17cc4296473d61e712d95e0._comment13
2 files changed, 53 insertions, 0 deletions
diff --git a/doc/forum/__34__git_annex_sync__34___synced_after_8_hours.mdwn b/doc/forum/__34__git_annex_sync__34___synced_after_8_hours.mdwn
new file mode 100644
index 000000000..2804828f5
--- /dev/null
+++ b/doc/forum/__34__git_annex_sync__34___synced_after_8_hours.mdwn
@@ -0,0 +1,40 @@
+Hi,
+
+The git annex seem has problem with many files.
+
+For synchronize, the operation lasts 8 hours. Here the sample for synchronizing to my local remote server (sbackup)
+
+start at **20:12** / end at **04:13** / total time = ~ **8 hours**
+
+ git annex sync sbackup
+
+ [2015-04-13 20:12:26 CEST] call: git ["--git-dir=.git","--work-tree=.","push","sbackup","+git-annex:synced/git-annex","master:synced/master"]
+ Counting objects: 792155, done.
+ Delta compression using up to 4 threads.
+ Compressing objects: 100% (789727/789727), done.
+ Writing objects: 100% (792155/792155), 75.73 MiB | 2.35 MiB/s, done.
+ Total 792155 (delta 449604), reused 1 (delta 0)
+ To partage@192.168.253.53:/data/samba/git-annex/docshare
+ ae182f0..fad3aca git-annex -> synced/git-annex
+ e0e67fe..5226a6f master -> synced/master
+ [2015-04-14 04:13:05 CEST] read: git ["--git-dir=.git","--work-tree=.","push","sbackup","git-annex","master"]
+ ok
+
+Another problem, I do not know exactly how many files I own (i use **find . | wc -l** )
+
+.git = 1250633
+
+documents = 61124
+
+medias = 199504
+
+it seem i own ~250000 files, but in the .git **1.2 millions files**.
+
+The following command also very slow
+
+ git annex info
+
+
+What the best pratices for use git annex with many files > 500 000 or maintenance & reduction/cleaning method
+
+Thanks
diff --git a/doc/forum/__34__git_annex_sync__34___synced_after_8_hours/comment_1_e815ac48a17cc4296473d61e712d95e0._comment b/doc/forum/__34__git_annex_sync__34___synced_after_8_hours/comment_1_e815ac48a17cc4296473d61e712d95e0._comment
new file mode 100644
index 000000000..4cc665e04
--- /dev/null
+++ b/doc/forum/__34__git_annex_sync__34___synced_after_8_hours/comment_1_e815ac48a17cc4296473d61e712d95e0._comment
@@ -0,0 +1,13 @@
+[[!comment format=mdwn
+ username="CandyAngel"
+ subject="comment 1"
+ date="2015-04-14T08:40:33Z"
+ content="""
+If you want a file count:
+
+ git annex find | wc -l
+
+is probably the best measure.
+
+I have an annex with about several million files in it and it is slow, but not as slow as you are describing. Have you done a repack/gc cycle?
+"""]]