aboutsummaryrefslogtreecommitdiff
path: root/doc/bugs/Out_of_memory_error_when_adding_large_files_to_v6_repository/comment_1_b9154c38406fca40c4c0edb716707c3a._comment
blob: 9ef59ed710fbf203606fb2246dd2c2b3fa909e9b (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
[[!comment format=mdwn
 username="joey"
 subject="""comment 1"""
 date="2017-06-09T17:34:40Z"
 content="""
Unfortunately, git add tries to load the whole file content
into memory (or at least allocates a buffer for it all),
even if it's only going to stream it through the clean filter
used in v6 mode, and even though the git-annex smudge
filter reads the file content from disk itself.

I submitted a patch to git over a year ago, that IIRC fixes this kind of
problem, but it was not accepted. Getting an updated version of that patch
accepted into git is the main blocker for v6 repositories to not be
experimental.

[[todo/smudge]] documents this problem. I'm going to close this bug
as it's a duplicate of stuff discussed there.
"""]]