Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Does it solve the large-file bottleneck? Then I might use it for my deep learning models.


No, Git's object store was not designed to hold large binary blobs, and no implementation of Git in any language can change this. It's a reasonable request; I mean, Git doesn't even deal with "pretty small" binary files very well, either. But it's all simply a consequence of its design that was thought up all those years ago.

The core object storage model and data format (and many, many things on top of those) have to be changed/extended/fixed first, but it's realistically an immense change, so git-lfs and other various solutions are about as good as it'll get in the mean time.


It doesn't, since Git's data model has to be changed to content-defined chunks to solve the issue.

You should look at git-lfs[1] instead.

[1] https://git-lfs.com


I've tried it but it doesn't play nice with git-shell, and thus for me is too much of a hassle to set up.

Also, I'm not a huge fan of tools that implement important functionality as an afterthought, especially if those tools deal with my precious data.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: