But why couldn't they just dedupe the refs from the command line before starting... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		rjmunro 74 days ago \| parent \| context \| favorite \| on: How we decreased GitLab repo backup times from 48 ... But why couldn't they just dedupe the refs from the command line before starting the actual bundling - surely there are never more than a couple of hundred of those (one per branch)?

6LLvveMx2koXfwn 73 days ago [–]

The point is the performance hit had nothing to do with dupe count (which could be zero), and everything to do with ref count.

nayak 72 days ago | [–]

Spot on. Some of our repositories at GitLab can contain millions of references.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact