[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Parallel guix builds can trample?
From: |
Phil |
Subject: |
Re: Parallel guix builds can trample? |
Date: |
Tue, 18 Jan 2022 09:28:37 +0000 |
User-agent: |
mu4e 1.4.15; emacs 27.2 |
Maxime Devos writes:
> Maybe 'latest-repository-commit' and 'update-cached-checkout' commit
> can be modified to not use 'switch-to-ref', and instead directly ask
> libgit ‘what's the tree structure of commit cabba9e’ and call a
> procedure like 'add-file-tree-to-store'. That would avoid lock files,
> creating separate directories for concurrent checkouts, ...
Thanks Maxime - I'll take a look at this as an option.
One option I was thinking of is to make this SHA call dependent on the
branch as well as the URL:
https://github.com/guix-mirror/guix/blob/9f526f5dad5f4af69d158c50369e182305147f3b/guix/git.scm#L131-L133
Technically this still leaves a race condition if someone were to do
parallel builds on the same branch however, so to completely solve the
problem I think we'd have make the SHA call on repo+commit-id.
This obviously limit the utility of the cache.
To mitigate performance concerns, I think it's possible to set the
branches and depth in git such that we only clone the bare-bones only?.
- Parallel guix builds can trample?, Phil, 2022/01/11
- Re: Parallel guix builds can trample?, Ricardo Wurmus, 2022/01/11
- Re: Parallel guix builds can trample?, Philip Beadling, 2022/01/12
- Re: Parallel guix builds can trample?, Ricardo Wurmus, 2022/01/12
- Re: Parallel guix builds can trample?, Phil, 2022/01/12
- Re: Parallel guix builds can trample?, Phil Beadling, 2022/01/17
- Re: Parallel guix builds can trample?, Maxime Devos, 2022/01/17
- Re: Parallel guix builds can trample?,
Phil <=
- Re: Parallel guix builds can trample?, Maxime Devos, 2022/01/18
- Re: Parallel guix builds can trample?, Ludovic Courtès, 2022/01/18
- Re: Parallel guix builds can trample?, Phil, 2022/01/18
- Re: Parallel guix builds can trample?, Phil Beadling, 2022/01/18