[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[PULL 1/8] gitlab: aggressively avoid extra GIT data
From: |
Alex Bennée |
Subject: |
[PULL 1/8] gitlab: aggressively avoid extra GIT data |
Date: |
Tue, 12 Mar 2024 11:25:25 +0000 |
This avoids fetching blobs and tree references for branches we are not
going to worry about. Also skip tag references which are similarly not
useful and keep the default --prune. This keeps the .git data to
around 100M rather than the ~400M even a shallow clone takes.
So we can check the savings we also run a quick du while setting up
the build.
We also have to have special settings of GIT_FETCH_EXTRA_FLAGS for the
Windows build (git too old?) and the migration legacy test where we
build an older QEMU alongside the main one.
Signed-off-by: Alex Bennée <alex.bennee@linaro.org>
diff --git a/.gitlab-ci.d/base.yml b/.gitlab-ci.d/base.yml
index 2dd8a9b57c..bf3d8efab6 100644
--- a/.gitlab-ci.d/base.yml
+++ b/.gitlab-ci.d/base.yml
@@ -24,6 +24,10 @@ variables:
# Each script line from will be in a collapsible section in the job output
# and show the duration of each line.
FF_SCRIPT_SECTIONS: 1
+ # The project has a fairly fat GIT repo so we try and avoid bringing in
things
+ # we don't need. The --filter options avoid blobs and tree references we
aren't going to use
+ # and we also avoid fetching tags.
+ GIT_FETCH_EXTRA_FLAGS: --filter=blob:none --filter=tree:0 --no-tags
--prune --quiet
interruptible: true
diff --git a/.gitlab-ci.d/buildtest-template.yml
b/.gitlab-ci.d/buildtest-template.yml
index 4fbfeb6667..22045add80 100644
--- a/.gitlab-ci.d/buildtest-template.yml
+++ b/.gitlab-ci.d/buildtest-template.yml
@@ -14,6 +14,7 @@
- export CCACHE_DIR="$CCACHE_BASEDIR/ccache"
- export CCACHE_MAXSIZE="500M"
- export PATH="$CCACHE_WRAPPERSDIR:$PATH"
+ - du -sh .git
- mkdir build
- cd build
- ccache --zero-stats
diff --git a/.gitlab-ci.d/buildtest.yml b/.gitlab-ci.d/buildtest.yml
index c7d92fc301..cfdff175c3 100644
--- a/.gitlab-ci.d/buildtest.yml
+++ b/.gitlab-ci.d/buildtest.yml
@@ -187,6 +187,8 @@ build-previous-qemu:
variables:
IMAGE: opensuse-leap
TARGETS: x86_64-softmmu aarch64-softmmu
+ # Override the default flags as we need more to grab the old version
+ GIT_FETCH_EXTRA_FLAGS: --prune --quiet
before_script:
- export QEMU_PREV_VERSION="$(sed 's/\([0-9.]*\)\.[0-9]*/v\1.0/' VERSION)"
- git remote add upstream https://gitlab.com/qemu-project/qemu
diff --git a/.gitlab-ci.d/windows.yml b/.gitlab-ci.d/windows.yml
index f116b8012d..94834269ec 100644
--- a/.gitlab-ci.d/windows.yml
+++ b/.gitlab-ci.d/windows.yml
@@ -28,6 +28,8 @@ msys2-64bit:
# qTests don't run successfully with "--without-default-devices",
# so let's exclude the qtests from CI for now.
TEST_ARGS: --no-suite qtest
+ # The Windows git is a bit older so override the default
+ GIT_FETCH_EXTRA_FLAGS: --no-tags --prune --quiet
artifacts:
name: "$CI_JOB_NAME-$CI_COMMIT_REF_SLUG"
expire_in: 7 days
--
2.39.2
- [PULL for 9.0 0/8] final maintainer updates (testing, gdbstub), Alex Bennée, 2024/03/12
- [PULL 3/8] gdbstub: Rename back gdb_handlesig, Alex Bennée, 2024/03/12
- [PULL 1/8] gitlab: aggressively avoid extra GIT data,
Alex Bennée <=
- [PULL 2/8] tests/vm: ensure we build everything by default, Alex Bennée, 2024/03/12
- [PULL 7/8] tests/tcg: Add multiarch test for Xfer:siginfo:read stub, Alex Bennée, 2024/03/12
- [PULL 5/8] gdbstub: Save target's siginfo, Alex Bennée, 2024/03/12
- [PULL 6/8] gdbstub: Add Xfer:siginfo:read stub, Alex Bennée, 2024/03/12
- [PULL 8/8] gdbstub: Fix double close() of the follow-fork-mode socket, Alex Bennée, 2024/03/12
- [PULL 4/8] linux-user: Move tswap_siginfo out of target code, Alex Bennée, 2024/03/12
- Re: [PULL for 9.0 0/8] final maintainer updates (testing, gdbstub), Peter Maydell, 2024/03/12