qemu-commits
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Qemu-commits] [qemu/qemu] 698a71: tests/docker: move most cross compile


From: Peter Maydell
Subject: [Qemu-commits] [qemu/qemu] 698a71: tests/docker: move most cross compilers to buster ...
Date: Thu, 06 Feb 2020 02:00:14 -0800

  Branch: refs/heads/master
  Home:   https://github.com/qemu/qemu
  Commit: 698a71edbed64473ae239de29bf76ef61b5f8115
      
https://github.com/qemu/qemu/commit/698a71edbed64473ae239de29bf76ef61b5f8115
  Author: Alex Bennée <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M tests/docker/Makefile.include
    M tests/docker/dockerfiles/debian-amd64.docker
    M tests/docker/dockerfiles/debian-armel-cross.docker
    M tests/docker/dockerfiles/debian-armhf-cross.docker
    M tests/docker/dockerfiles/debian-mips64el-cross.docker
    M tests/docker/dockerfiles/debian-mipsel-cross.docker
    M tests/docker/dockerfiles/debian-ppc64el-cross.docker
    M tests/docker/dockerfiles/debian-s390x-cross.docker

  Log Message:
  -----------
  tests/docker: move most cross compilers to buster base

This includes fixing up the dependencies (Which were already wrong for
one of the mips variants).

Signed-off-by: Alex Bennée <address@hidden>
Reviewed-by: Philippe Mathieu-Daudé <address@hidden>
Tested-by: Philippe Mathieu-Daudé <address@hidden>
Message-Id: <address@hidden>


  Commit: 5e33f7fead59e072506a81df8ca3119a4d84f736
      
https://github.com/qemu/qemu/commit/5e33f7fead59e072506a81df8ca3119a4d84f736
  Author: Alex Bennée <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M tests/docker/docker.py

  Log Message:
  -----------
  tests/docker: better handle symlinked libs

When we are copying we want to ensure we grab the first
resolution (the found in path section). However even that binary might
be a symlink so lets make sure we chase the symlinks to copy the right
binary to where it can be found.

Signed-off-by: Alex Bennée <address@hidden>
Reviewed-by: Philippe Mathieu-Daudé <address@hidden>
Tested-by: Philippe Mathieu-Daudé <address@hidden>
Reviewed-by: Robert Foley <address@hidden>

Message-Id: <address@hidden>


  Commit: 58a1e5b6e24ad8be0252501ee22ea074fe87b09e
      
https://github.com/qemu/qemu/commit/58a1e5b6e24ad8be0252501ee22ea074fe87b09e
  Author: Wainer dos Santos Moschetta <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  travis.yml: Install genisoimage package

The genisoimage program is required for tests/cdrom-test
tests, otherwise they are skipped. The current Travis
environments do not provide it by default, so let's
explicitly require the genisoimage package.

Signed-off-by: Wainer dos Santos Moschetta <address@hidden>
Reviewed-by: Thomas Huth <address@hidden>
Reviewed-by: Philippe Mathieu-Daudé <address@hidden>
Tested-by: Philippe Mathieu-Daudé <address@hidden>
Signed-off-by: Alex Bennée <address@hidden>
Message-Id: <address@hidden>
Message-Id: <address@hidden>


  Commit: f2dfb09ceb6ac1887b75993a3c078e62daab29e6
      
https://github.com/qemu/qemu/commit/f2dfb09ceb6ac1887b75993a3c078e62daab29e6
  Author: Alex Bennée <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M .shippable.yml

  Log Message:
  -----------
  .shippable: --disable-docs for cross-compile tests

The sphinx support is fairly new and we don't seem to have all the
bugs worked out for cross development environments right now.

Signed-off-by: Alex Bennée <address@hidden>
Reviewed-by: Philippe Mathieu-Daudé <address@hidden>
Tested-by: Philippe Mathieu-Daudé <address@hidden>
Message-Id: <address@hidden>


  Commit: 5311cb12e970ae6ba4395aa0c3b7674ba237451b
      
https://github.com/qemu/qemu/commit/5311cb12e970ae6ba4395aa0c3b7674ba237451b
  Author: Philippe Mathieu-Daudé <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  .travis.yml: Drop superfluous use of --python=python3 parameter

As we require Python3 since commit ddf9069963, we don't need to
explicit it with the --python=/usr/bin/python3 configure option.

Reported-by: Thomas Huth <address@hidden>
Signed-off-by: Philippe Mathieu-Daudé <address@hidden>
Signed-off-by: Alex Bennée <address@hidden>
Message-Id: <address@hidden>
Message-Id: <address@hidden>


  Commit: 097aebd8b6141f5048f81cbb527520679f4e0a21
      
https://github.com/qemu/qemu/commit/097aebd8b6141f5048f81cbb527520679f4e0a21
  Author: Philippe Mathieu-Daudé <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  .travis.yml: Add description to each job

The NAME variable can be used to describe nicely a job (see [*]).
As we currently have 32 jobs, use it. This helps for quickly
finding a particular job.

  before: https://travis-ci.org/qemu/qemu/builds/639887646
  after: https://travis-ci.org/philmd/qemu/builds/641795043

[*] 
https://docs.travis-ci.com/user/customizing-the-build/#naming-jobs-within-matrices

Signed-off-by: Philippe Mathieu-Daudé <address@hidden>
Signed-off-by: Alex Bennée <address@hidden>
Message-Id: <address@hidden>
Message-Id: <address@hidden>


  Commit: 204b30e2e274dcace80abf9d2441248a1b67929d
      
https://github.com/qemu/qemu/commit/204b30e2e274dcace80abf9d2441248a1b67929d
  Author: Alex Bennée <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  .travis.yml: build documents under bionic

It looks like the xenial tooling doesn't like something in our setup.
We should probably be moving to bionic for everything soon
anyway (libssh aside).

Signed-off-by: Alex Bennée <address@hidden>
Reviewed-by: Philippe Mathieu-Daudé <address@hidden>
Tested-by: Philippe Mathieu-Daudé <address@hidden>
Message-Id: <address@hidden>


  Commit: b3165c874e940653c9d3ef5224c0b928277d2b88
      
https://github.com/qemu/qemu/commit/b3165c874e940653c9d3ef5224c0b928277d2b88
  Author: Alex Bennée <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  .travis.yml: move cache flushing to early common phase

We shall be adding more common early setup in a future commit.

Signed-off-by: Alex Bennée <address@hidden>
Reviewed-by: Philippe Mathieu-Daudé <address@hidden>
Tested-by: Philippe Mathieu-Daudé <address@hidden>
Message-Id: <address@hidden>


  Commit: 0a7c0ae0534deed06e9a045324a03c09677d4c93
      
https://github.com/qemu/qemu/commit/0a7c0ae0534deed06e9a045324a03c09677d4c93
  Author: Alex Bennée <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  .travis.yml: probe for number of available processors

The arm64 hardware was especially hit by only building on 3 of the 32
available cores. Introduce a JOBS environment variable which we use
for all parallel builds. We still run the main checks single threaded
though so to make it easier to spot hangs.

Signed-off-by: Alex Bennée <address@hidden>
Reviewed-by: Thomas Huth <address@hidden>
Reviewed-by: Philippe Mathieu-Daudé <address@hidden>
Tested-by: Philippe Mathieu-Daudé <address@hidden>
Message-Id: <address@hidden>


  Commit: ded663a226de48892ce7a2875c7bca579b65080c
      
https://github.com/qemu/qemu/commit/ded663a226de48892ce7a2875c7bca579b65080c
  Author: Alex Bennée <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M tests/tcg/configure.sh

  Log Message:
  -----------
  tests/tcg: add a configure compiler check for ARMv8.1 and SVE

We will need this for some tests later. The docker images already
support it by default.

Signed-off-by: Alex Bennée <address@hidden>
Reviewed-by: Richard Henderson <address@hidden>
Message-Id: <address@hidden>


  Commit: bb516dfc5b389d1f557752715891a3eedef136f4
      
https://github.com/qemu/qemu/commit/bb516dfc5b389d1f557752715891a3eedef136f4
  Author: Alex Bennée <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M tests/tcg/aarch64/Makefile.softmmu-target
    M tests/tcg/aarch64/Makefile.target
    M tests/tcg/configure.sh

  Log Message:
  -----------
  tests/tcg: gate pauth-% tests on having compiler support

Otherwise we end up failing to build our tests on CI which may have
older compilers that the user expects. We can get rid of this once we
can fallback to multiarch containers.

Signed-off-by: Alex Bennée <address@hidden>
Message-Id: <address@hidden>


  Commit: 4f46afd986df4025dbc43cc86f4da33f70c21e04
      
https://github.com/qemu/qemu/commit/4f46afd986df4025dbc43cc86f4da33f70c21e04
  Author: Alex Bennée <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  .travis.yml: introduce TEST_BUILD_CMD and use it for check-tcg

At least for check-tcg we can split the build phase from the test
phase and do the former in parallel. While we are at it drop the V=1
for the check-tcg part as it just generates a lot more noise in the
logs.

Signed-off-by: Alex Bennée <address@hidden>
Reviewed-by: Philippe Mathieu-Daudé <address@hidden>
Tested-by: Philippe Mathieu-Daudé <address@hidden>
Message-Id: <address@hidden>


  Commit: ec49faacd616942f716e404c70766846c5b3c8dd
      
https://github.com/qemu/qemu/commit/ec49faacd616942f716e404c70766846c5b3c8dd
  Author: Alex Bennée <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  .travis.yml: drop the travis_retry from tests

This was a crutch when we introduced it - however it does have the
disadvantage of causing tests to timeout with large amounts of logs.
Lets drop it and see if the stability has improved since.

Signed-off-by: Alex Bennée <address@hidden>
Reviewed-by: Philippe Mathieu-Daudé <address@hidden>
Tested-by: Philippe Mathieu-Daudé <address@hidden>
Message-Id: <address@hidden>


  Commit: 7986f4866075d2f2a3d241c9e38cc14d7b5832a0
      
https://github.com/qemu/qemu/commit/7986f4866075d2f2a3d241c9e38cc14d7b5832a0
  Author: Alex Bennée <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  .travis.yml: drop cris-linux-user from the plugins test

While it shouldn't cause problems we will never get useful information
from cris as it has yet to be converted to the common translator loop.
It also causes the Travis CI to fail for weird reasons which I have so
far been unable to replicate on a normal Xenial system.

Signed-off-by: Alex Bennée <address@hidden>
Message-Id: <address@hidden>


  Commit: 73217f3ed47c7e9e2351d07d169df376466f18e6
      
https://github.com/qemu/qemu/commit/73217f3ed47c7e9e2351d07d169df376466f18e6
  Author: Alex Bennée <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  .travis.yml: single thread build-tcg

I've theorised that a parallel build-tcg is somehow getting confused
when two fedora-30 based cross compilers attempt to build at the same
time. From one data-point so far this may fix the problem although the
plugins job runs quite close to timeout.

Signed-off-by: Alex Bennée <address@hidden>
Message-Id: <address@hidden>


  Commit: 68e5b85e41fe7684e58cd077772b7d1e8bc092c7
      
https://github.com/qemu/qemu/commit/68e5b85e41fe7684e58cd077772b7d1e8bc092c7
  Author: Alex Bennée <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M .travis.yml

  Log Message:
  -----------
  .travis.yml: ensure python3-sphinx installed for docs

Signed-off-by: Alex Bennée <address@hidden>
Reviewed-by: Philippe Mathieu-Daudé <address@hidden>
Message-Id: <address@hidden>


  Commit: 418fa86dd465b4fd8394373cf83db8fa65d7611c
      
https://github.com/qemu/qemu/commit/418fa86dd465b4fd8394373cf83db8fa65d7611c
  Author: Peter Maydell <address@hidden>
  Date:   2020-02-04 (Tue, 04 Feb 2020)

  Changed paths:
    M .shippable.yml
    M .travis.yml
    M tests/docker/Makefile.include
    M tests/docker/docker.py
    M tests/docker/dockerfiles/debian-amd64.docker
    M tests/docker/dockerfiles/debian-armel-cross.docker
    M tests/docker/dockerfiles/debian-armhf-cross.docker
    M tests/docker/dockerfiles/debian-mips64el-cross.docker
    M tests/docker/dockerfiles/debian-mipsel-cross.docker
    M tests/docker/dockerfiles/debian-ppc64el-cross.docker
    M tests/docker/dockerfiles/debian-s390x-cross.docker
    M tests/tcg/aarch64/Makefile.softmmu-target
    M tests/tcg/aarch64/Makefile.target
    M tests/tcg/configure.sh

  Log Message:
  -----------
  Merge remote-tracking branch 'remotes/stsquad/tags/pull-testing-040220-1' 
into staging

Testing updates and build fixes:

  - move more cross compilers to buster
  - fix build breakage (hppa Kconfig)
  - disable docs on shippable
  - build docs under bionic with python3
  - travis.yml re-factoring
  - check capabilities of non-docker compilers
  - smarter make -j parallelism

# gpg: Signature made Tue 04 Feb 2020 17:16:40 GMT
# gpg:                using RSA key 6685AE99E75167BCAFC8DF35FBD0DB095A9E2A44
# gpg: Good signature from "Alex Bennée (Master Work Key) <address@hidden>" 
[full]
# Primary key fingerprint: 6685 AE99 E751 67BC AFC8  DF35 FBD0 DB09 5A9E 2A44

* remotes/stsquad/tags/pull-testing-040220-1:
  .travis.yml: ensure python3-sphinx installed for docs
  .travis.yml: single thread build-tcg
  .travis.yml: drop cris-linux-user from the plugins test
  .travis.yml: drop the travis_retry from tests
  .travis.yml: introduce TEST_BUILD_CMD and use it for check-tcg
  tests/tcg: gate pauth-% tests on having compiler support
  tests/tcg: add a configure compiler check for ARMv8.1 and SVE
  .travis.yml: probe for number of available processors
  .travis.yml: move cache flushing to early common phase
  .travis.yml: build documents under bionic
  .travis.yml: Add description to each job
  .travis.yml: Drop superfluous use of --python=python3 parameter
  .shippable: --disable-docs for cross-compile tests
  travis.yml: Install genisoimage package
  tests/docker: better handle symlinked libs
  tests/docker: move most cross compilers to buster base

Signed-off-by: Peter Maydell <address@hidden>


Compare: https://github.com/qemu/qemu/compare/7bd9d0a9e26c...418fa86dd465



reply via email to

[Prev in Thread] Current Thread [Next in Thread]