[Qemu-commits] [qemu/qemu] 6634f1: MAINTAINERS: Add an entry to review Avocado based ...

[Peter Maydell]

  Branch: refs/heads/master
  Home:   https://github.com/qemu/qemu
  Commit: 6634f1c43d0e2f26ab2cc71d1f53a25c5b56bdd9
      
https://github.com/qemu/qemu/commit/6634f1c43d0e2f26ab2cc71d1f53a25c5b56bdd9
  Author: Philippe Mathieu-Daudé <philmd@redhat.com>
  Date:   2020-06-21 (Sun, 21 Jun 2020)

  Changed paths:
    M MAINTAINERS

  Log Message:
  -----------
  MAINTAINERS: Add an entry to review Avocado based acceptance tests

    Acceptance tests can test any piece of the QEMU codebase.
    As such, the directory holding them does not belong to a specific
    subsystem with designated maintainers.

    Each subsystem covered by a test is welcomed to add the test path
    to its section.
    See for example commits 71b290e70, b11785ca2 or 5d480ddde.

Add an entry for to allow reviewers to be notified when acceptance /
integration tests are added or modified.
The designated reviewers are not maintainers, subsystem maintainers
are expected to merge their tests.

Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Acked-by: Eduardo Habkost <ehabkost@redhat.com>
Acked-by: Cleber Rosa <crosa@redhat.com>
Message-Id: <20200129212345.20547-30-philmd@redhat.com>
Message-Id: <20200605165656.17578-1-philmd@redhat.com>


  Commit: c7ebab0f16fd4e0dc3dd6d9c7ea73876a9db88f5
      
https://github.com/qemu/qemu/commit/c7ebab0f16fd4e0dc3dd6d9c7ea73876a9db88f5
  Author: Pavel Dovgalyuk <Pavel.Dovgaluk@gmail.com>
  Date:   2020-06-21 (Sun, 21 Jun 2020)

  Changed paths:
    M MAINTAINERS
    A tests/acceptance/replay_kernel.py

  Log Message:
  -----------
  tests/acceptance: add base class record/replay kernel tests

This patch adds a base for testing kernel boot recording and replaying.
Each test has the phase of recording and phase of replaying.
Virtual machines just boot the kernel and do not interact with
the network.
Structure and image links for the tests are borrowed from boot_linux_console.py
Testing controls the message pattern at the end of the kernel
boot for both record and replay modes. In replay mode QEMU is also
intended to finish the execution automatically.

Signed-off-by: Pavel Dovgalyuk <Pavel.Dovgaluk@ispras.ru>
Tested-by: Philippe Mathieu-Daude <philmd@redhat.com>
Message-Id: <159073589099.20809.14078431743098373301.stgit@pasha-ThinkPad-X280>
Reviewed-by: Philippe Mathieu-Daudé <philmd@redhat.com>
[PMD: Keep imports sorted alphabetically]
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 904be130b21f21b0aa0e8a9210dfda7b80278b28
      
https://github.com/qemu/qemu/commit/904be130b21f21b0aa0e8a9210dfda7b80278b28
  Author: Pavel Dovgalyuk <Pavel.Dovgaluk@gmail.com>
  Date:   2020-06-21 (Sun, 21 Jun 2020)

  Changed paths:
    M tests/acceptance/replay_kernel.py

  Log Message:
  -----------
  tests/acceptance: add kernel record/replay test for x86_64

This patch adds a test for record/replay an execution of x86_64 machine.
Execution scenario includes simple kernel boot, which allows testing
basic hardware interaction in RR mode.

Signed-off-by: Pavel Dovgalyuk <Pavel.Dovgaluk@ispras.ru>
Tested-by: Philippe Mathieu-Daude <philmd@redhat.com>
Message-Id: <159073589656.20809.14010247947948822435.stgit@pasha-ThinkPad-X280>
Reviewed-by: Philippe Mathieu-Daudé <philmd@redhat.com>
[PMD: Skip test_x86_64_pc on Travis-CI]
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 152a41b774df3adc20fa968260306c13431d543f
      
https://github.com/qemu/qemu/commit/152a41b774df3adc20fa968260306c13431d543f
  Author: Pavel Dovgalyuk <Pavel.Dovgaluk@gmail.com>
  Date:   2020-06-21 (Sun, 21 Jun 2020)

  Changed paths:
    M tests/acceptance/replay_kernel.py

  Log Message:
  -----------
  tests/acceptance: add record/replay test for aarch64

This patch adds a test for record/replay of the kernel
image boot for aarch64 platform.

Signed-off-by: Pavel Dovgalyuk <Pavel.Dovgaluk@ispras.ru>
Tested-by: Philippe Mathieu-Daude <philmd@redhat.com>
Message-Id: <159073590231.20809.9842179251741585482.stgit@pasha-ThinkPad-X280>
Reviewed-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 2f2d83ad2e588e85ad0e7e9ab24ef62af694f34f
      
https://github.com/qemu/qemu/commit/2f2d83ad2e588e85ad0e7e9ab24ef62af694f34f
  Author: Pavel Dovgalyuk <Pavel.Dovgaluk@gmail.com>
  Date:   2020-06-21 (Sun, 21 Jun 2020)

  Changed paths:
    M tests/acceptance/replay_kernel.py

  Log Message:
  -----------
  tests/acceptance: add record/replay test for arm

This patch adds a test for record/replay of the kernel
image boot for two different arm platforms.

Signed-off-by: Pavel Dovgalyuk <Pavel.Dovgaluk@ispras.ru>
Tested-by: Philippe Mathieu-Daude <philmd@redhat.com>
Message-Id: <159073590785.20809.17654573764167037499.stgit@pasha-ThinkPad-X280>
Reviewed-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 2e1206b9cb03894e824e1eaa2a81a0248b4abcba
      
https://github.com/qemu/qemu/commit/2e1206b9cb03894e824e1eaa2a81a0248b4abcba
  Author: Pavel Dovgalyuk <Pavel.Dovgaluk@gmail.com>
  Date:   2020-06-21 (Sun, 21 Jun 2020)

  Changed paths:
    M tests/acceptance/replay_kernel.py

  Log Message:
  -----------
  tests/acceptance: add record/replay test for ppc64

This patch adds a test for record/replay of the kernel
image boot for ppc64 platform.

Signed-off-by: Pavel Dovgalyuk <Pavel.Dovgaluk@ispras.ru>
Tested-by: Philippe Mathieu-Daude <philmd@redhat.com>
Message-Id: <159073591363.20809.15658672985367330140.stgit@pasha-ThinkPad-X280>
Reviewed-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 20b1bf2ea907a69d64ba50d3c737bba95231fc8d
      
https://github.com/qemu/qemu/commit/20b1bf2ea907a69d64ba50d3c737bba95231fc8d
  Author: Pavel Dovgalyuk <Pavel.Dovgaluk@gmail.com>
  Date:   2020-06-21 (Sun, 21 Jun 2020)

  Changed paths:
    M tests/acceptance/replay_kernel.py

  Log Message:
  -----------
  tests/acceptance: add record/replay test for m68k

This patch adds a test for record/replay of the kernel
image boot for m68k platform.

Signed-off-by: Pavel Dovgalyuk <Pavel.Dovgaluk@ispras.ru>
Tested-by: Philippe Mathieu-Daude <philmd@redhat.com>
Reviewed-by: Laurent Vivier <laurent@vivier.eu>
Message-Id: <159073592033.20809.1838967871297177313.stgit@pasha-ThinkPad-X280>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: b52d7e216c663ae89c65d656faf3a80b1c05737e
      
https://github.com/qemu/qemu/commit/b52d7e216c663ae89c65d656faf3a80b1c05737e
  Author: Pavel Dovgalyuk <Pavel.Dovgaluk@gmail.com>
  Date:   2020-06-21 (Sun, 21 Jun 2020)

  Changed paths:
    M tests/acceptance/replay_kernel.py

  Log Message:
  -----------
  tests/acceptance: record/replay tests with advcal images

This patch adds more record/replay tests with kernel images.

Signed-off-by: Pavel Dovgalyuk <Pavel.Dovgaluk@ispras.ru>
Tested-by: Philippe Mathieu-Daude <philmd@redhat.com>
Message-Id: <159073592589.20809.5156301499042635614.stgit@pasha-ThinkPad-X280>
Reviewed-by: Philippe Mathieu-Daudé <philmd@redhat.com>
[PMD: Use os.path.join(), add avocado 'cpu' tags]
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 61fee7f45955cd0bf9b79be9fa9c7ebabb5e6a85
      
https://github.com/qemu/qemu/commit/61fee7f45955cd0bf9b79be9fa9c7ebabb5e6a85
  Author: Peter Maydell <peter.maydell@linaro.org>
  Date:   2020-06-22 (Mon, 22 Jun 2020)

  Changed paths:
    M MAINTAINERS
    A tests/acceptance/replay_kernel.py

  Log Message:
  -----------
  Merge remote-tracking branch 
'remotes/philmd-gitlab/tags/acceptance-testing-20200622' into staging

Acceptance tests patches

- List acceptance test reviewers in MAINTAINERS
- Record/Replay tests from Pavel Dovgalyuk

Example of use:

$ avocado --show=app,replay run -t machine:vexpress-a9 
tests/acceptance/replay_kernel.py
Fetching asset from 
tests/acceptance/replay_kernel.py:ReplayKernel.test_arm_vexpressa9
 (1/1) tests/acceptance/replay_kernel.py:ReplayKernel.test_arm_vexpressa9:
replay: recording the execution...
replay: finished the recording with log size 204784 bytes
replay: elapsed time 6.44 sec
replay: replaying the execution...
replay: successfully finished the replay
replay: elapsed time 7.97 sec
replay: replay overhead 23.86%
PASS (14.67 s)

Travis-CI:
https://travis-ci.org/github/philmd/qemu/jobs/700787719

# gpg: Signature made Mon 22 Jun 2020 09:58:13 BST
# gpg:                using RSA key FAABE75E12917221DCFD6BB2E3E32C2CDEADC0DE
# gpg: Good signature from "Philippe Mathieu-Daudé (F4BUG) <f4bug@amsat.org>" 
[full]
# Primary key fingerprint: FAAB E75E 1291 7221 DCFD  6BB2 E3E3 2C2C DEAD C0DE

* remotes/philmd-gitlab/tags/acceptance-testing-20200622:
  tests/acceptance: record/replay tests with advcal images
  tests/acceptance: add record/replay test for m68k
  tests/acceptance: add record/replay test for ppc64
  tests/acceptance: add record/replay test for arm
  tests/acceptance: add record/replay test for aarch64
  tests/acceptance: add kernel record/replay test for x86_64
  tests/acceptance: add base class record/replay kernel tests
  MAINTAINERS: Add an entry to review Avocado based acceptance tests

Signed-off-by: Peter Maydell <peter.maydell@linaro.org>


Compare: https://github.com/qemu/qemu/compare/171199f56f5f...61fee7f45955