qemu-commits
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Qemu-commits] [qemu/qemu] 162127: tests/acceptance: Extract tesseract_a


From: Peter Maydell
Subject: [Qemu-commits] [qemu/qemu] 162127: tests/acceptance: Extract tesseract_available() he...
Date: Mon, 08 Feb 2021 12:23:28 -0800

  Branch: refs/heads/staging
  Home:   https://github.com/qemu/qemu
  Commit: 162127f29f2a5a628ecea79d4718d3a51b1bffac
      
https://github.com/qemu/qemu/commit/162127f29f2a5a628ecea79d4718d3a51b1bffac
  Author: Philippe Mathieu-Daudé <f4bug@amsat.org>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M tests/acceptance/machine_m68k_nextcube.py
    A tests/acceptance/tesseract_utils.py

  Log Message:
  -----------
  tests/acceptance: Extract tesseract_available() helper in new namespace

We are going to reuse tesseract_available(). Extract it to
a new 'tesseract_utils' namespace.

Signed-off-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Reviewed-by: Thomas Huth <thuth@redhat.com>
Message-Id: <20201021105035.2477784-4-f4bug@amsat.org>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: ca8224492854a2930d0cadc76e715bf59582bf66
      
https://github.com/qemu/qemu/commit/ca8224492854a2930d0cadc76e715bf59582bf66
  Author: Philippe Mathieu-Daudé <f4bug@amsat.org>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M tests/acceptance/machine_m68k_nextcube.py
    M tests/acceptance/tesseract_utils.py

  Log Message:
  -----------
  tests/acceptance: Introduce tesseract_ocr() helper

We are going to reuse the tesseract OCR code.
Create a new tesseract_ocr() helper and use it.

Signed-off-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Message-Id: <20201021105035.2477784-5-f4bug@amsat.org>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 108a76da763aa33a72842c5d0785f5523067bfa7
      
https://github.com/qemu/qemu/commit/108a76da763aa33a72842c5d0785f5523067bfa7
  Author: Philippe Mathieu-Daudé <f4bug@amsat.org>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M tests/acceptance/boot_linux_console.py

  Log Message:
  -----------
  tests/acceptance: Extract do_test_arm_orangepi_armbian_uboot() method

As we want to reuse the same U-Boot test for multiple
Armbian releases, extract the common part as
do_test_arm_orangepi_armbian_uboot().

Signed-off-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Tested-by: Bin Meng <bin.meng@windriver.com>
Tested-by: Niek Linnenbank <nieklinnenbank@gmail.com>
Message-Id: <20201023131808.3198005-4-f4bug@amsat.org>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 093aac4ab2059d02bc137476198cdd5791ab0b08
      
https://github.com/qemu/qemu/commit/093aac4ab2059d02bc137476198cdd5791ab0b08
  Author: Philippe Mathieu-Daudé <f4bug@amsat.org>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M tests/acceptance/boot_linux_console.py

  Log Message:
  -----------
  tests/acceptance: Test U-Boot/Linux from Armbian 20.08 on Orange Pi PC

Test U-Boot and Linux on the recent Armbian release 20.08.

Suggested-by: Cleber Rosa <crosa@redhat.com>
Tested-by: Niek Linnenbank <nieklinnenbank@gmail.com>
Tested-by: Bin Meng <bin.meng@windriver.com>
Signed-off-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Message-Id: <20201023131808.3198005-5-f4bug@amsat.org>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: c592f70cae94faef7c9f915ce49d4b8edb6d71ea
      
https://github.com/qemu/qemu/commit/c592f70cae94faef7c9f915ce49d4b8edb6d71ea
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M MAINTAINERS
    M tests/acceptance/boot_linux_console.py
    A tests/acceptance/machine_ppc.py

  Log Message:
  -----------
  tests/acceptance: Move the pseries test to a separate file

Let's gather the POWER-related tests in a separate file.

Signed-off-by: Thomas Huth <thuth@redhat.com>
Reviewed-by: Wainer dos Santos Moschetta <wainersm@redhat.com>
Reviewed-by: Willian Rampazzo <willianr@redhat.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Acked-by: David Gibson <david@gibson.dropbear.id.au>
Message-Id: <20210112164045.98565-2-thuth@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 46c647e69d6525c63bc235d96b5956130dc3f04f
      
https://github.com/qemu/qemu/commit/46c647e69d6525c63bc235d96b5956130dc3f04f
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M tests/acceptance/machine_ppc.py

  Log Message:
  -----------
  tests/acceptance: Test the mpc8544ds machine

We can use the "Stupid creek" image to test the mpc8544ds ppc machine.

Signed-off-by: Thomas Huth <thuth@redhat.com>
Reviewed-by: Wainer dos Santos Moschetta <wainersm@redhat.com>
Reviewed-by: Willian Rampazzo <willianr@redhat.com>
Acked-by: David Gibson <david@gibson.dropbear.id.au>
Message-Id: <20210112164045.98565-3-thuth@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 299ab1b0cef9b7aacf3658ed9b6f16d4870c2778
      
https://github.com/qemu/qemu/commit/299ab1b0cef9b7aacf3658ed9b6f16d4870c2778
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M tests/acceptance/machine_ppc.py

  Log Message:
  -----------
  tests/acceptance: Add a test for the virtex-ml507 ppc machine

The "And a hippo new year" image from the QEMU advent calendar 2020
can be used to test the virtex-ml507 ppc machine.

Signed-off-by: Thomas Huth <thuth@redhat.com>
Reviewed-by: Wainer dos Santos Moschetta <wainersm@redhat.com>
Reviewed-by: Willian Rampazzo <willianr@redhat.com>
Acked-by: David Gibson <david@gibson.dropbear.id.au>
Message-Id: <20210112164045.98565-4-thuth@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: ee6c14d0166c9a2fa2bf849d8e09fffdda4de31f
      
https://github.com/qemu/qemu/commit/ee6c14d0166c9a2fa2bf849d8e09fffdda4de31f
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M MAINTAINERS
    M tests/acceptance/boot_linux_console.py
    A tests/acceptance/machine_microblaze.py

  Log Message:
  -----------
  tests/acceptance: Re-enable the microblaze test

The microblaze kernel sometimes gets stuck during boot (ca. 1 out of 200
times), so we disabled the corresponding acceptance tests some months
ago. However, it's likely better to check that the kernel is still
starting than to not testing it at all anymore. Move the test to
a separate file, enable it again and check for an earlier console
message that should always appear.

Signed-off-by: Thomas Huth <thuth@redhat.com>
Reviewed-by: Wainer dos Santos Moschetta <wainersm@redhat.com>
Message-Id: <20210128152815.585478-1-thuth@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 834736c9d1fa5623bd600b46c36cc6c46e7cefe1
      
https://github.com/qemu/qemu/commit/834736c9d1fa5623bd600b46c36cc6c46e7cefe1
  Author: Cleber Rosa <crosa@redhat.com>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M tests/acceptance/boot_linux.py

  Log Message:
  -----------
  tests/acceptance/boot_linux: fix typo on cloudinit error message

Signed-off-by: Cleber Rosa <crosa@redhat.com>
Reviewed-by: Alex Bennée <alex.bennee@linaro.org>
Reviewed-by: Beraldo Leal <bleal@redhat.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Message-Id: <20210203172357.1422425-2-crosa@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: b5a86c482d9c18b594b7dc8c37acc5bc72c4279a
      
https://github.com/qemu/qemu/commit/b5a86c482d9c18b594b7dc8c37acc5bc72c4279a
  Author: Cleber Rosa <crosa@redhat.com>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M tests/acceptance/boot_linux.py

  Log Message:
  -----------
  tests/acceptance/boot_linux: rename misleading cloudinit method

There's no downloading happening on that method, so let's call it
"prepare" instead.  While at it, and because of it, the current
"prepare_boot" and "prepare_cloudinit" are also renamed.

The reasoning here is that "prepare_" methods will just work on the
images, while "set_up_" will make them effective to the VM that will
be launched.  Inspiration comes from the "virtiofs_submounts.py"
tests, which this expects to converge more into.

Signed-off-by: Cleber Rosa <crosa@redhat.com>
Reviewed-by: Alex Bennée <alex.bennee@linaro.org>
Reviewed-by: Beraldo Leal <bleal@redhat.com>
Reviewed-by: Thomas Huth <thuth@redhat.com>
Message-Id: <20210203172357.1422425-3-crosa@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: fef453ee185958bf42644e3eb107e99184e0cbfc
      
https://github.com/qemu/qemu/commit/fef453ee185958bf42644e3eb107e99184e0cbfc
  Author: Cleber Rosa <crosa@redhat.com>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M tests/acceptance/virtiofs_submounts.py

  Log Message:
  -----------
  tests/acceptance/virtiofs_submounts: use workdir property

For Avocado Instrumented based tests, it's a better idea to just use
the property.  The environment variable is a fall back for tests not
written using that Python API.

Signed-off-by: Cleber Rosa <crosa@redhat.com>
Reviewed-by: Beraldo Leal <bleal@redhat.com>
Reviewed-by: Alex Bennée <alex.bennee@linaro.org>
Reference: 
https://avocado-framework.readthedocs.io/en/84.0/api/test/avocado.html#avocado.Test.workdir
Message-Id: <20210203172357.1422425-5-crosa@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: c70a6d1b9f0cd88dfa583d05d562f625038e26cd
      
https://github.com/qemu/qemu/commit/c70a6d1b9f0cd88dfa583d05d562f625038e26cd
  Author: Cleber Rosa <crosa@redhat.com>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M tests/acceptance/virtiofs_submounts.py

  Log Message:
  -----------
  tests/acceptance/virtiofs_submounts: do not ask for ssh key password

Tests are supposed to be non-interactive, and ssh-keygen is asking for
a passphrase when creating a key.  Let's set an empty passphrase to
avoid the prompt.

Signed-off-by: Cleber Rosa <crosa@redhat.com>
Reviewed-by: Beraldo Leal <bleal@redhat.com>
Reviewed-by: Alex Bennée <alex.bennee@linaro.org>
Message-Id: <20210203172357.1422425-6-crosa@redhat.com>
[PMD: Reword description per Alex Bennée comment]
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 14a79778e17bb7e087101b00d6b1839dc7858f1e
      
https://github.com/qemu/qemu/commit/14a79778e17bb7e087101b00d6b1839dc7858f1e
  Author: Cleber Rosa <crosa@redhat.com>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M tests/acceptance/virtiofs_submounts.py

  Log Message:
  -----------
  tests/acceptance/virtiofs_submounts: use a virtio-net device instead

In a virtiofs based tests, it seems safe to assume that the guest will
be capable of a virtio-net device.

Signed-off-by: Cleber Rosa <crosa@redhat.com>
Reviewed-by: Alex Bennée <alex.bennee@linaro.org>
Message-Id: <20210203172357.1422425-7-crosa@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: c0d1681e501180065927f40f4bfd0ed2a06d2ff1
      
https://github.com/qemu/qemu/commit/c0d1681e501180065927f40f4bfd0ed2a06d2ff1
  Author: Cleber Rosa <crosa@redhat.com>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M tests/acceptance/virtiofs_submounts.py

  Log Message:
  -----------
  tests/acceptance/virtiofs_submounts: standardize port as integer

Instead of having to cast it whenever it's going to be used, let's
standardize it as an integer, which is the data type that will be
used most often.

Given that the regex will only match digits, it's safe that we'll
end up getting a integer, but, it could as well be a zero.

Signed-off-by: Cleber Rosa <crosa@redhat.com>
Reviewed-by: Beraldo Leal <bleal@redhat.com>
Message-Id: <20210203172357.1422425-9-crosa@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: d7f57c25e10d9d39ec8125c981320c343cac0743
      
https://github.com/qemu/qemu/commit/d7f57c25e10d9d39ec8125c981320c343cac0743
  Author: Cleber Rosa <crosa@redhat.com>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M tests/acceptance/virtiofs_submounts.py

  Log Message:
  -----------
  tests/acceptance/virtiofs_submounts: required space between IP and port

AFAICT, there should not be a situation where IP and port do not have
at least one whitespace character separating them.

This may be true for other '\s*' patterns in the same regex too.

Signed-off-by: Cleber Rosa <crosa@redhat.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Message-Id: <20210203172357.1422425-10-crosa@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 4f0d032185a422116e492b1e07b55728e5ba1832
      
https://github.com/qemu/qemu/commit/4f0d032185a422116e492b1e07b55728e5ba1832
  Author: Cleber Rosa <crosa@redhat.com>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M tests/acceptance/linux_ssh_mips_malta.py
    M tests/acceptance/virtiofs_submounts.py

  Log Message:
  -----------
  Acceptance tests: clarify ssh connection failure reason

If the connection to the ssh server fails, it may indeed be a "sshd"
issue, but it may also not be that.  Let's state what we know: the
establishment of the connection from the client side was not possible.

Signed-off-by: Cleber Rosa <crosa@redhat.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Message-Id: <20210203172357.1422425-13-crosa@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 86b7cb6660bfec139f293c246572f77b53389699
      
https://github.com/qemu/qemu/commit/86b7cb6660bfec139f293c246572f77b53389699
  Author: Cleber Rosa <crosa@redhat.com>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M docs/devel/testing.rst

  Log Message:
  -----------
  Acceptance Tests: remove unnecessary tag from documentation example

The ":avocado: enable" is not necessary and was removed in 9531d26c,
so let's remove from the docs.

Signed-off-by: Cleber Rosa <crosa@redhat.com>
Reviewed-by: Alex Bennée <alex.bennee@linaro.org>
Reviewed-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Message-Id: <20210203172357.1422425-4-crosa@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>


  Commit: 34b7d4193e450d0799be4ca58323d0dcbb0075cc
      
https://github.com/qemu/qemu/commit/34b7d4193e450d0799be4ca58323d0dcbb0075cc
  Author: Peter Maydell <peter.maydell@linaro.org>
  Date:   2021-02-08 (Mon, 08 Feb 2021)

  Changed paths:
    M MAINTAINERS
    M docs/devel/testing.rst
    M tests/acceptance/boot_linux.py
    M tests/acceptance/boot_linux_console.py
    M tests/acceptance/linux_ssh_mips_malta.py
    M tests/acceptance/machine_m68k_nextcube.py
    A tests/acceptance/machine_microblaze.py
    A tests/acceptance/machine_ppc.py
    A tests/acceptance/tesseract_utils.py
    M tests/acceptance/virtiofs_submounts.py

  Log Message:
  -----------
  Merge remote-tracking branch 
'remotes/philmd-gitlab/tags/integration-testing-20210208' into staging

Integration testing patches

Tests added:
- Armbian 20.08 on Orange Pi PC (Philippe)
- MPC8544ds machine (Thomas)
- Virtex-ml507 ppc machine (Thomas)
- Re-enable the microblaze test (Thomas)

Various fixes and documentation improvements from Cleber.

# gpg: Signature made Mon 08 Feb 2021 20:19:12 GMT
# gpg:                using RSA key FAABE75E12917221DCFD6BB2E3E32C2CDEADC0DE
# gpg: Good signature from "Philippe Mathieu-Daudé (F4BUG) <f4bug@amsat.org>" 
[full]
# Primary key fingerprint: FAAB E75E 1291 7221 DCFD  6BB2 E3E3 2C2C DEAD C0DE

* remotes/philmd-gitlab/tags/integration-testing-20210208:
  Acceptance Tests: remove unnecessary tag from documentation example
  Acceptance tests: clarify ssh connection failure reason
  tests/acceptance/virtiofs_submounts: required space between IP and port
  tests/acceptance/virtiofs_submounts: standardize port as integer
  tests/acceptance/virtiofs_submounts: use a virtio-net device instead
  tests/acceptance/virtiofs_submounts: do not ask for ssh key password
  tests/acceptance/virtiofs_submounts: use workdir property
  tests/acceptance/boot_linux: rename misleading cloudinit method
  tests/acceptance/boot_linux: fix typo on cloudinit error message
  tests/acceptance: Re-enable the microblaze test
  tests/acceptance: Add a test for the virtex-ml507 ppc machine
  tests/acceptance: Test the mpc8544ds machine
  tests/acceptance: Move the pseries test to a separate file
  tests/acceptance: Test U-Boot/Linux from Armbian 20.08 on Orange Pi PC
  tests/acceptance: Extract do_test_arm_orangepi_armbian_uboot() method
  tests/acceptance: Introduce tesseract_ocr() helper
  tests/acceptance: Extract tesseract_available() helper in new namespace

Signed-off-by: Peter Maydell <peter.maydell@linaro.org>


Compare: https://github.com/qemu/qemu/compare/2436651b2658...34b7d4193e45



reply via email to

[Prev in Thread] Current Thread [Next in Thread]