[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Qemu-commits] [qemu/qemu] 333d70: tests/acceptance: introduce new check
|
From: |
Richard Henderson |
|
Subject: |
[Qemu-commits] [qemu/qemu] 333d70: tests/acceptance: introduce new check-avocado target |
|
Date: |
Mon, 08 Nov 2021 11:37:44 -0800 |
Branch: refs/heads/master
Home: https://github.com/qemu/qemu
Commit: 333d7036ef6cf959a1f883fe93042047bef73497
https://github.com/qemu/qemu/commit/333d7036ef6cf959a1f883fe93042047bef73497
Author: Willian Rampazzo <willianr@redhat.com>
Date: 2021-11-08 (Mon, 08 Nov 2021)
Changed paths:
M tests/Makefile.include
Log Message:
-----------
tests/acceptance: introduce new check-avocado target
This introduces a new `make` target, `check-avocado`, and adds a
deprecation message about the `check-acceptance` target. This is
a preparation for renaming the `tests/acceptance` folder to
`tests/avocado`.
The plan is to remove the call to the `check-avocado` target one
or two months after the release and leave the warning to force
people to move to the new `check-avocado` target.
Later, the `check-acceptance` target can be removed. The intent
is to avoid a direct impact during the current soft freeze.
Suggested-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Signed-off-by: Willian Rampazzo <willianr@redhat.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Tested-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Acked-by: Thomas Huth <thuth@redhat.com>
Message-Id: <20211105155354.154864-2-willianr@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Commit: bbbd9b6ec645ca45c2195e894537da4964f1aa12
https://github.com/qemu/qemu/commit/bbbd9b6ec645ca45c2195e894537da4964f1aa12
Author: Willian Rampazzo <willianr@redhat.com>
Date: 2021-11-08 (Mon, 08 Nov 2021)
Changed paths:
M .gitlab-ci.d/buildtest-template.yml
M .gitlab-ci.d/buildtest.yml
M MAINTAINERS
M configure
M docs/devel/build-system.rst
M docs/devel/ci-definitions.rst.inc
M docs/devel/testing.rst
M docs/system/arm/orangepi.rst
M python/qemu/machine/README.rst
M python/qemu/qmp/README.rst
M python/qemu/utils/README.rst
M tests/Makefile.include
R tests/acceptance/README.rst
R tests/acceptance/avocado_qemu/__init__.py
R tests/acceptance/boot_linux.py
R tests/acceptance/boot_linux_console.py
R tests/acceptance/boot_xen.py
R tests/acceptance/cpu_queries.py
R tests/acceptance/empty_cpu_model.py
R tests/acceptance/hotplug_cpu.py
R tests/acceptance/info_usernet.py
R tests/acceptance/intel_iommu.py
R tests/acceptance/linux_initrd.py
R tests/acceptance/linux_ssh_mips_malta.py
R tests/acceptance/machine_arm_canona1100.py
R tests/acceptance/machine_arm_integratorcp.py
R tests/acceptance/machine_arm_n8x0.py
R tests/acceptance/machine_avr6.py
R tests/acceptance/machine_m68k_nextcube.py
R tests/acceptance/machine_microblaze.py
R tests/acceptance/machine_mips_fuloong2e.py
R tests/acceptance/machine_mips_loongson3v.py
R tests/acceptance/machine_mips_malta.py
R tests/acceptance/machine_rx_gdbsim.py
R tests/acceptance/machine_s390_ccw_virtio.py
R tests/acceptance/machine_sparc64_sun4u.py
R tests/acceptance/machine_sparc_leon3.py
R tests/acceptance/migration.py
R tests/acceptance/multiprocess.py
R tests/acceptance/pc_cpu_hotplug_props.py
R tests/acceptance/ppc_405.py
R tests/acceptance/ppc_bamboo.py
R tests/acceptance/ppc_mpc8544ds.py
R tests/acceptance/ppc_prep_40p.py
R tests/acceptance/ppc_pseries.py
R tests/acceptance/ppc_virtex_ml507.py
R tests/acceptance/replay_kernel.py
R tests/acceptance/replay_linux.py
R tests/acceptance/reverse_debugging.py
R tests/acceptance/smmu.py
R tests/acceptance/tcg_plugins.py
R tests/acceptance/tesseract_utils.py
R tests/acceptance/version.py
R tests/acceptance/virtio-gpu.py
R tests/acceptance/virtio_check_params.py
R tests/acceptance/virtio_version.py
R tests/acceptance/virtiofs_submounts.py
R tests/acceptance/virtiofs_submounts.py.data/cleanup.sh
R tests/acceptance/virtiofs_submounts.py.data/guest-cleanup.sh
R tests/acceptance/virtiofs_submounts.py.data/guest.sh
R tests/acceptance/virtiofs_submounts.py.data/host.sh
R tests/acceptance/vnc.py
R tests/acceptance/x86_cpu_model_versions.py
A tests/avocado/README.rst
A tests/avocado/avocado_qemu/__init__.py
A tests/avocado/boot_linux.py
A tests/avocado/boot_linux_console.py
A tests/avocado/boot_xen.py
A tests/avocado/cpu_queries.py
A tests/avocado/empty_cpu_model.py
A tests/avocado/hotplug_cpu.py
A tests/avocado/info_usernet.py
A tests/avocado/intel_iommu.py
A tests/avocado/linux_initrd.py
A tests/avocado/linux_ssh_mips_malta.py
A tests/avocado/machine_arm_canona1100.py
A tests/avocado/machine_arm_integratorcp.py
A tests/avocado/machine_arm_n8x0.py
A tests/avocado/machine_avr6.py
A tests/avocado/machine_m68k_nextcube.py
A tests/avocado/machine_microblaze.py
A tests/avocado/machine_mips_fuloong2e.py
A tests/avocado/machine_mips_loongson3v.py
A tests/avocado/machine_mips_malta.py
A tests/avocado/machine_rx_gdbsim.py
A tests/avocado/machine_s390_ccw_virtio.py
A tests/avocado/machine_sparc64_sun4u.py
A tests/avocado/machine_sparc_leon3.py
A tests/avocado/migration.py
A tests/avocado/multiprocess.py
A tests/avocado/pc_cpu_hotplug_props.py
A tests/avocado/ppc_405.py
A tests/avocado/ppc_bamboo.py
A tests/avocado/ppc_mpc8544ds.py
A tests/avocado/ppc_prep_40p.py
A tests/avocado/ppc_pseries.py
A tests/avocado/ppc_virtex_ml507.py
A tests/avocado/replay_kernel.py
A tests/avocado/replay_linux.py
A tests/avocado/reverse_debugging.py
A tests/avocado/smmu.py
A tests/avocado/tcg_plugins.py
A tests/avocado/tesseract_utils.py
A tests/avocado/version.py
A tests/avocado/virtio-gpu.py
A tests/avocado/virtio_check_params.py
A tests/avocado/virtio_version.py
A tests/avocado/virtiofs_submounts.py
A tests/avocado/virtiofs_submounts.py.data/cleanup.sh
A tests/avocado/virtiofs_submounts.py.data/guest-cleanup.sh
A tests/avocado/virtiofs_submounts.py.data/guest.sh
A tests/avocado/virtiofs_submounts.py.data/host.sh
A tests/avocado/vnc.py
A tests/avocado/x86_cpu_model_versions.py
Log Message:
-----------
tests/acceptance: rename tests acceptance to tests avocado
In the discussion about renaming the `tests/acceptance` [1], the
conclusion was that the folders inside `tests` are related to the
framework running the tests and not directly related to the type of
the tests.
This changes the folder to `tests/avocado` and adjusts the MAKEFILE, the
CI related files and the documentation.
[1] https://lists.gnu.org/archive/html/qemu-devel/2021-05/msg06553.html
Reviewed-by: Niek Linnenbank <nieklinnenbank@gmail.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Tested-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Signed-off-by: Willian Rampazzo <willianr@redhat.com>
Message-Id: <20211105155354.154864-3-willianr@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Commit: 3982feb476e46bbac8f6affbc58bf715e5ca9a4f
https://github.com/qemu/qemu/commit/3982feb476e46bbac8f6affbc58bf715e5ca9a4f
Author: Philippe Mathieu-Daudé <f4bug@amsat.org>
Date: 2021-11-08 (Mon, 08 Nov 2021)
Changed paths:
M tests/avocado/avocado_qemu/__init__.py
Log Message:
-----------
tests/avocado: Extract QemuBaseTest from Test
The Avocado Test::fetch_asset() is handy to download artifacts
before running tests. The current class is named Test but only
tests system emulation. As we want to test user emulation,
refactor the common code as QemuBaseTest.
Reviewed-by: Willian Rampazzo <willianr@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Message-Id: <20211105143416.148332-2-f4bug@amsat.org>
Commit: 9112d4fd493c14a30ebd5ba9853328137490aab6
https://github.com/qemu/qemu/commit/9112d4fd493c14a30ebd5ba9853328137490aab6
Author: Philippe Mathieu-Daudé <f4bug@amsat.org>
Date: 2021-11-08 (Mon, 08 Nov 2021)
Changed paths:
M tests/avocado/avocado_qemu/__init__.py
Log Message:
-----------
tests/avocado: Make pick_default_qemu_bin() more generic
Make pick_default_qemu_bin() generic to find qemu-system or
qemu-user binaries.
Reviewed-by: Willian Rampazzo <willianr@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Message-Id: <20211105143416.148332-3-f4bug@amsat.org>
Commit: 5334df48224f494303b4717b57b2b0cd42bd1c1a
https://github.com/qemu/qemu/commit/5334df48224f494303b4717b57b2b0cd42bd1c1a
Author: Philippe Mathieu-Daudé <f4bug@amsat.org>
Date: 2021-11-08 (Mon, 08 Nov 2021)
Changed paths:
M tests/avocado/avocado_qemu/__init__.py
Log Message:
-----------
tests/avocado: Introduce QemuUserTest base class
Similarly to the 'System' Test base class with methods for testing
system emulation, the QemuUserTest class contains methods useful to
test user-mode emulation.
Reviewed-by: Wainer dos Santos Moschetta <wainersm@redhat.com>
Reviewed-by: Willian Rampazzo <willianr@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Message-Id: <20211105143416.148332-4-f4bug@amsat.org>
Commit: 0e4b1c9435528c30718a2722d09ff35beaa300ee
https://github.com/qemu/qemu/commit/0e4b1c9435528c30718a2722d09ff35beaa300ee
Author: Philippe Mathieu-Daudé <f4bug@amsat.org>
Date: 2021-11-08 (Mon, 08 Nov 2021)
Changed paths:
M tests/avocado/avocado_qemu/__init__.py
M tests/avocado/virtiofs_submounts.py
Log Message:
-----------
tests/avocado: Share useful helpers from virtiofs_submounts test
Move the useful has_cmd()/has_cmds() helpers from the virtiofs
test to the avocado_qemu public class.
Reviewed-by: Wainer dos Santos Moschetta <wainersm@redhat.com>
Reviewed-by: Willian Rampazzo <willianr@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Message-Id: <20211105143416.148332-5-f4bug@amsat.org>
Commit: 8011837a019182c61bad0d8f3a603d26dd4b6710
https://github.com/qemu/qemu/commit/8011837a019182c61bad0d8f3a603d26dd4b6710
Author: Philippe Mathieu-Daudé <f4bug@amsat.org>
Date: 2021-11-08 (Mon, 08 Nov 2021)
Changed paths:
A tests/avocado/load_bflt.py
Log Message:
-----------
tests/avocado: Add bFLT loader linux-user test
Add a very quick test that runs a busybox binary in bFLT format:
$ AVOCADO_ALLOW_UNTRUSTED_CODE=1 \
avocado --show=app run -t linux_user tests/avocado/load_bflt.py
JOB ID : db94d5960ce564c50904d666a7e259148c27e88f
JOB LOG : ~/avocado/job-results/job-2019-06-25T10.52-db94d59/job.log
(1/1) tests/avocado/load_bflt.py:LoadBFLT.test_stm32: PASS (0.15 s)
RESULTS : PASS 1 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 |
CANCEL 0
JOB TIME : 0.54 s
Reviewed-by: Willian Rampazzo <willianr@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Message-Id: <20211105143416.148332-6-f4bug@amsat.org>
Commit: 2283b627bc6ba2bc7f120b4e7af0e43503282bb7
https://github.com/qemu/qemu/commit/2283b627bc6ba2bc7f120b4e7af0e43503282bb7
Author: Philippe Mathieu-Daudé <f4bug@amsat.org>
Date: 2021-11-08 (Mon, 08 Nov 2021)
Changed paths:
M docs/devel/testing.rst
M tests/avocado/avocado_qemu/__init__.py
M tests/avocado/boot_linux_console.py
M tests/avocado/cpu_queries.py
M tests/avocado/empty_cpu_model.py
M tests/avocado/info_usernet.py
M tests/avocado/linux_initrd.py
M tests/avocado/linux_ssh_mips_malta.py
M tests/avocado/machine_arm_canona1100.py
M tests/avocado/machine_arm_integratorcp.py
M tests/avocado/machine_arm_n8x0.py
M tests/avocado/machine_avr6.py
M tests/avocado/machine_m68k_nextcube.py
M tests/avocado/machine_microblaze.py
M tests/avocado/machine_mips_fuloong2e.py
M tests/avocado/machine_mips_loongson3v.py
M tests/avocado/machine_mips_malta.py
M tests/avocado/machine_rx_gdbsim.py
M tests/avocado/machine_s390_ccw_virtio.py
M tests/avocado/machine_sparc_leon3.py
M tests/avocado/migration.py
M tests/avocado/multiprocess.py
M tests/avocado/pc_cpu_hotplug_props.py
M tests/avocado/ppc_405.py
M tests/avocado/ppc_bamboo.py
M tests/avocado/ppc_mpc8544ds.py
M tests/avocado/ppc_prep_40p.py
M tests/avocado/ppc_pseries.py
M tests/avocado/ppc_virtex_ml507.py
M tests/avocado/version.py
M tests/avocado/virtio-gpu.py
M tests/avocado/virtio_check_params.py
M tests/avocado/virtio_version.py
M tests/avocado/vnc.py
M tests/avocado/x86_cpu_model_versions.py
Log Message:
-----------
tests/avocado: Rename avocado_qemu.Test -> QemuSystemTest
To run user-mode emulation tests, we introduced the
avocado_qemu.QemuUserTest which inherits from avocado_qemu.QemuBaseTest.
System-mode emulation tests are based on the avocado_qemu.Test class,
which also inherits avocado_qemu.QemuBaseTest. To avoid confusion,
rename it as avocado_qemu.QemuSystemTest.
Suggested-by: Wainer dos Santos Moschetta <wainersm@redhat.com>
Reviewed-by: Willian Rampazzo <willianr@redhat.com>
Signed-off-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Message-Id: <20211105143416.148332-7-f4bug@amsat.org>
Commit: b94d00898a9ee708b4d4b79432c2272905a56b06
https://github.com/qemu/qemu/commit/b94d00898a9ee708b4d4b79432c2272905a56b06
Author: Philippe Mathieu-Daudé <philmd@redhat.com>
Date: 2021-11-08 (Mon, 08 Nov 2021)
Changed paths:
M tests/avocado/boot_linux_console.py
Log Message:
-----------
tests/avocado: Remove p7zip binary availability check
The single use of the 7z binary has been removed in commit a30e114f3
("tests/acceptance: remove Armbian 19.11.3 test for orangepi-pc"),
we don't need to check for this binary availability anymore.
Signed-off-by: Philippe Mathieu-Daudé <philmd@redhat.com>
Reviewed-by: Joaquin de Andres <me@xcancerberox.com.ar>
Reviewed-by: Willian Rampazzo <willianr@redhat.com>
Message-Id: <20211106091059.465109-1-philmd@redhat.com>
Commit: 114f3c8cc427333dbae331dfd2ecae64676b087e
https://github.com/qemu/qemu/commit/114f3c8cc427333dbae331dfd2ecae64676b087e
Author: Richard Henderson <richard.henderson@linaro.org>
Date: 2021-11-08 (Mon, 08 Nov 2021)
Changed paths:
M .gitlab-ci.d/buildtest-template.yml
M .gitlab-ci.d/buildtest.yml
M MAINTAINERS
M configure
M docs/devel/build-system.rst
M docs/devel/ci-definitions.rst.inc
M docs/devel/testing.rst
M docs/system/arm/orangepi.rst
M python/qemu/machine/README.rst
M python/qemu/qmp/README.rst
M python/qemu/utils/README.rst
M tests/Makefile.include
R tests/acceptance/README.rst
R tests/acceptance/avocado_qemu/__init__.py
R tests/acceptance/boot_linux.py
R tests/acceptance/boot_linux_console.py
R tests/acceptance/boot_xen.py
R tests/acceptance/cpu_queries.py
R tests/acceptance/empty_cpu_model.py
R tests/acceptance/hotplug_cpu.py
R tests/acceptance/info_usernet.py
R tests/acceptance/intel_iommu.py
R tests/acceptance/linux_initrd.py
R tests/acceptance/linux_ssh_mips_malta.py
R tests/acceptance/machine_arm_canona1100.py
R tests/acceptance/machine_arm_integratorcp.py
R tests/acceptance/machine_arm_n8x0.py
R tests/acceptance/machine_avr6.py
R tests/acceptance/machine_m68k_nextcube.py
R tests/acceptance/machine_microblaze.py
R tests/acceptance/machine_mips_fuloong2e.py
R tests/acceptance/machine_mips_loongson3v.py
R tests/acceptance/machine_mips_malta.py
R tests/acceptance/machine_rx_gdbsim.py
R tests/acceptance/machine_s390_ccw_virtio.py
R tests/acceptance/machine_sparc64_sun4u.py
R tests/acceptance/machine_sparc_leon3.py
R tests/acceptance/migration.py
R tests/acceptance/multiprocess.py
R tests/acceptance/pc_cpu_hotplug_props.py
R tests/acceptance/ppc_405.py
R tests/acceptance/ppc_bamboo.py
R tests/acceptance/ppc_mpc8544ds.py
R tests/acceptance/ppc_prep_40p.py
R tests/acceptance/ppc_pseries.py
R tests/acceptance/ppc_virtex_ml507.py
R tests/acceptance/replay_kernel.py
R tests/acceptance/replay_linux.py
R tests/acceptance/reverse_debugging.py
R tests/acceptance/smmu.py
R tests/acceptance/tcg_plugins.py
R tests/acceptance/tesseract_utils.py
R tests/acceptance/version.py
R tests/acceptance/virtio-gpu.py
R tests/acceptance/virtio_check_params.py
R tests/acceptance/virtio_version.py
R tests/acceptance/virtiofs_submounts.py
R tests/acceptance/virtiofs_submounts.py.data/cleanup.sh
R tests/acceptance/virtiofs_submounts.py.data/guest-cleanup.sh
R tests/acceptance/virtiofs_submounts.py.data/guest.sh
R tests/acceptance/virtiofs_submounts.py.data/host.sh
R tests/acceptance/vnc.py
R tests/acceptance/x86_cpu_model_versions.py
A tests/avocado/README.rst
A tests/avocado/avocado_qemu/__init__.py
A tests/avocado/boot_linux.py
A tests/avocado/boot_linux_console.py
A tests/avocado/boot_xen.py
A tests/avocado/cpu_queries.py
A tests/avocado/empty_cpu_model.py
A tests/avocado/hotplug_cpu.py
A tests/avocado/info_usernet.py
A tests/avocado/intel_iommu.py
A tests/avocado/linux_initrd.py
A tests/avocado/linux_ssh_mips_malta.py
A tests/avocado/load_bflt.py
A tests/avocado/machine_arm_canona1100.py
A tests/avocado/machine_arm_integratorcp.py
A tests/avocado/machine_arm_n8x0.py
A tests/avocado/machine_avr6.py
A tests/avocado/machine_m68k_nextcube.py
A tests/avocado/machine_microblaze.py
A tests/avocado/machine_mips_fuloong2e.py
A tests/avocado/machine_mips_loongson3v.py
A tests/avocado/machine_mips_malta.py
A tests/avocado/machine_rx_gdbsim.py
A tests/avocado/machine_s390_ccw_virtio.py
A tests/avocado/machine_sparc64_sun4u.py
A tests/avocado/machine_sparc_leon3.py
A tests/avocado/migration.py
A tests/avocado/multiprocess.py
A tests/avocado/pc_cpu_hotplug_props.py
A tests/avocado/ppc_405.py
A tests/avocado/ppc_bamboo.py
A tests/avocado/ppc_mpc8544ds.py
A tests/avocado/ppc_prep_40p.py
A tests/avocado/ppc_pseries.py
A tests/avocado/ppc_virtex_ml507.py
A tests/avocado/replay_kernel.py
A tests/avocado/replay_linux.py
A tests/avocado/reverse_debugging.py
A tests/avocado/smmu.py
A tests/avocado/tcg_plugins.py
A tests/avocado/tesseract_utils.py
A tests/avocado/version.py
A tests/avocado/virtio-gpu.py
A tests/avocado/virtio_check_params.py
A tests/avocado/virtio_version.py
A tests/avocado/virtiofs_submounts.py
A tests/avocado/virtiofs_submounts.py.data/cleanup.sh
A tests/avocado/virtiofs_submounts.py.data/guest-cleanup.sh
A tests/avocado/virtiofs_submounts.py.data/guest.sh
A tests/avocado/virtiofs_submounts.py.data/host.sh
A tests/avocado/vnc.py
A tests/avocado/x86_cpu_model_versions.py
Log Message:
-----------
Merge remote-tracking branch 'remotes/philmd/tags/avocado-20211108' into
staging
Integration testing patches
- Rename tests/acceptance/ -> tests/avocado/
- Rename avocado_qemu.Test -> avocado_qemu.QemuSystemTest
- Introduce QemuUserTest class
- Add the first linux-user test, covering the bFLT loader
# gpg: Signature made Mon 08 Nov 2021 05:16:46 PM CET
# gpg: using RSA key FAABE75E12917221DCFD6BB2E3E32C2CDEADC0DE
# gpg: Good signature from "Philippe Mathieu-Daudé (F4BUG) <f4bug@amsat.org>"
[full]
* remotes/philmd/tags/avocado-20211108:
tests/avocado: Remove p7zip binary availability check
tests/avocado: Rename avocado_qemu.Test -> QemuSystemTest
tests/avocado: Add bFLT loader linux-user test
tests/avocado: Share useful helpers from virtiofs_submounts test
tests/avocado: Introduce QemuUserTest base class
tests/avocado: Make pick_default_qemu_bin() more generic
tests/avocado: Extract QemuBaseTest from Test
tests/acceptance: rename tests acceptance to tests avocado
tests/acceptance: introduce new check-avocado target
Signed-off-by: Richard Henderson <richard.henderson@linaro.org>
Compare: https://github.com/qemu/qemu/compare/5e10ccc27067...114f3c8cc427