[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Qemu-devel] [RFC PATCH v2 0/3] acceptance tests: Test firmware chec
From: |
Philippe Mathieu-Daudé |
Subject: |
Re: [Qemu-devel] [RFC PATCH v2 0/3] acceptance tests: Test firmware checking debug console output |
Date: |
Thu, 4 Oct 2018 16:44:06 +0200 |
User-agent: |
Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.0 |
Hi Alex,
On 04/10/2018 15:04, Alex Bennée wrote:
>
> Alex Bennée <address@hidden> writes:
>
>> Philippe Mathieu-Daudé <address@hidden> writes:
>>
>>> Hi,
>>>
>>> This RFC series add simple acceptance tests which boot SeaBIOS and EDK2 on
>>> the pc and virt/aarch64 default machines
>>>
>>> Still PoC but can be useful for the Avocado team to test the
>>> multi-arch targets.
>>
>> I couldn't get this to work on qemu-test (aarch64):
Thanks for giving it a try!
Sorry, I only tested this on x86_64 :/
>>
>> 12:52:56 address@hidden:~/l/qemu.git] review/acceptance-rfc-v2 + avocado
>> run tests/acceptance
>> JOB ID : b6377b8d4196903846c7d57e2b234c523d6c6ba1
>> JOB LOG :
>> /home/alex/avocado/job-results/job-2018-10-04T12.53-b6377b8/job.log
>> (1/9) tests/acceptance/boot_firmware.py:BootFirmware.test_seabios: ERROR:
>> timed out (15.14 s)
>> (2/9) tests/acceptance/boot_firmware.py:BootFirmware.test_ovmf_pc: ERROR:
>> timed out (15.14 s)
>> (3/9) tests/acceptance/boot_firmware.py:BootFirmware.test_ovmf_virt:
>> FAIL: OVMF failed to boot (17.97 s)
>> (4/9) tests/acceptance/boot_linux_console.py:BootLinuxConsole.test:
>> ERROR: timed out (17.36 s)
>> (5/9) tests/acceptance/version.py:Version.test_qmp_human_info_version:
>> ERROR: timed out (15.14 s)
>> (6/9) tests/acceptance/vnc.py:Vnc.test_no_vnc: ERROR: timed out (15.14 s)
>> (7/9) tests/acceptance/vnc.py:Vnc.test_no_vnc_change_password: ERROR:
>> timed out (15.14 s)
>> (8/9)
>> tests/acceptance/vnc.py:Vnc.test_vnc_change_password_requires_a_password:
>> ERROR: timed out (15.14 s)
>> (9/9) tests/acceptance/vnc.py:Vnc.test_vnc_change_password: ERROR: timed
>> out (15.14 s)
>> RESULTS : PASS 0 | ERROR 8 | FAIL 1 | SKIP 0 | WARN 0 | INTERRUPT 0 |
>> CANCEL 0
>> JOB TIME : 142.37 s
>>
>> The error log: https://transfer.sh/lK71v/avocado-errors.log
>
> It looks like it's trying to launch a pc (rather than virt) machine:
>
> 2018-10-04 12:53:16,339 qemu L0270 DEBUG| Output:
> 'qemu-system-aarch64: -machine pc: unsupported machine type\nUse -machine
> help to list supported machines\n'
Due to some limitation (Cleber is aware of it) you have to use the -p
option as in patch #3 of this series:
$ avocado run --filter-by-tags=arch:x86_64 -p
qemu_bin=x86_64-softmmu/qemu-system-x86_64 tests/acceptance/boot_firmware.py
JOB ID : 5f9078796ef749e0606bbdf9409e91443ab2bad1
JOB LOG :
/home/phil/avocado/job-results/job-2018-10-04T14.30-5f90787/job.log
(1/2) tests/acceptance/boot_firmware.py:BootFirmware.test_seabios: PASS
(0.90 s)
(2/2) tests/acceptance/boot_firmware.py:BootFirmware.test_ovmf_pc:
FAIL: 'SEC: Normal boot\r\n' not found in [] (9.48 s)
RESULTS : PASS 1 | ERROR 0 | FAIL 1 | SKIP 0 | WARN 0 | INTERRUPT 0 |
CANCEL 0
JOB TIME : 10.72 s
The error "FAIL: 'SEC: Normal boot\r\n' not found" means the serial test
worked, but not the debugconsole.
You can use verbose Avocado:
$ avocado --show=app,debugcon,serial run --filter-by-tags=arch:x86_64 -p
qemu_bin=x86_64-softmmu/qemu-system-x86_64 tests/acceptance/boot_firmware.py
(2/2) tests/acceptance/boot_firmware.py:BootFirmware.test_ovmf_pc: \
serial: UEFI Interactive Shell v2.2
serial: EDK II
FAIL: 'SEC: Normal boot\r\n' not found in [] (9.58 s)
I'll look at it.
$ avocado run --filter-by-tags=arch:aarch64 -p
qemu_bin=aarch64-softmmu/qemu-system-aarch64
tests/acceptance/boot_firmware.py
JOB ID : 678d83c0b10d6daadb5fa177318b774281c346b7
JOB LOG :
/home/phil/avocado/job-results/job-2018-10-04T14.29-678d83c/job.log
(1/1) tests/acceptance/boot_firmware.py:BootFirmware.test_ovmf_virt:
FAIL: OVMF failed to boot (16.59 s)
RESULTS : PASS 0 | ERROR 0 | FAIL 1 | SKIP 0 | WARN 0 | INTERRUPT 0 |
CANCEL 0
JOB TIME : 16.83 s
$ avocado --show=app,serial run --filter-by-tags=arch:aarch64 -p
qemu_bin=aarch64-softmmu/qemu-system-aarch64
tests/acceptance/boot_firmware.py
JOB LOG :
/home/phil/avocado/job-results/job-2018-10-04T14.40-dab2e26/job.log
(1/1) tests/acceptance/boot_firmware.py:BootFirmware.test_ovmf_virt:
serial: a
serial: dd-symbol-
serial: file /home/
serial: buildslave/
serial: workspace/l
serial: eg-virt-tia
serial: nocore-edk2
serial: -upstream/e
serial: dk2/Build/A
serial: rmVirtQemu-
serial: AARCH64/DEB
serial: UG_GCC5/AA
serial: RCH64/ArmPl
serial: atformPkg/P
serial: rePeiCore/P
serial: rePeiCoreUn
serial: iCore/DEBUG
serial: /ArmPlatfor
serial: mPrePeiCore
serial: .dll 0x1800
...
serial: Boot00
serial: 04: EFI In
serial: ternal S
serial: h
serial: ell 0x00
serial: 01
serial:
serial: PlatformRe
serial: covery Opti
serial: ons:
FAIL: OVMF failed to boot (16.44 s)
RESULTS : PASS 0 | ERROR 0 | FAIL 1 | SKIP 0 | WARN 0 | INTERRUPT 0 |
CANCEL 0
JOB TIME : 16.68 s
So this image boots, this is my ugly way of handling virt console with
avocado which failed :)
QEMU console arg:
'-chardev', 'file,path=%s,id=console' % serial_path,
'-serial', 'chardev:console')
then I'd like to use the FDDrainer class Cleber suggested instead of the
current read_console_for_string().
Thanks,
Phil.