Re: [PATCH v2] tests/functional: Convert Aarch64 SBSA-Ref avocado tests

[Thomas Huth]

On 22/08/2024 16.39, Philippe Mathieu-Daudé wrote:
> On 22/8/24 16:06, Marcin Juszkiewicz wrote:
> > On 22.08.2024 13:41, Philippe Mathieu-Daudé wrote:
> > >   # Timeouts for individual tests that can be slow e.g. with debugging 
> > > enabled
> > >   test_timeouts = {
> > > +  'aarch64_sbsaref' : 180,
> >
> > What kind of machine is able to run those tests in 180s? I bumped them to 
> > 2400s and got timeout (Macbook with M1 Pro).
> >
> > "make check-avocado" (with some AVOCADO_* vars to limit list of tests) 
> > shown me which test is run and pass/fail for each.
> >
> > "make check-functional-aarch64 V=1" shows me "1/4 
> > qemu:func-thorough+func-aarch64-thorough+thorough / 
> > func-aarch64-aarch64_sbsaref" and timeouts without information which tests 
> > pass, which fail.
> >
> > Maybe for QEMU project this is a progress. For me it is moving tests from 
> > working ones to "sorry, timeout, find out why" ones.
>
> Sorry for the annoyance of switching from one framework to another
> one :/ Are you using Linux on your Macbook with M1 Pro? I'm using
> macOS and these tests currently don't work, so for me this is a
> huge win.
>
> Most of the (long) time was spent in downloading the assets.
>
> IIUC there is a way to pre-download without using the test timer
> (apparently Richard and Daniel use it) but I haven't found the way
> yet.

It's done automatically when you run "make check-functional" ... but I think 
it might get skipped if you run "make check-functional-<target>".

Anyway, you can do the precaching manually by running:

 make precache-functional

 HTH,
  Thomas