Re: [Qemu-devel] [PATCH] Fedora images: use URLs from stable "archives.fedoraproject.org"

[Eduardo Habkost]

On Tue, Sep 10, 2019 at 08:29:24AM -0400, Cleber Rosa wrote:
> On Tue, Sep 10, 2019 at 09:41:20AM +0100, Daniel P. Berrangé wrote:
> > On Tue, Sep 03, 2019 at 08:52:18PM -0400, Cleber Rosa wrote:
> > > The LinuxInitrd.test_with_2gib_file_should_work_with_linux_v4_16 test,
> > > from tests/acceptance/linux_initrd.py, is currently failing to fetch
> > > the "vmlinuz" file.  The reason for the failure is that the Fedora
> > > project retires older versions from the "dl.fedoraproject.org" URL,
> > > and keeps them in "archives.fedoraproject.org".  As an added note,
> > > that test uses a Fedora 28 image, because of the specific Linux kernel
> > > version requirements of the test.
> > > 
> > > For the sake of stability, let's use URLs from the archived and
> > > supposedely ever stable URLs.  The good news is that the currently
> > > supported versions are also hosted on the later.  This change limits
> > > itself to change the URLs, while keeping the fetched files the same
> > > (as can be evidenced by the unchanged hashes).
> > 
> > The download.fedoraproject.org site we're (mostly) currently using
> > is serviced by the Fedora mirrors which is very desirable as it
> > spreads the load.
> > 
> > The archive.fedoraproject.org site is the master Fedora hosting
> > server(s). dl.fedoraproject.org is the same master hosting service
> > that is intended for use by the mirror sites to sync their content
> > from.  Projects really shouldn't use either of these URLs for getting
> > any content which is available via the mirror service as it places
> > uncessary load on the Fedora master servers.
> > 
[...]
> > > @@ -360,8 +364,9 @@ class BootLinuxConsole(Test):
> > >          :avocado: tags=arch:ppc64
> > >          :avocado: tags=machine:pseries
> > >          """
> > > -        kernel_url = 
> > > ('https://download.fedoraproject.org/pub/fedora-secondary/'
> > > -                      
> > > 'releases/29/Everything/ppc64le/os/ppc/ppc64/vmlinuz')
> > > +        kernel_url = ('https://archives.fedoraproject.org/pub/archive'
> > > +                      
> > > '/fedora-secondary/releases/29/Everything/ppc64le/os'
> > > +                      '/ppc/ppc64/vmlinuz')
> > >          kernel_hash = '3fe04abfc852b66653b8c3c897a59a689270bc77'
> > >          kernel_path = self.fetch_asset(kernel_url, 
> > > asset_hash=kernel_hash)
> > 
> > Don't change these URLs. We can update to Fedora 30 though if you want
> > to.
> > 
> 
> I believe your suggestion to not change the URLs is based solely on your
> perspective on the load on the "archives" server, right?
> 
> You should know that there's a number of counter points.  One is that
> these tests are used on environments, which are maintained for a much
> longer time than the lifespan of the currently maintained Fedora
> versions.  We really need to make it stable and reliable, and IMO it
> should be done upstream, for the benefit of all.

We're trying to offload the costs of long term hosting for our
test cases to a third party (Fedora Project), but we need to know
if that's really acceptable usage of archives.fedoraproject.org.

-- 
Eduardo