[gnuastro-devel] [task #15181] Fits program using network libraries for optimal download

[Mohammad Akhlaghi]

URL:
  <https://savannah.gnu.org/task/?15181>

                 Summary: Fits program using network libraries for optimal
download
                 Project: GNU Astronomy Utilities
            Submitted by: makhlaghi
            Submitted on: Thu 14 Feb 2019 11:30:52 AM UTC
         Should Start On: Thu 14 Feb 2019 12:00:00 AM UTC
   Should be Finished on: Thu 14 Feb 2019 12:00:00 AM UTC
                Category: Fits
                Priority: 5 - Normal
              Item Group: Enhancement
                  Status: Postponed
                 Privacy: Public
        Percent Complete: 0%
             Assigned to: None
             Open/Closed: Open
         Discussion Lock: Any
                  Effort: 0.00

    _______________________________________________________

Details:

CFITSIO allows the usage of network addresses as input FITS files. However,
after some tests, I noticed that it simply first downloads the full file, then
prepares the required extension/region. So in effect, its is no different from
a full download of the full file first, then running CFITSIO on it. 

But if we follow the FITS standard, and considering the fact that we can ask
download libraries (like cURL), to only download certain byte ranges. In this
way, we can optimize the network traffic when only certain extensions/parts of
a file on the server are requested. 

As servers are hosting larger and larger datasets, optimal usage of network
traffic can greatly help in speeding up of processing.




    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/task/?15181>

_______________________________________________
  Message sent via Savannah
  https://savannah.gnu.org/