Important changes to the Copernicus Australasia Regional Data Hub - Update #6

It has been some time since our last update on the Copernicus Australasia Regional Data Hub upgrade. We appreciate your patience as we complete this process. With the combined efforts of staff at Geoscience Australia, European Space Agency (ESA), GAEL Systems and Australia’s National Computational Infrastructure (NCI), we are steadily making headway and nearing the production release of the new version of the Hub.

In early January, we are aiming to have the new system operate at full production syncs directly with the CDSE to bed in the new processes, and by mid-January, expect to set a hard release date of the new GSS-based Hub. The old and new Hubs will run in parallel for 3 weeks to ensure everyone has time to transition to the new system. At the end of this period (February 2025), we will turn off synchronisations to the old Hub, which will then only operate to retain access to archive products via SARA. From that point onwards, new Sentinel data will only be available from the new Hub. We will send further updates during this period with more details.

Access to the products hosted by the new Hub will be via a new web portal. Documentation for the portal can be found here:

As stated in previous updates, users will need to update their scripts and code to the new Hub’s APIs in order to continue to access products as they are published. Documentation on the new APIs can be found in the new portal manual. General documentation on OData API’s can be found on the ESA Documentation Portal.

A command line tool and Python library compatible with the new Hub platform has been developed and is available here:

IMPORTANT: The new platform will change the folder structure where new products can be found. If you currently access Sentinel products via NCI THREDDS or directly from the filesystem, the migration will impact workflow scripts that rely on predicting where new products are located. Recommended access is via the new OData APIs and/or the PyGSSearch library.

Once the new platform is fully operational, we will begin to migrate our archive products to the new system. During this time unmigrated products will continue to be available via the old SARA portal and we will document progress on our website.

More information on the Hub Upgrade Project can be found here.