Authors / CoAuthors
Purss, M. | Lewis, A.
Abstract
The next decade promises an exponential increase in volumes of open data from Earth observing satellites (EOS). The ESA Sentinels, the Japan Meteorological Agency's Himawari 8/9 geostationary satellites, and various NASA missions, to name just a few, will produce petabyte scale datasets of national and global significance. If we are to cope with this deluge of data we must embrace the paradigm shift that is 'big data'. This paradigm shift requires a fundamental change in the way we manage and interact with our data from the traditional 'ad-hoc' and labour intensity methods to the new High Performance Data (HPD) models where data are well organised and co-located with High Performance Computational (HPC) facilities. We are now taking the compute power and algorithms to the data instead of downloading the data to our own computers. To meet this challenge Geoscience Australia (GA) has developed the Australian Geoscience Data Cube (AG-DC), hosted on the National Computational Infrastructure (NCI). The AG-DC is a data management system for large scale multi-dimensional data which will allow efficient spatial and temporal analyses of continental scale geospatial datasets, including those produced by EOS. Initial work on the AG-DC has been focused developing a proof of concept using the 25 year archive of calibrated Landsat data to demonstrate a new way of interacting with large volumes of geoscientific data to derive valuable information in a timely fashion. The AG-DC is now being further developed through a collaboration involving GA, CSIRO and the NCI to fully realise the vision of an integrated and operational HPD infrastructure that will enhance Australia's ability to maximise the value and impact of geoscience data to meet the social, economic and environmental challenges we face both now and into the future.
Product Type
nonGeographicDataset
eCat Id
78870
Contact for the resource
Custodian
Point of contact
Cnr Jerrabomberra Ave and Hindmarsh Dr GPO Box 378
Canberra
ACT
2601
Australia
Keywords
-
- External Publication
- Australian and New Zealand Standard Research Classification (ANZSRC)
-
- Earth Sciences
-
- Published_Internal
Publication Date
2014-01-01T00:00:00
Creation Date
Security Constraints
Legal Constraints
Status
Purpose
Maintenance Information
unknown
Topic Category
geoscientificInformation
Series Information
Lineage
Unknown
Parent Information
Extents
Reference System
Spatial Resolution
Service Information
Associations
Downloads and Links
Source Information
Source data not available.