EOSDIS is working toward a vision of a cloud-based, highly flexible system to meet its ever-growing and evolving data demands. Cumulus, a free and open source framework, supports this vision via configurable workflows to ingest, process, archive, manage, and distribute NASA’s Earth imagery. The Cumulus infrastructure is designed for scalability and reliability, using much of the AWS serverless platform, which enables Cumulus to scale in real time to be performant under the largest expected workloads.
Cumulus is poised to make a huge impact on how NASA manages and disseminates its Earth science imagery. In one notable case, the NASA-ISRO Synthetic Aperture Radar (NISAR) mission, Cumulus will be used to collect more data in a year than exists in NASA’s current archive. The NISAR mission will collect 45 PB a year and process that data at a rate of 1 GB per second. The need for Cumulus is proven through its application to NASA missions, but its application has extended beyond NASA’s Distributed Active Archive Centers (DAACs). It’s being used to monitor agriculture in Tanzania, apply machine learning models to estimate hurricane intensity, and generate air quality predictions using near-real-time forecast data.
Aimee Barciauskas (Development Seed) outlines the motivation for Cumulus, the achievements and hurdles of the past two years, and its varied applications. You’ll learn about the availability of the open-sourced software and how NASA intends to make its Earth Observing Geospatial data available for free to the public in the cloud.
- Title: How NASA is building a petabyte-scale geospatial archive in the cloud
- Release date: December 2019
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 0636920361817
You might also like
Building Event-Driven Microservices
Organizations today often struggle to balance business requirements with ever-increasing volumes of data. Additionally, the demand …
Go is rapidly becoming the preferred language for building web services. There are plenty of tutorials …
gRPC: Up and Running
Get a comprehensive understanding of gRPC fundamentals through real-world examples. With this practical guide, you’ll learn …
O'Reilly Software Architecture Conference 2020 - New York, NY
O’Reilly Media’s Software Architecture Conference (SACON) New York 2020 was Maggie Carrol’s (MAG Aerospace) compelling examination …