Between the Poles: Open developer-friendly standard for querying satellite imagery

Geoff Zeiss

About the Author

October 2019

Sun	Mon	Tue	Wed	Thu	Fri	Sat
		1	2	3	4	5
6	7	8	9	10	11	12
13	14	15	16	17	18	19
20	21	22	23	24	25	26
27	28	29	30	31

Links

Lidar News
Gene Roe's laser scanning industry news
Open Source Geospatial Foundation OSGEO
OSGeo was created to support the collaborative development of open source geospatial software and promote its widespread use
Proven guidelines for reducing underground infrastructure damage at airports, university, industrial, and commercial campuses, and towns
There are proven measures that an administration, owner, or municipal government responsible for an airport, university, industrial or commercial campus, or town can undertake to reduce the risk of underground utility damage, the associated disruptions to operations and business and the danger for workers and the public.
Sharing information about the location of underground utilities
The U.S. devotes an estimated $10 billion annually to locating underground infrastructure. Every construction project requiring excavation involves significant efforts in locating underground utilities prior to and during construction to reduce the risk of injuries and unexpected project delays. But this information is rarely shared and the location of underground infrastructure is recaptured over and over again. There are successful examples around the world where municipal and regional governments have helped enable a shared underground utility network database.
Growing evidence of the benefits of an integrated BIM+geospatial full lifecycle approach to construction
Building information modeling (BIM) has been applied to design-build construction projects for many years. A growing number of countries are mandating BIM for public projects. While the UK government has said that "...we know that the largest prize for BIM lies in the operational stages of the project life-cycle", until recently there has not been hard data to support this conjecture. Similarly there has been only anecdotal support for an integrated BIM and geospatial approach for design, build, operate and maintain projects. Now we are beginning to see data from real world projects that offer evidence for the benefits of an integrated BIM+geospatial full lifecycle approach for construction projects.
Progress in geospatial, civil, and BIM interoperability promises efficient workflows for infrastructure
The BIM and geospatial interoperability challenge is the latest symptom of the broader problem of integrating AEC and geospatial workflows, that has contributed to low productivity in the construction sector. After the announcement about a year ago by Jack Dangermond and Andrew Anagnost of a new relationship to build a bridge between Autodesk and ESRI technologies, I thought it a good time to review progress toward interoperability between the AEC and geospatial worlds.
Geography2050: Accurate location information about underground infrastructure is essential for powering our future planet
I thought it would be worth while to include here a talk I gave at GEOGRAPHY 2050 Powering Our Future Planet at Columbia University in New York about the importance of accurate location information about underground infrastructure for the future development of the energy grid. With some notable exceptions accurately recording the location of subsurface infrastructure including oil, gas, electric power and other energy infrastructure is ignored - perhaps this is a case of out-of-sight is indeed out-of-mind. The reality is that knowing the location of underground energy infrastructure is critical for national security, for disaster planning and management, for public safety and for economic efficiency. Everyone is aware of at least one disaster resulting from or exacerbated by not knowing where our energy infrastructure is - the explosions in San Bruno in California (2010) and Belgium (2004) immediately come to mind.
Deep learning enables automated extraction of building footprints and road networks from satellite imagery
Automated feature extraction from satellite imagery has made major progress in the last year. Accurate building footprints extracted from high resolution satellite imagery are becoming available from companies such as Ecopia, which has just announced a partnership with DigitalGlobe, whose satellites are capable of 30 cm (approximately one foot) resolution. Also NVIDIA has demonstrated the ability to automate detection of many road networks using sophisticated algorithms and multi-spectral high resolution imagery.
BIM + geospatial interoperability would avoid another CAD + GIS quagmire
A specific challenge currently facing the AEC and geospatial industries is integrating building information models (BIM) and geospatial infrastructure and building models. There are parallels between what happened in the 1990s in unsuccessfully addressing CAD+GIS interoperability and the current challenge of BIM+geospatial interoperability. But there are also important differences which provide grounds for optimism that the availability of both BIM and geospatial standards, a vibrant open source geospatial community, and a new willingness on the part of major software players in the BIM and geospatial industries will make it possible to successfully address the latest interoperability challenge facing the AEC (architecture, engineering and construction) and geospatial industries.
BVLOS drones improve power line inspections amid increasing fire and storm risks for utilities | Utility Dive
Transmission line inspections for vegetation management and other purposes are essential in ensuring grid reliability and resilience. We saw the devastating effect of vegetation encroachment in the recent California fires, which in part have been blamed on failure to maintain properly cleared transmission lines. With drones that can cover great distances in a single flight and provide detailed and accurate aerial imagery of transmission lines and other infrastructure, it is now possible to almost completely automate this expensive process. Automating transmission line inspections for vegetation management using BVLOS drones not only saves money, but also could improve the resiliency and reliability of the transmission grid.

« Enabling the rest of us to find actionable information in huge volumes of satellite data | Main | Virtual reference networks workshop »

May 17, 2018

Open developer-friendly standard for querying satellite imagery

One of the things that is required to make the vast quantity of satellite imagery easily searchable is a common way to query satellite data. The SpatioTemporal Asset Catalog, known as STAC, is an open specification that came about when fourteen different organizations came together to increase the interoperability of searching for satellite imagery. At this year's FOSS4GNA (Free and Open Source Software for Geospatial North America) get together in St Louis, Matt Hanson, of developmentSEED, gave a technical overview of the STAC standard and described one of the first implementations. The context for Matt's STAC presentation was provided by Chris Holmes' keynote in the morning.

Chris Holmes and others have been working on a standard for searching satellite imagery. Currently when a user wants to search for all the imagery in their area and time of interest they can’t make just one search — they have to use different tools and connect to API’s that are similar but all slightly different. The STAC specification aims to make that much easier, by providing common metadata and API mechanics to search and access geospatial data. This and other standards are essential for opening up satellite data to processing and visualization. This is one of a new breed of standards that are designed to be developer-friendly to encourage the open source community and others to get involved with the Open Geospatial Consortium (OGC) to further interoperability.

The STAC standard is minimalist, but balances that with extensibility. Basically it is comprised of metadata, catalog, and API. The core of STAC metadata is very simple, with only three mandatory fields; ID, geometry (for example, a bounding box in a defined projection), and date and time. The standard supports extensions, of which the earth observation standard "eo" has been defined at this time. Future extensions could include point cloud, mosaic and video extensions. The eo extension includes parameters such as camera viewing angle, resolution (dist between pixels), percent cloud cover, and band descriptions such as RGB, SWIR, band frequency and band accuracy.

The STAC standard and cloud optimized GeoTiff (COG) files makes it possible to search and stream imagery. COGs are GeoTiff files optimized for the cloud, for example, by streaming them from Amazon Web Services S3. Planet, Google Earth, and QGIS already support COGs and there are other open source tools such as COG-Explorer that support them as well.

Sat-api is developmentSEED's partial implementation of STAC. It currently supports Landsat-8 and Sentinel-2 imagery. The API allows these imagery libraries to be queried by any of the metadata fields such as date and time, location (by defining a polygon), bands, viewing angle, and so on. It returns GeoJSON. Matt provided some example queries.

Find all Landsat-8 scenes from 2017 with 0-20% cloud cover

https://sat-api.developmentseed.org/search/stac?datetime=2017&collection=landsat-8&eo:cloud_cover=0/20

Find all scenes from Dec 31, 2016 through Jan 1, 2018

https://sat-api.developmentseed.org/search/stac?datetime=2016-12-31/2018-01-01

The next developments that developmentSEED is planning for the STAC standard is to add more data CBERS and MODIS and to develop some applications based on the API.

Posted at 02:30 PM in Earth from space, Earth observation from satellites, Geospatial Open Source, Geospatial Standards, Imagery, Open Data, Open Source Geospatial, Open Standards, Sharing Spatial Data, Spatial Data, Temporal geospatial | Permalink

Comments

The comments to this entry are closed.

Between the Poles

Geoff Zeiss

October 2019

Links

May 17, 2018

Open developer-friendly standard for querying satellite imagery

Comments

RSS Feed

Search

Categories

Recent Posts

Archives