Sentinel-2

Tutorials

• Exploring the Chile wildfires with Landsat and Sentinel-2 imagery by Timothy Whitehead
• Integrate imagery from the Sentinel-2 archive into your own apps, maps, and analysis with the Sentinel-2 image service by Esri
• Learning Custom Scripts to Make Useful and Beautiful Satellite Images by Monja Šebela
• Tutorial for using Sentinel-2 data by Antti Lipponen
• Using Vector tiles and AWS Lambda, we can build a really simple API to get Landsat and Sentinel images by Remote Pixel

Tools & Applications

• EO Browser by Sinergise
• EOS Land Viewer by Earth Observing System
• FME Landsat-8/Sentinel-2 File Selector by Safe Software
• Python package for working with Sentinel-2 AWS data by Sinergise
• QGIS plugin for Sentinel-2 data by Sinergise
• Satellite Search by Remote Pixel by Remote Pixel
• Sentinel Hub WMS/WMTS/WCS Service by Sinergise
• Sentinel Playground by Sinergise
• Sentinel-2 Cloudless Atlas by EOX
• Spectator - tracking Sentinel 2, accessing the data and quick preview by Spectator
• Sterling Geo Using Sentinel-2 on Amazon Web Services to Create NDVI by Sterling Geo
• Use the Sentinel Explorer app to explore, visualize, and analyze the entire Sentinel-2 archive by Esri

Landsat 8

Tutorials

• A Gentle Introduction to GDAL Part 4: Working with Satellite Data by Planet
• Exploring the Chile wildfires with Landsat and Sentinel-2 imagery by Timothy Whitehead
• Integrate imagery from the full Landsat archive into your own apps, maps, and analysis with Landsat image services by Esri
• Using Vector tiles and AWS Lambda, we can build a really simple API to get Landsat and Sentinel images by Remote Pixel

Tools & Applications

• Aggi: the fire detecting Twitter bot by Aggi
• Apps for exploring and analyzing Landsat imagery on the fly by Esri
• COG-Explorer - View Cloud Optimized GeoTIFF images in the browser directly from object storage by EOX
• Development Seed Geolambda by Matthew Hanson
• EOS Land Viewer by Earth Observing System
• FME Landsat-8 on AWS Reader by Safe Software
• FME Landsat-8/Sentinel-2 File Selector by Safe Software
• Sentinel Hub WMS/WMTS/WCS Service for Landsat by Sinergise
• Sentinel Playground for Landsat by Sinergise
• Spectator - tracking Landsat 8, accessing the data and quick preview by Spectator

Common Crawl

Tutorials

• Large-scale graph mining with Spark by Win Suen
• Learning word vectors for 157 languages by Facebook AI Research

Tools & Applications

• Dresden Web Table Corpus (DWTC) by Database Systems Group Dresden
• Index to WARC Files and URLs in Columnar Format by Sebastian Nagel

Publications

• Building a Web-Scale Dependency-Parsed Corpus from CommonCrawl by Alexander Panchenko, et al.
• C4Corpus: Multilingual Web-Size Corpus with Free License by Ivan Habernal, Omnia Zayed, Iryna Gurevych
• Large-scale analysis of style injection by relative path overwrite by Sajjad Arshad, et al.
• N-gram counts and language models from the Common Crawl by Christian Buck, Kenneth Heafield, Bas van Ooyen
• Of using Common Crawl to play Family Feud by Paul Masurel
• Using open data to predict market movements by DELL EMC
• Web Data Commons - RDFa, microdata, and microformat data sets by Christian Bizer, Robert Meusel, Anna Primpeli

CBERS on AWS

Tutorials

• Keeping a SpatioTemporal Asset Catalog (STAC) Up To Date with SNS/SQS by Frederico Liporace

Tools & Applications

• aws-sat-api-py by Remote Pixel
• CBERS static STAC catalog served by stac-browser by Radiant Earth
• CBERS timelapse GIF generator by Frederico Liporace
• cbers-tiler by Mapbox
• EOS Land Viewer by Earth Observing System
• Remote Pixel Viewer by Remote Pixel
• rio-tiler by Mapbox
• STAC V0.7 search endpoint for archive by AMS Kepler

IRS 990 Filings

Tutorials

• Tutorial on using the IRS 990 e-file dataset by 990 Consulting, LLC

Tools & Applications

• 990_long by Charity Navigator
• aws-irs-990-explorer by Chris Herbert
• Grantmakers.io by Chad Kruse
• Guide to Open Data for Nonprofit Research by lecy
• Non Profit Light by Non Profit Light
• Nonprofit Explorer by ProPublica
• Open990 by 990 Consulting, LLC
• Parse 990 XML using IRSx by Jacob Fenton

Terrain Tiles

Tools & Applications

• EOS Land Viewer by Earth Observing System
• Mapzen Terrain Tiles on AWS Reader by Safe Software
• On The Go Map by On The Go Map
• Open-Source Elevation Service by Racemap
• PlanetUtils (GitHub): Scripts and a Docker container to download, merge, and resample terrain tiles by Interline Technologies
• PODPAC: Python Library supporting TerrainTiles for analysis by Creare
• R package for accessing Terrain Tiles by Jeffrey W. Hollister
• Sentinel Hub WMS/WMTS/WCS Service for DEM by Sinergise
• Sentinel Playground for DEM by Sinergise

Allen Cell Imaging Collections

Tutorials

• Download and train label-free models by Greg Johnson
• Integrating single-cell sequencing and nuclear imaging data by Chengxiang Qiu and William Noble

Tools & Applications

• AICS Volume Viewer by Dan Toloudis
• AICSImageIO by Matthew Bowden, Jackson Brown, Jamie Sherman, Dan Toloudis
• Allen Cell Feature Explorer by Allen Institute for Cell Science
• Allen Cell Structure Segmenter by Jianxu Chen, Liya Ding, Matheus P. Viana, Melissa C. Hendershott, Ruian Yang, Irina A. Mueller, Susanne M. Rafelski
• Integrated Mitotic Stem Cell by Allen Institute for Cell Science
• Pytorch 3D Integrated Cell by Gregory R. Johnson, Rory M. Donovan-Maiye, Mary M. Maleckar
• Visual Guide to Human Cells by Allen Institute for Cell Science

Publications

• Label-free prediction of three-dimensional fluorescence images from transmitted-light microscopy by Chawin Ounkomol, Sharmishtaa Seshamani, Mary M. Maleckar, Forrest Collman & Gregory R. Johnson

NEXRAD on AWS

Tutorials

• Mapping Noaa Nexrad Radar Data With CARTO by Stuart Lynn
• NEXRAD on EC2 tutorial by openradar
• Using Python to Access NCEI Archived NEXRAD Level 2 Data (Jupyter notebook) by Ryan May

Tools & Applications

• nexradaws on pypi.python.org - python module to query and download Nexrad data from Amazon S3 by Aaron Anderson
• WeatherPipe - Amazon EMR based analysis tool for NEXRAD data stored on Amazon S3 by Stephen Lien Harrell

Publications

• Seasonal abundance and survival of North America’s migratory avifauna determined by weather radar by Adriaan M. Dokter, Andrew Farnsworth, Daniel Fink, Viviana Ruiz-Gutierrez, Wesley M. Hochachka, Frank A. La Sorte, Orin J. Robinson, Kenneth V. Rosenberg & Steve Kelling
• Unlocking the Potential of NEXRAD Data through NOAA’s Big Data Partnership by Steve Ansari and Stephen Del Greco

SpaceNet

Tutorials

• Getting Started with SpaceNet Data by Adam Van Etten

Tools & Applications

• Solaris: an open source Python library for analyzing overhead imagery with machine learning by Nick Weir

Publications

• 2nd SpaceNet Competition Winners Code Release by David Lindenbaum
• Building Extraction with YOLT2 and SpaceNet Data by Adam Van Etten
• Introducing the SpaceNet Road Detection and Routing Challenge and Dataset by David Lindenbaum
• Solving SpaceNet Road Detection Challenge With Deep Learning by Jonathan Howe, May Casterline and Abel Brown
• SpaceNet: Winning Implementations and New Imagery Release by Todd Stavish

eBird Status and Trends Model Results

Tutorials

• eBird Status and Trends FAQ by Cornell Lab of Ornithology
• eBird Status and Trends Visualizations by Cornell Lab of Ornithology
• ebirdst - Background, Data Access and Data Structure by Tom Auer and Daniel Fink
• ebirdst - Generating Seasonal Abundance and Range Maps and Stats by Matt Strimas-Mackey, Tom Auer, and Daniel Fink
• ebirdst - Intro Mapping by Tom Auer and Daniel Fink
• ebirdst - Non-raster Data by Tom Auer and Daniel Fink

Tools & Applications

• ebirdst R Package by Cornell Lab of Ornithology

Global Database of Events, Language and Tone (GDELT)

Tutorials

• Analysing Brexit Coverage In The Media Over Time by Mark Chopping
• Bootstrapping GeoMesa HBase on AWS S3 by Commonwealth Computer Research, Inc.
• Creating PySpark DataFrame from CSV in AWS S3 in EMR by Jake Chen
• Exploring GDELT with Athena by Julien Simon
• Running R on Amazon Athena by Gopal Wunnava

Tools & Applications

• Globe Events by thermobook

Community Earth System Model Large Ensemble (CESM LENS)

Tutorials

• Analyzing large climate model ensembles in the cloud by Joe Hamman, NCAR

Tools & Applications

• Jupyter Notebook and other documentation and tools for CESM LENS on AWS by NCAR Science at Scale team
• Rendered (static) version of Jupyter Notebook by Anderson Banihirwe, NCAR

Publications

• The Community Earth System Model (CESM) Large Ensemble Project: A Community Resource for Studying Climate Change in the Presence of Internal Climate Variability by Kay et al. (2015), Bull. AMS, 96, 1333-1349

New York City Taxi and Limousine Commission (TLC) Trip Record Data

Tutorials

• Build a Real-time Stream Processing Pipeline with Apache Flink on AWS by Steffen Hausmann
• Deep Dive on Flink & Spark on Amazon EMR by Keith Steward
• Exploring data with Python and Amazon S3 Select by Manav Sehgal
• Optimizing data for analysis with Amazon Athena and AWS Glue by Manav Sehgal

OpenStreetMap on AWS

Tutorials

• Develop and Extract Value from Open Data by Daniel Bernao
• Querying OpenStreetMap with Amazon Athena by Seth Fitzsimmons

Tools & Applications

• OSM+Athena (GitHub) by Development Seed
• PlanetUtils (GitHub): Scripts and a Docker container to maintain your own OpenStreetMap planet by Interline Technologies

Sentinel-1

Tools & Applications

• EO Browser by Sinergise
• EOS Land Viewer by Earth Observing System
• Sentinel Hub WMS/WMTS/WCS Service by Sinergise by Sinergise
• Sentinel Playground by Sinergise

Amazon Customer Reviews Dataset

Tutorials

• How to scale sentiment analysis using Amazon Comprehend, AWS Glue and Amazon Athena by Roy Hasson
• Implementing a recommender system with Amazon SageMaker and Apache MXNet Gluon by David Arpin
• Querying Review Data with Kognitio AWS Marketplace product using SQL by Mark Chopping

Deutsche Börse Public Dataset

Tutorials

• 10 visualizations to try in Amazon QuickSight with sample data by AWS Big Data Blog
• Stock Price Movement Prediction Using The Deutsche Börse Public Dataset & Machine Learning by Originate

Tools & Applications

• Streaming XETRA Data Using Apache Spark by Thermobook

Encyclopedia of DNA Elements (ENCODE)

Tutorials

• ENCODE CTCF ChIP-seq data correlation across different cell types by Paul Sud
• Exploring ENCODE data from EC2 with Jupyter notebook by Keenan Graham
• Ingesting ENCODE data into TileDB with S3 backend by Otto Jolanki

GEOS-Chem Input Data

Tutorials

• Tutorial on accessing GEOS-Chem data bucket in S3 by Jiawei Zhuang

Publications

• Overview of the GEOSChem-on-cloud project by Atmospheric Chemistry Modeling Group, Harvard University
• Running GEOS-Chem on Cloud Computing Platforms, presented at the 8th International GEOS-Chem Meeting by Jiawei Zhuang, et al.

MODIS on AWS

Tools & Applications

• EOS Land Viewer by Earth Observing System
• Sentinel Hub WMS/WMTS/WCS Service for MODIS by Sinergise
• Sentinel Playground for MODIS by Sinergise

NREL Wind Integration National Dataset on AWS

Tools & Applications

• HSDS Examples by Caleb Phillips, Caroline Draxl, John Readey, Jordan Perr-Sauer
• Wind Visualization by Jordan Perr-Sauer

Publications

• Power from wind: Open data on AWS by Caleb Phillips, Caroline Draxl, John Readey, Jordan Perr-Sauer

OpenAQ

Tutorials

• Access OpenAQ data via a filterable SNS topic by OpenAQ
• Using Athena to access the whole archive by OpenAQ

Tools & Applications

• ARISense by Aerodyne Research, Inc.
• hackAIR by hackAir
• ropenaq R package by Maëlle Salmon
• Smokey: Air Quality Bot by Amrit Sharma

SILO climate data on AWS

Tools & Applications

• Convert NetCDF to ESRI ArcASCII or GeoTIFF by SILO
• NetCDF Operators to calculate seasonal means by SILO
• Python script to calculate a regional mean by SILO

Southern California Earthquake Data

Tutorials

• Cactus to Clouds: Processing The SCEDC Open Data Set on AWS by Tim Clements
• Getting Started with SCEDC AWS Public Dataset by Ellen Yu
• Using Lambda to Process Seismograms by Shang-Lin Chen

USGS 3DEP LiDAR Point Clouds

Tutorials

• Using Lambda Layers with USGS 3DEP LiDAR Point Clouds by Howard Butler
• WebGL Visualization of USGS 3DEP Lidar Point Clouds with Potree and Plasio.js by Connor Manning

Publications

• USGS 3DEP Lidar Point Cloud Now Available as Amazon Public Dataset by Department of the Interior, U.S. Geological Survey

Africa Soil Information Service (AfSIS) Soil Chemistry

Tutorials

• AfSIS Soil Chemistry - Usage Tutorial by QED

Publications

• Goalkeepers 2018, Soil - The Big Data Beneath Your Feet by QED

Amazon Bin Image Dataset

Publications

• Amazon Bin Image Dataset Challenge by silverbottlep
• Amazon Inventory Reconciliation using AI by Pablo Rodriguez Bertorello, Sravan Sripada, Nutchapol Dendumrongsup

Atmospheric Models from Météo-France

Tools & Applications

• Windguru.cz by Windguru
• Windy.com by Windy

ECMWF ERA5 Reanalysis

Tutorials

• Accessing ERA5 Data on S3 Using Boto by Intertrust Technologies Corporation
• ERA5 tutorial using the Planet OS API by Intertrust Technologies Corporation

GOES on AWS

Tutorials

• Visualize GOES-16 in Python using Xarray by Hamed Alemohammad

Publications

• Billions of Birds Migrate. Where Do They Go? by National Geographic

Hubble Space Telescope Public Data

Tutorials

• Exploring AWS Lambda with cloud-hosted Hubble public data by Arfon Smith

Publications

• Making HST Public Data Available on AWS by Arfon Smith

NAIP on AWS

Tools & Applications

• EOS Land Viewer by Earth Observing System
• VoyagerSearch showing off Batch + NAIP by Voyager

NASA NEX

Tutorials

• Accessing and plotting NASA-NEX data, from GEOSChem-on-cloud tutorial. by Jiawei Zhuang

Tools & Applications

• Azavea Climate API by Azavea

NREL National Solar Radiation Database on AWS

Tools & Applications

• NSRDB Viewer by Manajit Sengupta, Yu Xe, Anthony Lopez, Aron Habte, Galen Maclaurin, James Shelby, Paul Edwards

Publications

• The National Solar Radiation Data Base (NSRDB) by Manajit Sengupta, Yu Xe, Anthony Lopez, Aron Habte, Galen Maclaurin, James Shelby

Open City Model (OCM)

Tutorials

• Running queries on Open City Model using AWS Athena by Allen Gilliland
• Using Open City Model with the 3dCityDB by Allen Gilliland

OpenEEW

Tutorials

• Analyzing a magnitude 7.2 earthquake in Mexico using Python by Grillo

Tools & Applications

• OpenEEW library for Python by Grillo

Rapid7 FDNS ANY Dataset

Tutorials

• Creating a Project Sonar FDNS API with AWS by Evan Perotti at SecurityRiskAdvisors
• How to Conduct DNS Reconnaissance for $.02 Using Rapid7 Open Data and AWS by Shan Sikdar at Rapid7

UK Met Office Atmospheric Deterministic and Probabilistic Forecasts

Tutorials

• Met Office AWS Earth data - Getting Started by Jacob Tomlinson
• Met Office AWS Earth data - Subscribing to data by Jacob Tomlinson

1000 Genomes

Publications

• Exploratory data analysis of genomic datasets using ADAM and Mango with Apache Spark on Amazon EMR by Alyssa Marrow

AWS iGenomes

Tools & Applications

• nf-core analysis pipelines by Phil Ewels

Allen Brain Observatory - Visual Coding AWS Public Data Set

Tutorials

• Use the Allen Brain Observatory – Visual Coding on AWS by Nika Keller, David Feng

Broad Genome References

Tools & Applications

• Genomics Workflows on AWS - Cromwell on AWS by W. Lee Pang

Cell Painting Image Collection

Publications

• Example submission for the 2018 CytoData Hackathon (in R and Python) by Juan Caicedo, Tim Becker

Cornell EAS Data Lake

Tutorials

• Cornell EAS Data Lake Setup Tutorial by Marty Sullivan

GATK Test Data

Tools & Applications

• Genomics Workflows on AWS - Cromwell on AWS by W. Lee Pang

LOFAR ELAIS-N1 cycle 2 observations on AWS

Publications

• Calibration of LOFAR ELAIS-N1 data in the Amazon cloud by J. Sabater

NOAA Global Historical Climatology Network Daily (GHCN-D)

Tutorials

• Visualize over 200 years of global climate data using Amazon Athena and Amazon QuickSight by Conor Delaney

QIIME 2 User Tutorial Datasets

Tutorials

• Installing QIIME 2 using Amazon Web Services by The QIIME 2 Development Team

SILAM Air Quality

Tutorials

• Simple examples by Roope Tervo

Safecast

Tools & Applications

• Safecast Map by Nick Dolezal

Sentinel-1 SLC dataset for South and Southeast Asia, Taiwan, and Japan

Tutorials

• Sentinel-1 Opendataset Wiki and Tutorials by Earth Observatory of Singapore

TCGA on AWS

Tutorials

• Building High-Throughput Genomics Batch Workflows on AWS by Aaron Friedman

Transiting Exoplanet Survey Satellite (TESS)

Publications

• TESS data available on AWS by Arfon Smith

U.S. Census ACS PUMS

Tutorials

• Setting up Blazegraph on EC2 by data.world

Unidata NOAA Global Forecast System (GFS) Model

Tools & Applications

• PODPAC: Python Library supporting GFS for analysis by Creare

Voices Obscured in Complex Environmental Settings (VOiCES)

Tutorials

• Getting started with VOiCES data by M.A. Barrios

Xiph.Org Test Media

Tutorials

• Encoding video with AV1 on EC2 by Thomas Daede

Yale-CMU-Berkeley (YCB) Object and Model Set

Publications

• Benchmarking in Manipulation Research: Using the Yale-CMU-Berkeley Object and Model Set by Berk Calli, Aaron Walsman, Arjun Singh, Siddhartha Srinivasa, Pieter Abbeel, Aaron M Dollar
• Label Fusion: A Pipeline for Generating Ground Truth Labels for Real RGBD Data of Cluttered Scenes by Pat Marion, Peter R. Florence, Lucas Manuelli, Russ Tedrake
• Pre-touch sensing for sequential manipulation by Boling Yang, Patrick Lancaster, Joshua R. Smith
• The Closure Signature: A Functional Approach to Model Underactuated Compliant Robotic Hands by Maria Pozzi, Gionata Salvietti, João Bimbo, Monica Malvezzi, Domenico Prattichizzo

ZINC Database

Publications

• ZINC Database by John Irwin

MIMIC-III (‘Medical Information Mart for Intensive Care’)

Tutorials

• Perform biomedical informatics without a database using MIMIC-III data and Amazon Athena by James Wiggins, Alistair Johnson

Tools & Applications

• MIMIC-code GitHub repository by Alistair Johnson

Swiss Public Transport Stops

Tools & Applications

• Map Viewer by Swiss Geoportal