Sentinel-2

Tutorials

• Exploring the Chile wildfires with Landsat and Sentinel-2 imagery by Timothy Whitehead
• Integrate imagery from the Sentinel-2 archive into your own apps, maps, and analysis with the Sentinel-2 image service by Esri
• Learning Custom Scripts to Make Useful and Beautiful Satellite Images by Monja Šebela
• Tutorial for using Sentinel-2 data by Antti Lipponen
• Using Vector tiles and AWS Lambda, we can build a really simple API to get Landsat and Sentinel images by Remote Pixel

Tools & Applications

• EO Browser by Sinergise
• EOS Land Viewer by Earth Observing System
• FME Landsat-8/Sentinel-2 File Selector by Safe Software
• Interactive map with AI detected fields and crops based on Sentinel-2 imagery by OneSoil
• Python package for working with Sentinel-2 AWS data by Sinergise
• QGIS plugin for Sentinel-2 data by Sinergise
• Satellite Search by Remote Pixel by Remote Pixel
• Sentinel Hub WMS/WMTS/WCS Service by Sinergise
• Sentinel Playground by Sinergise
• Sentinel-2 Cloudless Atlas by EOX
• Spectator - tracking Sentinel 2, accessing the data and quick preview by Spectator
• Sterling Geo Using Sentinel-2 on Amazon Web Services to Create NDVI by Sterling Geo
• Use the Sentinel Explorer app to explore, visualize, and analyze the entire Sentinel-2 archive by Esri

Landsat 8

Tutorials

• A Gentle Introduction to GDAL Part 4: Working with Satellite Data by Planet
• Exploring the Chile wildfires with Landsat and Sentinel-2 imagery by Timothy Whitehead
• Integrate imagery from the full Landsat archive into your own apps, maps, and analysis with Landsat image services by Esri
• Using Vector tiles and AWS Lambda, we can build a really simple API to get Landsat and Sentinel images by Remote Pixel

Tools & Applications

• Aggi: the fire detecting Twitter bot by Aggi
• Apps for exploring and analyzing Landsat imagery on the fly by Esri
• COG-Explorer - View Cloud Optimized GeoTIFF images in the browser directly from object storage by EOX
• Development Seed Geolambda by Matthew Hanson
• EOS Land Viewer by Earth Observing System
• FME Landsat-8 on AWS Reader by Safe Software
• FME Landsat-8/Sentinel-2 File Selector by Safe Software
• Sentinel Hub WMS/WMTS/WCS Service for Landsat by Sinergise
• Sentinel Playground for Landsat by Sinergise
• Spectator - tracking Landsat 8, accessing the data and quick preview by Spectator

Common Crawl

Tutorials

• Large-scale graph mining with Spark by Win Suen
• Learning word vectors for 157 languages by Facebook AI Research

Tools & Applications

• Dresden Web Table Corpus (DWTC) by Database Systems Group Dresden
• Index to WARC Files and URLs in Columnar Format by Sebastian Nagel

Publications

• Building a Web-Scale Dependency-Parsed Corpus from CommonCrawl by Alexander Panchenko, et al.
• C4Corpus: Multilingual Web-Size Corpus with Free License by Ivan Habernal, Omnia Zayed, Iryna Gurevych
• Large-scale analysis of style injection by relative path overwrite by Sajjad Arshad, et al.
• N-gram counts and language models from the Common Crawl by Christian Buck, Kenneth Heafield, Bas van Ooyen
• Of using Common Crawl to play Family Feud by Paul Masurel
• Using open data to predict market movements by DELL EMC
• Web Data Commons - RDFa, microdata, and microformat data sets by Christian Bizer, Robert Meusel, Anna Primpeli

CBERS on AWS

Tutorials

• Keeping a SpatioTemporal Asset Catalog (STAC) Up To Date with SNS/SQS by Frederico Liporace

Tools & Applications

• aws-sat-api-py by Remote Pixel
• CBERS static STAC catalog served by stac-browser by Radiant Earth
• CBERS timelapse GIF generator by Frederico Liporace
• cbers-tiler by Mapbox
• EOS Land Viewer by Earth Observing System
• Remote Pixel Viewer by Remote Pixel
• rio-tiler by Mapbox
• STAC V0.7 search endpoint for archive by AMS Kepler

IRS 990 Filings

Tutorials

• Tutorial on using the IRS 990 e-file dataset by 990 Consulting, LLC

Tools & Applications

• 990_long by Charity Navigator
• aws-irs-990-explorer by Chris Herbert
• Grantmakers.io by Chad Kruse
• Guide to Open Data for Nonprofit Research by lecy
• Non Profit Light by Non Profit Light
• Nonprofit Explorer by ProPublica
• Open990 by 990 Consulting, LLC
• Parse 990 XML using IRSx by Jacob Fenton

Terrain Tiles

Tools & Applications

• EOS Land Viewer by Earth Observing System
• Mapzen Terrain Tiles on AWS Reader by Safe Software
• On The Go Map by On The Go Map
• Open-Source Elevation Service by Racemap
• PlanetUtils (GitHub): Scripts and a Docker container to download, merge, and resample terrain tiles by Interline Technologies
• PODPAC: Python Library supporting TerrainTiles for analysis by Creare
• R package for accessing Terrain Tiles by Jeffrey W. Hollister
• Sentinel Hub WMS/WMTS/WCS Service for DEM by Sinergise
• Sentinel Playground for DEM by Sinergise

Allen Cell Imaging Collections

Tutorials

• Download and train label-free models by Greg Johnson
• Integrating single-cell sequencing and nuclear imaging data by Chengxiang Qiu and William Noble

Tools & Applications

• AICS Volume Viewer by Dan Toloudis
• AICSImageIO by Matthew Bowden, Jackson Brown, Jamie Sherman, Dan Toloudis
• Allen Cell Feature Explorer by Allen Institute for Cell Science
• Allen Cell Structure Segmenter by Jianxu Chen, Liya Ding, Matheus P. Viana, Melissa C. Hendershott, Ruian Yang, Irina A. Mueller, Susanne M. Rafelski
• Integrated Mitotic Stem Cell by Allen Institute for Cell Science
• Pytorch 3D Integrated Cell by Gregory R. Johnson, Rory M. Donovan-Maiye, Mary M. Maleckar
• Visual Guide to Human Cells by Allen Institute for Cell Science

Publications

• Label-free prediction of three-dimensional fluorescence images from transmitted-light microscopy by Chawin Ounkomol, Sharmishtaa Seshamani, Mary M. Maleckar, Forrest Collman & Gregory R. Johnson

NEXRAD on AWS

Tutorials

• Mapping Noaa Nexrad Radar Data With CARTO by Stuart Lynn
• NEXRAD on EC2 tutorial by openradar
• Using Python to Access NCEI Archived NEXRAD Level 2 Data (Jupyter notebook) by Ryan May

Tools & Applications

• nexradaws on pypi.python.org - python module to query and download Nexrad data from Amazon S3 by Aaron Anderson
• WeatherPipe - Amazon EMR based analysis tool for NEXRAD data stored on Amazon S3 by Stephen Lien Harrell

Publications

• Seasonal abundance and survival of North America’s migratory avifauna determined by weather radar by Adriaan M. Dokter, Andrew Farnsworth, Daniel Fink, Viviana Ruiz-Gutierrez, Wesley M. Hochachka, Frank A. La Sorte, Orin J. Robinson, Kenneth V. Rosenberg & Steve Kelling
• Unlocking the Potential of NEXRAD Data through NOAA’s Big Data Partnership by Steve Ansari and Stephen Del Greco

SpaceNet

Tutorials

• Getting Started with SpaceNet Data by Adam Van Etten

Tools & Applications

• Solaris: an open source Python library for analyzing overhead imagery with machine learning by Nick Weir

Publications

• 2nd SpaceNet Competition Winners Code Release by David Lindenbaum
• Building Extraction with YOLT2 and SpaceNet Data by Adam Van Etten
• Introducing the SpaceNet Road Detection and Routing Challenge and Dataset by David Lindenbaum
• Solving SpaceNet Road Detection Challenge With Deep Learning by Jonathan Howe, May Casterline and Abel Brown
• SpaceNet: Winning Implementations and New Imagery Release by Todd Stavish

eBird Status and Trends Model Results

Tutorials

• eBird Status and Trends FAQ by Cornell Lab of Ornithology
• eBird Status and Trends Visualizations by Cornell Lab of Ornithology
• ebirdst - Background, Data Access and Data Structure by Tom Auer and Daniel Fink
• ebirdst - Generating Seasonal Abundance and Range Maps and Stats by Matt Strimas-Mackey, Tom Auer, and Daniel Fink
• ebirdst - Intro Mapping by Tom Auer and Daniel Fink
• ebirdst - Non-raster Data by Tom Auer and Daniel Fink

Tools & Applications

• ebirdst R Package by Cornell Lab of Ornithology

Global Database of Events, Language and Tone (GDELT)

Tutorials

• Analysing Brexit Coverage In The Media Over Time by Mark Chopping
• Bootstrapping GeoMesa HBase on AWS S3 by Commonwealth Computer Research, Inc.
• Creating PySpark DataFrame from CSV in AWS S3 in EMR by Jake Chen
• Exploring GDELT with Athena by Julien Simon
• Running R on Amazon Athena by Gopal Wunnava

Tools & Applications

• Globe Events by thermobook

Open NeuroData

Tutorials

• Download by Benjamin Falk
• Visualization using Neuroglancer by Benjamin Falk

Tools & Applications

• CloudVolume by William Silversmith
• Igneous by William Silversmith
• Neuroglancer by Jeremy Maitin-Shepard

Publications

• A Community-Developed Open-Source Computational Ecosystem for Big Neuro Data by J. T. Vogelstein, E. Perlman, B. Falk, A. Baden, W. Gray Roncal, V. Chandrashekhar, F. Collman, S. Seshamani, J. L. Patsolic, K. Lillaney, M. Kazhdan, R. Hider, D. Pryor, J. Matelsky, T. Gion, P. Manavalan, B. Wester, M. Chevillet, E. T. Trautman, K. Khairy, E. Bridgeford, D. M. Kleissas, D. J. Tward, A. K. Crow, B. Hsueh, M. A. Wright, M. I. Miller, S. J. Smith, R. J. Vogelstein, K. Deisseroth, and R. Burns
• From cosmos to connectomes: The evolution of data-intensive science by R. Burns, J. T. Vogelstein, and A. S. Szalay
• The Open Connectome Project Data Cluster: Scalable Analysis and Vision for High-Throughput Neuroscience by R. Burns, W. G. Roncal, D. Kleissas, K. Lillaney, P. Manavalan, E. Perlman, D. R. Berger, D. D. Bock, K. Chung, L. Grosenick, N. Kasthuri, N. C. Weiler, K. Deisseroth, M. Kazhdan, J. Lichtman, R. C. Reid, S. J. Smith, A. S. Szalay, J. T. Vogelstein, and R. J. Vogelstein.
• To the Cloud! A Grassroots Proposal to Accelerate Brain Science Discovery by J. T. Vogelstein, B. Mensh, M. Häusser, N. Spruston, A. C. Evans, K. Kording, K. Amunts, C. Ebell, J. Muller, M. Telefont, S. Hill, S. P. Koushika, C. Calì, P. A. Valdés-Sosa, P. B. Littlewood, C. Koch, S. Saalfeld, A. Kepecs, H. Peng, Y. O. Halchenko, G. Kiar, M. M. Poo, J. B. Poline, M. P. Milham, A. P. Schaffer, R. Gidron, H. Okano, V. D. Calhoun, M. Chun, D. M. Kleissas, R. J. Vogelstein, E. Perlman, R. Burns, R. Huganir, and M. I. Miller

Amazon Customer Reviews Dataset

Tutorials

• How to scale sentiment analysis using Amazon Comprehend, AWS Glue and Amazon Athena by Roy Hasson
• Implementing a recommender system with Amazon SageMaker and Apache MXNet Gluon by David Arpin
• Querying Review Data with Kognitio AWS Marketplace product using SQL by Mark Chopping
• Using S3 and Analytics with Amazon Reviews data by AWS

Community Earth System Model Large Ensemble (CESM LENS)

Tutorials

• Analyzing large climate model ensembles in the cloud by Joe Hamman, NCAR

Tools & Applications

• Jupyter Notebook and other documentation and tools for CESM LENS on AWS by NCAR Science at Scale team
• Rendered (static) version of Jupyter Notebook by Anderson Banihirwe, NCAR

Publications

• The Community Earth System Model (CESM) Large Ensemble Project: A Community Resource for Studying Climate Change in the Presence of Internal Climate Variability by Kay et al. (2015), Bull. AMS, 96, 1333-1349

New York City Taxi and Limousine Commission (TLC) Trip Record Data

Tutorials

• Build a Real-time Stream Processing Pipeline with Apache Flink on AWS by Steffen Hausmann
• Deep Dive on Flink & Spark on Amazon EMR by Keith Steward
• Exploring data with Python and Amazon S3 Select by Manav Sehgal
• Optimizing data for analysis with Amazon Athena and AWS Glue by Manav Sehgal

OpenStreetMap on AWS

Tutorials

• Develop and Extract Value from Open Data by Daniel Bernao
• Querying OpenStreetMap with Amazon Athena by Seth Fitzsimmons

Tools & Applications

• OSM+Athena (GitHub) by Development Seed
• PlanetUtils (GitHub): Scripts and a Docker container to maintain your own OpenStreetMap planet by Interline Technologies

Sentinel-1

Tools & Applications

• EO Browser by Sinergise
• EOS Land Viewer by Earth Observing System
• Sentinel Hub WMS/WMTS/WCS Service by Sinergise by Sinergise
• Sentinel Playground by Sinergise

Deutsche Börse Public Dataset

Tutorials

• 10 visualizations to try in Amazon QuickSight with sample data by AWS Big Data Blog
• Stock Price Movement Prediction Using The Deutsche Börse Public Dataset & Machine Learning by Originate

Tools & Applications

• Streaming XETRA Data Using Apache Spark by Thermobook

Encyclopedia of DNA Elements (ENCODE)

Tutorials

• ENCODE CTCF ChIP-seq data correlation across different cell types by Paul Sud
• Exploring ENCODE data from EC2 with Jupyter notebook by Keenan Graham
• Ingesting ENCODE data into TileDB with S3 backend by Otto Jolanki

GEOS-Chem Input Data

Tutorials

• Tutorial on accessing GEOS-Chem data bucket in S3 by Jiawei Zhuang

Publications

• Overview of the GEOSChem-on-cloud project by Atmospheric Chemistry Modeling Group, Harvard University
• Running GEOS-Chem on Cloud Computing Platforms, presented at the 8th International GEOS-Chem Meeting by Jiawei Zhuang, et al.

MODIS on AWS

Tools & Applications

• EOS Land Viewer by Earth Observing System
• Sentinel Hub WMS/WMTS/WCS Service for MODIS by Sinergise
• Sentinel Playground for MODIS by Sinergise

NREL Wind Integration National Dataset on AWS

Tools & Applications

• HSDS Examples by Caleb Phillips, Caroline Draxl, John Readey, Jordan Perr-Sauer
• Wind Visualization by Jordan Perr-Sauer

Publications

• Power from wind: Open data on AWS by Caleb Phillips, Caroline Draxl, John Readey, Jordan Perr-Sauer

OpenAQ

Tutorials

• Access OpenAQ data via a filterable SNS topic by OpenAQ
• Using Athena to access the whole archive by OpenAQ

Tools & Applications

• ARISense by Aerodyne Research, Inc.
• hackAIR by hackAir
• ropenaq R package by Maëlle Salmon
• Smokey: Air Quality Bot by Amrit Sharma

SILO climate data on AWS

Tools & Applications

• Convert NetCDF to ESRI ArcASCII or GeoTIFF by SILO
• NetCDF Operators to calculate seasonal means by SILO
• Python script to calculate a regional mean by SILO

Southern California Earthquake Data

Tutorials

• Cactus to Clouds: Processing The SCEDC Open Data Set on AWS by Tim Clements
• Getting Started with SCEDC AWS Public Dataset by Ellen Yu
• Using Lambda to Process Seismograms by Shang-Lin Chen

USGS 3DEP LiDAR Point Clouds

Tutorials

• Using Lambda Layers with USGS 3DEP LiDAR Point Clouds by Howard Butler
• WebGL Visualization of USGS 3DEP Lidar Point Clouds with Potree and Plasio.js by Connor Manning

Publications

• USGS 3DEP Lidar Point Cloud Now Available as Amazon Public Dataset by Department of the Interior, U.S. Geological Survey

Africa Soil Information Service (AfSIS) Soil Chemistry

Tutorials

• AfSIS Soil Chemistry - Usage Tutorial by QED

Publications

• Goalkeepers 2018, Soil - The Big Data Beneath Your Feet by QED

Amazon Bin Image Dataset

Publications

• Amazon Bin Image Dataset Challenge by silverbottlep
• Amazon Inventory Reconciliation using AI by Pablo Rodriguez Bertorello, Sravan Sripada, Nutchapol Dendumrongsup

Atmospheric Models from Météo-France

Tools & Applications

• Windguru.cz by Windguru
• Windy.com by Windy

ECMWF ERA5 Reanalysis

Tutorials

• Accessing ERA5 Data on S3 Using Boto by Intertrust Technologies Corporation
• ERA5 tutorial using the Planet OS API by Intertrust Technologies Corporation

GOES on AWS

Tutorials

• Visualize GOES-16 in Python using Xarray by Hamed Alemohammad

Publications

• Billions of Birds Migrate. Where Do They Go? by National Geographic

Hubble Space Telescope Public Data

Tutorials

• Exploring AWS Lambda with cloud-hosted Hubble public data by Arfon Smith

Publications

• Making HST Public Data Available on AWS by Arfon Smith

NAIP on AWS

Tools & Applications

• EOS Land Viewer by Earth Observing System
• VoyagerSearch showing off Batch + NAIP by Voyager

NASA NEX

Tutorials

• Accessing and plotting NASA-NEX data, from GEOSChem-on-cloud tutorial. by Jiawei Zhuang

Tools & Applications

• Azavea Climate API by Azavea

NREL National Solar Radiation Database on AWS

Tools & Applications

• NSRDB Viewer by Manajit Sengupta, Yu Xe, Anthony Lopez, Aron Habte, Galen Maclaurin, James Shelby, Paul Edwards

Publications

• The National Solar Radiation Data Base (NSRDB) by Manajit Sengupta, Yu Xe, Anthony Lopez, Aron Habte, Galen Maclaurin, James Shelby

Open City Model (OCM)

Tutorials

• Running queries on Open City Model using AWS Athena by Allen Gilliland
• Using Open City Model with the 3dCityDB by Allen Gilliland

OpenEEW

Tutorials

• Analyzing a magnitude 7.2 earthquake in Mexico using Python by Grillo

Tools & Applications

• OpenEEW library for Python by Grillo

Rapid7 FDNS ANY Dataset

Tutorials

• Creating a Project Sonar FDNS API with AWS by Evan Perotti at SecurityRiskAdvisors
• How to Conduct DNS Reconnaissance for $.02 Using Rapid7 Open Data and AWS by Shan Sikdar at Rapid7

Terra Fusion Data Sampler

Tutorials

• Basic Terra fusion product algorithm theoretical basis and data specifications by Zhao, Guangu; Yang, Muqun; Clipp, Landon; Gao, Yizhao; Lee, Joe H.

Tools & Applications

• TerraFusion GitHub by University of Illinois

UK Met Office Atmospheric Deterministic and Probabilistic Forecasts

Tutorials

• Met Office AWS Earth data - Getting Started by Jacob Tomlinson
• Met Office AWS Earth data - Subscribing to data by Jacob Tomlinson

1000 Genomes

Publications

• Exploratory data analysis of genomic datasets using ADAM and Mango with Apache Spark on Amazon EMR by Alyssa Marrow

AWS iGenomes

Tools & Applications

• nf-core analysis pipelines by Phil Ewels

Allen Brain Observatory - Visual Coding AWS Public Data Set

Tutorials

• Use the Allen Brain Observatory – Visual Coding on AWS by Nika Keller, David Feng

Broad Genome References

Tools & Applications

• Genomics Workflows on AWS - Cromwell on AWS by W. Lee Pang

Cell Painting Image Collection

Publications

• Example submission for the 2018 CytoData Hackathon (in R and Python) by Juan Caicedo, Tim Becker

Cornell EAS Data Lake

Tutorials

• Cornell EAS Data Lake Setup Tutorial by Marty Sullivan

GATK Test Data

Tools & Applications

• Genomics Workflows on AWS - Cromwell on AWS by W. Lee Pang

LOFAR ELAIS-N1 cycle 2 observations on AWS

Publications

• Calibration of LOFAR ELAIS-N1 data in the Amazon cloud by J. Sabater

NOAA Global Historical Climatology Network Daily (GHCN-D)

Tutorials

• Visualize over 200 years of global climate data using Amazon Athena and Amazon QuickSight by Conor Delaney

QIIME 2 User Tutorial Datasets

Tutorials

• Installing QIIME 2 using Amazon Web Services by The QIIME 2 Development Team

SILAM Air Quality

Tutorials

• Simple examples by Roope Tervo

Safecast

Tools & Applications

• Safecast Map by Nick Dolezal

Sentinel-1 SLC dataset for South and Southeast Asia, Taiwan, and Japan

Tutorials

• Sentinel-1 Opendataset Wiki and Tutorials by Earth Observatory of Singapore

TCGA on AWS

Tutorials

• Building High-Throughput Genomics Batch Workflows on AWS by Aaron Friedman

Transiting Exoplanet Survey Satellite (TESS)

Publications

• TESS data available on AWS by Arfon Smith

U.S. Census ACS PUMS

Tutorials

• Setting up Blazegraph on EC2 by data.world

Unidata NOAA Global Forecast System (GFS) Model

Tools & Applications

• PODPAC: Python Library supporting GFS for analysis by Creare

Voices Obscured in Complex Environmental Settings (VOiCES)

Tutorials

• Getting started with VOiCES data by M.A. Barrios

Xiph.Org Test Media

Tutorials

• Encoding video with AV1 on EC2 by Thomas Daede

Yale-CMU-Berkeley (YCB) Object and Model Set

Publications

• Benchmarking in Manipulation Research: Using the Yale-CMU-Berkeley Object and Model Set by Berk Calli, Aaron Walsman, Arjun Singh, Siddhartha Srinivasa, Pieter Abbeel, Aaron M Dollar
• Label Fusion: A Pipeline for Generating Ground Truth Labels for Real RGBD Data of Cluttered Scenes by Pat Marion, Peter R. Florence, Lucas Manuelli, Russ Tedrake
• Pre-touch sensing for sequential manipulation by Boling Yang, Patrick Lancaster, Joshua R. Smith
• The Closure Signature: A Functional Approach to Model Underactuated Compliant Robotic Hands by Maria Pozzi, Gionata Salvietti, João Bimbo, Monica Malvezzi, Domenico Prattichizzo

ZINC Database

Publications

• ZINC Database by John Irwin

MIMIC-III (‘Medical Information Mart for Intensive Care’)

Tutorials

• Perform biomedical informatics without a database using MIMIC-III data and Amazon Athena by James Wiggins, Alistair Johnson

Tools & Applications

• MIMIC-code GitHub repository by Alistair Johnson

MODIS MYD13A1, MOD13A1, MYD11A1, MOD11A1, MCD43A4

Tools & Applications

• Astraea Earth OnDemand by Astraea, Inc.

Swiss Public Transport Stops

Tools & Applications

• Map Viewer by Swiss Geoportal