The MIT Supercloud Dataset

Description

Collection of parsed datacenter logs and time series data of hardware utilization from the MIT Supercloud system.

Update Frequency

Data will be updated annually

License

http://creativecommons.org/licenses/by-nc-nd/4.0/

Documentation

https://github.com/MIT-AI-Accelerator/datacenter-challenge

Managed By

Siddharth Samsi

See all datasets managed by Siddharth Samsi.

Contact

mit-dcc@mit.edu

How to Cite

The MIT Supercloud Dataset was accessed on DATE from https://registry.opendata.aws/dcc. Samsi, Siddharth, Weiss, Matthew, Bestor, David, et al. "The MIT Supercloud Dataset." 2021 IEEE High Performance Extreme Computing Conference (HPEC). IEEE, 2021.

Usage Examples

Tutorials

• Generating the labelled dataset by Matthew Weiss
  
  
• Introduction to the MIT Supercloud Dataset by Matthew Weiss
  
  

Tools & Applications

• The MIT Supercloud Workload Classification Challenge by Benny J. Tang, Qiqi Chen, Matthew L. Weiss, et. al.
  

Publications

• AI-Enabling Workloads on Large-Scale GPU-Accelerated System: Characterization, Opportunities, and Implications by Baolin Li, Rohin Arora, Siddharth Samsi, et. al.
  
• The MIT Supercloud Dataset by Siddharth Samsi, Matthew Weiss, David Bestor, et. al.
  
• The MIT Supercloud Workload Classification Challenge by Benny J. Tang, Qiqi Chen, Matthew L. Weiss, et. al.