The Registry of Open Data on AWS is now available on AWS Data Exchange
All datasets on the Registry of Open Data are now discoverable on AWS Data Exchange alongside 3,000+ existing data products from category-leading data providers across industries. Explore the catalog to find open, free, and commercial data sets. Learn more about AWS Data Exchange

WikiSum: Coherent Summarization Dataset for Efficient Human-Evaluation

amazon.science machine learning natural language processing

Description

This dataset provides how-to articles from wikihow.com and their summaries, written as a coherent paragraph. The dataset itself is available at wikisum.zip, and contains the article, the summary, the wikihow url, and an official fold (train, val, or test). In addition, human evaluation results are available at wikisum-human-eval.zip. It consists of human evaluation of the summary of the Pegasus system, annotators response regarding the difficulty of the task, and words they marked as unknown.

Update Frequency

Not currently being updated

License

Dataset is published under CC-NC-SA-3.0. Human evaluation is published under CC-SA-4.0.

Documentation

https://wikisum.s3.amazonaws.com/README.txt

Managed By

See all datasets managed by Amazon.

Contact

nachshon@amazon.com, orenk@amazon.com

How to Cite

WikiSum: Coherent Summarization Dataset for Efficient Human-Evaluation was accessed on DATE from https://registry.opendata.aws/wikisum.

Usage Examples

Publications

Resources on AWS

  • Description
    WikiSum Dataset
    Resource type
    S3 Bucket
    Amazon Resource Name (ARN)
    arn:aws:s3:::wikisum
    AWS Region
    us-east-1
    AWS CLI Access (No AWS account required)
    aws s3 ls --no-sign-request s3://wikisum/
    Explore
    wikisum.zip
    wikisum-human-eval.zip

Edit this dataset entry on GitHub

Tell us about your project

Home