WikiSum: Coherent Summarization Dataset for Efficient Human-Evaluation

amazon.science machine learning natural language processing

Description

This dataset provides how-to articles from wikihow.com and their summaries, written as a coherent paragraph. The dataset itself is available at wikisum.zip, and contains the article, the summary, the wikihow url, and an official fold (train, val, or test). In addition, human evaluation results are available at wikisum-human-eval.zip. It consists of human evaluation of the summary of the Pegasus system, annotators response regarding the difficulty of the task, and words they marked as unknown.

Update Frequency

Not currently being updated

License

Dataset is published under CC-NC-SA-3.0. Human evaluation is published under CC-SA-4.0.

Documentation

https://wikisum.s3.amazonaws.com/README.txt

Managed By

See all datasets managed by Amazon.

Contact

nachshon@amazon.com, orenk@amazon.com

Usage Examples

Publications

Resources on AWS

  • Description
    WikiSum Dataset
    Resource type
    S3 Bucket
    Amazon Resource Name (ARN)
    arn:aws:s3:::wikisum
    AWS Region
    us-east-1
    AWS CLI Access (No AWS account required)
    aws s3 ls s3://wikisum/ --no-sign-request
    Explore
    wikisum.zip
    wikisum-human-eval.zip

Edit this dataset entry on GitHub

Home