Transformer-DeID: Deidentification of free-text clinical notes with transformers

health life sciences medicine

Description

Sharing patient data such as clinical notes among clinicians and researchers is fundamental to advancements in clinical practice and biomedical research. Prior to distribution, it is often necessary and legally mandated to remove identifiers such as names, contact details, identification numbers, and dates to safeguard patient privacy. This process is known as deidentification. Here we provide a neural network model for the removal of patient identifiers from clinical text based upon Bidirectional Encoder Representations from Transformers (BERT) and two variations of BERT, namely Robustly Optimized BERT Approach (RoBERTa) and Distilled BERT (DistilBERT). The models demonstrated excellent performance on a publicly available benchmark and are made freely available to maximize reuse.

Update Frequency

Not updated

License

MIT License

Documentation

https://doi.org/10.13026/7dj5-7x85

Managed By

PhysioNet

See all datasets managed by PhysioNet.

Contact

https://physionet.org/about/#contact_us

How to Cite

Transformer-DeID: Deidentification of free-text clinical notes with transformers was accessed on DATE from https://registry.opendata.aws/transformer-deid.

Resources on AWS

  • Description
    https://doi.org/10.13026/7dj5-7x85
    Resource type
    S3 Bucket
    Amazon Resource Name (ARN)
    arn:aws:s3:::physionet-open/transformer-deid/
    AWS Region
    us-east-1
    AWS CLI Access (No AWS account required)
    aws s3 ls --no-sign-request s3://physionet-open/transformer-deid/

Edit this dataset entry on GitHub

Tell us about your project

Home