Construct · 1 fields · 1 citations

data contamination: a standalone construct

One name. One construct. A landmark on the map.

● anchor · a standalone construct Nearest construct by meaning·not indexed
datacontamination1 CONSTRUCTData contaminationMAGAR · NATURAL LANGUAGE

A single standalone construct; nearby constructs are located against it in the Collider. Tap a field for its definition, unit, and measures.

Natural language processing

test examples from an evaluation benchmark appear in a model's pretraining data, which can inflate measured performance.

In natural language processing, data contamination refers to test examples from an evaluation benchmark appear in a model's pretraining data, which can inflate measured performance. This meaning comes from Magar (2022) in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers).[1]

Unit
Recovery means
Measured by

Next

Run it through the Collider, or take the citations with you.

See how data contamination sits against neighbouring constructs in the Collider, or export every reference on this page in one click.

Open in ColliderExport BibTeXReport this entry

Nearby constructs

association4 fields · 4 citationsjingle · one word, four constructscontamination3 fields · 5 citationsjingle · one word, three constructsmodel3 fields · 3 citationsjingle · one word, three constructs

References

  1. Magar, I., & Schwartz, R. (2022). Data Contamination: From Memorization to Exploitation. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). https://doi.org/10.18653/v1/2022.acl-short.18

Cited on this page?

Confirm your construct, or correct us.

If your work is cited behind one of these entries, you know better than we do whether we captured the meaning right. Confirm it, suggest an edit, or dispute it, and your name goes on the entry as an author who has checked it, linked to your ORCID.

Claim your construct