Construct · 1 fields · 2 citations

audit: a standalone construct

One name. One construct. A landmark on the map.

● anchor · a standalone construct Nearest construct by meaningintegritycompare the meanings
How to read this

Every construct on the map is compared with every other by the meaning of its definitions, and the closest one is surfaced here. The nearest construct to audit is integrity.

Hold this as a prompt, not a verdict. Two constructs sitting close in meaning is a reason to read them side by side and decide for yourself whether they are one idea under two names. It is not proof that they are. Compare the meanings in the Collider.

audit1 CONSTRUCTAlgorithm auditSANDVIG · ALGORITHM AUDIT

A single standalone construct; nearby constructs are located against it in the Collider. Tap a field for its definition, unit, and measures.

Computer science

Empirical testing of a system for bias or discrimination

The empirical testing of an algorithmic system to reveal whether its outputs differ unfairly across groups such as race or gender: investigators feed controlled inputs to a deployed system, observe its decisions, and check for discrimination or other harm the operator did not disclose. Sandvig, Hamilton, Karahalios, and Langbort's 2014 Auditing algorithms adapted the social-science audit study, in which matched testers probe for bias, to online platforms and named several research designs for doing so. Raji and Buolamwini's 2019 Actionable auditing showed that publicly reporting such results changed the products that vendors shipped. Here the referent is an external test of a running computer system, not an opinion on financial records or a review of clinical care.[1][2]

Unit
One study probing a system's outputs across controlled or matched inputs for disparate outcomes
Recovery means
Not applicable
Measured by
Outputs are compared across groups or matched inputs with statistical tests of disparity, often via scraping, sock-puppet accounts, or code review

Next

Run it through the Collider, or take the citations with you.

See how audit sits against neighbouring constructs in the Collider, or export every reference on this page in one click.

Open in ColliderExport BibTeXReport this entry

Nearby constructs

bias6 fields · 8 citationsjingle · one name, six constructsfairness4 fields · 4 citationsjingle · one word, four constructsattestation2 fields · 2 citationsjingle · one word, two constructs

References

  1. Sandvig, C., Hamilton, K., Karahalios, K., & Langbort, C. (2014). Auditing algorithms: Research methods for detecting discrimination on internet platforms. Paper presented at Data and Discrimination: Converting Critical Concerns into Productive Inquiry, a preconference of the 64th Annual Meeting of the International Communication Association, Seattle, WA.
  2. Raji, I. D., & Buolamwini, J. (2019). Actionable auditing: Investigating the impact of publicly naming biased performance results of commercial AI products. Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society, 429–435. https://doi.org/10.1145/3306618.3314244

Cited on this page?

Confirm your construct, or correct us.

If your work is cited behind one of these entries, you know better than we do whether we captured the meaning right. Confirm it, suggest an edit, or dispute it, and your name goes on the entry as an author who has checked it, linked to your ORCID.

Claim your construct