Construct · 1 fields · 1 citations

vision transformer: a standalone construct

One name. One construct. A landmark on the map.

● anchor · a standalone construct Nearest construct by meaning·not indexed

A single standalone construct; nearby constructs are located against it in the Collider. Tap a field for its definition, unit, and measures.

Machine learning

applying a standard transformer directly to an image split into a sequence of fixed-size patches, matching convolutional networks when pretrained at scale.

In machine learning, vision transformer refers to applying a standard transformer directly to an image split into a sequence of fixed-size patches, matching convolutional networks when pretrained at scale. This meaning comes from Dosovitskiy (2020) in arXiv.[1]

Unit
Recovery means
Measured by

Run it through the Collider, or take the citations with you.

See how vision transformer sits against neighbouring constructs in the Collider, or export every reference on this page in one click.

Open in Collider Export BibTeX Report this entry

Nearby constructs

image4 fields · 5 citationsjingle · one word, four constructs learning6 fields · 14 citationsjingle · one name, six constructs matching4 fields · 4 citationsjingle · one word, four constructs

References

Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., & Houlsby, N. (2020). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv. https://doi.org/10.48550/arxiv.2010.11929

Cited on this page?

Confirm your construct, or correct us.

If your work is cited behind one of these entries, you know better than we do whether we captured the meaning right. Confirm it, suggest an edit, or dispute it, and your name goes on the entry as an author who has checked it, linked to your ORCID.

Claim your construct