Construct · 1 fields · 1 citations

edge of stability: a standalone construct

One name. One construct. A landmark on the map.

● anchor · a standalone construct Nearest construct by meaning·not indexed

A single standalone construct; nearby constructs are located against it in the Collider. Tap a field for its definition, unit, and measures.

Machine learning

during full-batch gradient descent the sharpness of the loss rises until it hovers near two divided by the step size, while loss keeps falling non-monotonically.

In machine learning, edge of stability refers to during full-batch gradient descent the sharpness of the loss rises until it hovers near two divided by the step size, while loss keeps falling non-monotonically. This meaning comes from Cohen (2021) in arXiv.[1]

Unit
Recovery means
Measured by

Run it through the Collider, or take the citations with you.

See how edge of stability sits against neighbouring constructs in the Collider, or export every reference on this page in one click.

Open in Collider Export BibTeX Report this entry

Nearby constructs

descent3 fields · 4 citationsjingle · one word, three constructs edge5 fields · 5 citationsjingle · one word, five constructs gradient descent1 fields · 4 citationsanchor · a standalone construct

References

Cohen, J. M., Kaur, S., Li, Y., Kolter, J. Z., & Talwalkar, A. (2021). Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability. arXiv. https://doi.org/10.48550/arxiv.2103.00065

Cited on this page?

Confirm your construct, or correct us.

If your work is cited behind one of these entries, you know better than we do whether we captured the meaning right. Confirm it, suggest an edit, or dispute it, and your name goes on the entry as an author who has checked it, linked to your ORCID.

Claim your construct