The Canonical Representation of a Task
This paper proposes that generalization occurs when learned representations align with a canonical representation determined by the task itself, and tests this theory on grokking in modular arithmetic.
This paper proposes that generalization occurs when learned representations align with a canonical representation determined by the task itself, and tests this theory on grokking in modular arithmetic.