Motio is a visual explorer for the internal movements of a language model. It groups the model's internal representations into clusters and lays them out on a grid. Pick cells and draw a path. The right hand side shows you every example in which the model followed that same path. Zoom down for finer categories, chain cells to find patterns, and let the shades guide you toward the most common continuations.
For technical details, please check the accompanying article.
Did you find any interesting pattern? Email me at [email protected].
