Handwriting converted to computer code
Cornell University researchers created an interface allowing users to sketch and handwrite within computer code, a challenge for conventional coding which relies on typing.
Notate is a pen-based interface that allows users to open drawing canvases in their digital notebooks and write diagrams inside lines of traditional computer code.
The interface is powered by a deep-learning model that bridges the gap between handwritten and textual contexts. Notation in a handwritten diagram may refer to textual code, and vice versa. Notate, for example, recognizes handwritten symbols like \”n\” and links them to their typewritten counterparts.