Notate: Bridging Handwriting with Computer Code

Handwriting converted to computer code

Cornell University researchers created an interface allowing users to sketch and handwrite within computer code, a challenge for conventional coding which relies on typing.

Notate is a pen-based interface that allows users to open drawing canvases in their digital notebooks and write diagrams inside lines of traditional computer code.

The interface is powered by a deep-learning model that bridges the gap between handwritten and textual contexts. Notation in a handwritten diagram may refer to textual code, and vice versa. Notate, for example, recognizes handwritten symbols like \”n\” and links them to their typewritten counterparts.