New programming tool turns sketches, handwriting into code

40


Credit: The thirty fifth Annual ACM Symposium on Person Interface Software program and Expertise (2022). DOI: 10.1145/3526113.3545619

Cornell University researchers have created an interface that enables customers to handwrite and sketch inside pc code—a problem to traditional coding, which usually depends on typing.

The pen-based interface, referred to as Notate, lets customers of computational, digital notebooks open drawing canvases and handwrite diagrams inside traces of conventional, digitized computer code.

Powered by a deep learning model, the interface bridges handwritten and textual programming contexts: notation within the handwritten diagram can reference textual code and vice versa. As an example, Notate acknowledges handwritten programming symbols, like “n”, after which hyperlinks them as much as their typewritten equivalents.

“A system like this would be great for data science, specifically with sketching plots and charts that then inter-operate with textual code,” mentioned Ian Arawjo, lead writer of the paper and doctoral pupil within the area of knowledge science.

“Our work shows that the current infrastructure of programming is actually holding us back. People are ready for this type of feature, but developers of interfaces for typing code need to take note of this and support images and graphical interfaces inside code.”

Credit: The thirty fifth Annual ACM Symposium on Person Interface Software program and Expertise (2022). DOI: 10.1145/3526113.3545619

Arawjo additionally mentioned the work demonstrates a brand new path ahead by introducing synthetic intelligence-powered, pen-based coding at a time when drawing tablets have gotten extra broadly used.

“Tools like Notate are important because they open us up to new ways to think about what programming is, and how different tools and representational practices can change that perspective,” mentioned Tapan Parikh, affiliate professor of knowledge science and paper co-author.

Data on the software was revealed within the proceedings of The thirty fifth Annual ACM Symposium on Person Interface Software program and Expertise.

Extra info:
Ian Arawjo et al, Notational Programming for Pocket book Environments: A Case Research with Quantum Circuits, The thirty fifth Annual ACM Symposium on Person Interface Software program and Expertise (2022). DOI: 10.1145/3526113.3545619

Supplied by
Cornell University

Quotation:
New programming software turns sketches, handwriting into code (2022, November 28)
retrieved 28 November 2022
from https://techxplore.com/information/2022-11-tool-code.html

This doc is topic to copyright. Other than any truthful dealing for the aim of personal examine or analysis, no
half could also be reproduced with out the written permission. The content material is offered for info functions solely.



Click Here To Join Our Telegram Channel



Source link

If in case you have any considerations or complaints concerning this text, please tell us and the article will likely be eliminated quickly. 

Raise A Concern