Rapsai: Rapid Application Prototyping System for AI

The project Rapsai aims to make the prototyping of machine learning (ML) based multimedia applications more efficient and accessible. The researchers conducted a formative study with ML practitioners to gather insights on common challenges in the field, which informed the development of Rapsai. Rapsai is a visual programming platform that allows for rapid and iterative development of end-to-end ML-based multimedia applications, through a node-graph editor that facilitates interactive characterization and visualization of ML model performance. It streamlines the prototyping process with interactive data augmentation and model comparison capabilities, in a no-coding environment. The evaluation of Rapsai in four real-world case studies suggests that it accelerates workflow, makes informed decisions, and allows for the holistic evaluation of model behavior with real-world input.

Publications

teaser image of Rapsai: Accelerating Machine Learning Prototyping of Multimedia Applications Through Visual Programming

Rapsai: Accelerating Machine Learning Prototyping of Multimedia Applications Through Visual Programming

Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI), 2023.
Keywords: visual programming, node-graph editor, deep neural networks, data augmentation, deep learning, model comparison, visual analytics




Videos

Talks

Cited By

Stay In Touch