Computer Science Department
School of Computer Science, Carnegie Mellon University


Painting with CaTS: Camera-aided Texture Synthesis

Ticha Sethapakdi

M.S. Thesis

May 2018


Keywords: Texture Synthesis, Creativity Support, Human-Computer Interaction, Interfaces, Digital Painting

Digital painting is a popular approach to creating visual art. Much like in traditional media, digital painting programs equip artists with a multitude of tools and brushes so they can produce diverse paintings. It is often the case that artists want to make their own assets and textures to produce speci c results. Unfortunately, creating custom assets can be cumbersome and time-consuming as artists often need to go through the process of scanning, importing, and adjusting before they can use their own textures for painting.

We present CaTS, a painting system that synthesizes textures from live video in real-time. The system interfaces with a simple capture rig which facilitates bimanual manipulation, allowing users to manipulate the exemplar object with one hand while painting with the other. Through the close integration of the capture device and painting method, CaTS builds upon the concept of texture synthesis-based painting and augments it with more artistic freedom. This allows digital artists to easily create custom brushes which they can use to produce texture-rich paintings. Furthermore, CaTS fosters an exploratory approach to painting that is not easily achievable through purely digital or traditional means. We demonstrate the expressiveness of our system through paintings produced by artists with varying artistic styles and evaluate its e ectiveness through user feedback.

Thesis Committee:
James McCann (Chair)
Nancy Pollard
Jessica Hodgins

Srinvasan Seshan, Head, Computer Science Department
Andrew W. Moore, Dean, School of Computer Science

56 pages

Return to: SCS Technical Report Collection
School of Computer Science

This page maintained by