Manufacturer University of Konstanz Type Articulated robot | Year of creation 2009 Purpose Paint | |
Website www.informatik.uni-konstanz.de/en/edavid/ | ||
eDavid is a painting robot developed at the Universität Konstanz (University of Konstanz) that calculates brushstrokes from an input image and paints the image on a canvas. The project began in 2009 as a one-armed welding robot modified to be able to paint. The robot’s arm can interchange between different brushes and pens, and is equipped with a distance sensor to measure exactly how far the arm is from the canvas. eDavid features two main painting methods: predefined stroke candidates and dynamically generated strokes.
Contents
Development
eDavid was developed by Prof. Dr. Oliver Deussen, Thomas Lindemeier, Mark Tautzenberger, and Dr. Sören Pirk of the Department of Computer and Information Science. The goal for the project was to build a robot that mimics the manual painting process: painting in iterations until the desired image is achieved. This differs from earlier painting robots because instead of computing the perfect set of strokes and painting once, the robot paints in iterative steps, moving the optimization process from the computer to the canvas. eDavid implements features from earlier works, including AARON, a robot developed by Harold Cohens to paint abstract art. However unlike AARON, eDavid focuses on representing an input image accurately rather than generating abstract art.
Painting Process
eDavid takes in an input photograph and generates a set of brushstrokes which vary in length and width. The algorithm implements a visual feedback loop. The loop follows these steps:
This process mimics the human painting process, just as a painter would lighten and darken a painting to satisfaction rather than paint a perfect painting in one attempt.
Stroke Generation Methods
eDavid utilizes two different stroke generation methods: Predefined strokes, and Dynamically generated strokes.
Predefined strokes
This method chooses the new strokes from a set of 3 different lengths, 3 different widths, and 60 different directions, resulting in 540 different possible strokes. At each location in the image all of the 540 possible stroke candidates are “tried-out”, and eDavid chooses the stroke that matches the image at that point with the highest quality. During each iteration of the feedback loop, eDavid paints 300 predefined strokes. The resulting brushstrokes are short in comparison to dynamically generated strokes.
Dynamically generated strokes
This method uses the image gradient to create longer brushstroke paths rather than many shorter strokes which are used in the predefined strokes method. The image gradient is how the color or intensity of an image is changing at any particular location. For example, if at a particular pixel in an image, the image is transitioning between a lighter color to a darker color, the gradient at that location will indicate which way the image is brightening/darkening and how fast it is brightening/darkening. eDavid generates a collection of brushstrokes perpendicular to the gradient’s direction, resulting in lines along paths of similar color intensity.
eDavid takes all of these dynamically generated strokes, and chooses the paths that do not overlap. The chosen brushstrokes, usually longer and smoother than predefined strokes, result in dark and expressive paintings.
Comparison of styles
Predefined strokes result in very clean paintings, however the shorter preset brushstrokes seem more robotic than paintings created by dynamically generated strokes. One way to improve upon this painting style is to include longer and more varied brushstrokes, but this could slow down the process due to the larger number of predefined brushstrokes to "try out" choose from.
In dynamically generated strokes, areas of the painting with high detail are often too dark. However, dynamically generated strokes look more complex and artistic than predefined strokes due to the unique brushstrokes. One way to improve upon the dynamically generated strokes is to prevent the creation of dark spots by filtering fine lines in high detail areas.