Search Results

Now showing 1 - 10 of 13
  • Item
    Depth-aware Neural Style Transfer
    (Association for Computing Machinery, Inc (ACM), 2017) Liu, Xiao-Chang; Cheng, Ming-Ming; Lai, Yu-Kun; Rosin, Paul L.; Holger Winnemoeller and Lyn Bartram
    Neural style transfer has recently received signi cant a ention and demonstrated amazing results. An e cient solution proposed by Johnson et al. trains feed-forward convolutional neural networks by de ning and optimizing perceptual loss functions. Such methods are typically based on high-level features extracted from pre-trained neural networks, where the loss functions contain two components: style loss and content loss. However, such pre-trained networks are originally designed for object recognition, and hence the high-level features o en focus on the primary target and neglect other details. As a result, when input images contain multiple objects potentially at di erent depths, the resulting images are o en unsatisfactory because image layout is destroyed and the boundary between the foreground and background as well as di erent objects becomes obscured. We observe that the depth map e ectively re ects the spatial distribution in an image and preserving the depth map of the content image a er stylization helps produce an image that preserves its semantic content. In this paper, we introduce a novel approach for neural style transfer that integrates depth preservation as additional loss, preserving overall image layout while performing style transfer.
  • Item
    Real-Time Panorama Maps
    (Association for Computing Machinery, Inc (ACM), 2017) Brown, S. Alex; Samavati, Faramarz; Holger Winnemoeller and Lyn Bartram
    Panorama maps are stylized paintings of terrain often seen at tourist destinations. They are difficult to create since they are both artistic and grounded in real geographic data. In this paper we present techniques for rendering real-world data in the style of Heinrich Berann's panorama maps in a real-time application. We analyse several of Berann's paintings to identify the artistic elements used. We use this analysis to form algorithms that mimic the panorama map style, focusing on replicating the terrain deformation, distorted projection, terrain colouring, tree brush strokes, water rendering, and atmospheric scattering. In our approach we use freely available digital earth data to render interactive panorama maps without needing further design work.
  • Item
    Mixed Illumination Analysis in Single Image for Interactive Color Grading
    (Association for Computing Machinery, Inc (ACM), 2017) Duchêne, Sylvain; Aliaga, Carlos; Pouli, Tania; Pérez, Patrick; Holger Winnemoeller and Lyn Bartram
    Colorists often use keying or rotoscoping tools to access and edit particular colors or parts of the scene. Although necessary, this is a time-consuming and potentially imprecise process, as it is not possible to fully separate the influence of light sources in the scene from the colors of objects and actors within it. To simplify this process, we present a new solution for automatically estimating the color and influence of multiple illuminants, based on image variation analysis. Using this information, we present a new color grading tool for simply and interactively editing the colors of de- tected illuminants, which fits naturally in color grading workflows. We demonstrate the use of our solution in several scenes, evaluating the quality of our results by means of a psychophysical study.
  • Item
    Modeling Go: A mobile sketch-based modeling system for extracting objects
    (Association for Computing Machinery, Inc (ACM), 2017) Lai, Chun-An; Chiang, Pei-Ying; Holger Winnemoeller and Lyn Bartram
    This article presents an easy to use mobile application which allows users to create 3D digital copies of their interested objects anywhere and anytime. An advanced 3-sweep modeling technique is developed to construct 3D primitives not only from generalized cylinder and cuboid, but also objects with symmetrical or non-uniformly scaled profiles. In addition, our system supports the texture and structure refinement which combine results created from multiple source images. The constructed 3D model will be the combination of our 3D primitives. The combined result can preserve more features which may not be seen from a single photo.
  • Item
    Neural Style Transfer: A Paradigm Shift for Image-based Artistic Rendering?
    (Association for Computing Machinery, Inc (ACM), 2017) Semmo, Amir; Isenberg, Tobias; Döllner, Jürgen; Holger Winnemoeller and Lyn Bartram
    In this meta paper we discussimage-based artistic rendering (IB-AR)based onneural style transfer(NST) and argue, while NST may represent a paradigm shift for IB-AR, that it also has to evolve as an interactive tool that considers the design aspects and mecha- nisms of artwork production. IB-AR received signifficant attention in the past decades for visual communication, covering a plethora of techniques to mimic the appeal of artistic media. Example-based renderingrepresents one the most promising paradigms in IB-AR to (semi-)automatically simulate artistic media with high fidelity, but so far has been limited because it relies on pre-defined image pairs for training or informs only low-level image features for texture transfers. Advancements in deep learning showed to alleviate these limitations by matching content and style statistics via activations of neural network layers, thus making a generalized style trans- fer practicable. We categorize style transfers within the taxonomy of IB-AR, then propose a semiotic structure to derive a technical research agenda for NSTs with respect to the grand challenges of NPAR. We finally discuss the potentials of NSTs, thereby identifying applications such as casual creativity and art production.
  • Item
    Sketch and Shade : An interactive assistant for sketching and shading
    (Association for Computing Machinery, Inc (ACM), 2017) Parakkat, Amal Dev; Joshi, Sarang Anil; Pundarikaksha, Uday Bondi; Muthuganapathy, Ramanathan; Holger Winnemoeller and Lyn Bartram
    We present a drawing assistant for sketching and for assisting users in shading a hand drawn sketch. The augmented reality based system uses a sketch made by a professional and uses it to help inexperienced users to do sketching and shading. The input image is converted to a set of points based on simple heuristics for providing a “connect the dots'' interface for a user to aid sketching. With the help of a 2.5D mesh generated by our algorithm, the system assists the user by providing information about the colors that can be given in different parts of the sketch. The system was tested with users of different age groups and skill levels, indicating its usefulness.
  • Item
    Whole-Cloth Quilting Patterns from Photographs
    (Association for Computing Machinery, Inc (ACM), 2017) Liu, Chenxi; Hodgins, Jessica; McCann, James; Holger Winnemoeller and Lyn Bartram
    Whole-cloth quilts are decorative and functional artifacts made of plain cloth embellished with complicated stitching patterns. We describe a method that can automatically create a sewing pattern for a whole-cloth quilt from a photograph. Our technique begins with a segmented image, extracts desired and optional edges, and creates a continuous sewing path by approximately solving the Rural Postman Problem (RPP). In addition to many example quilts, we provide visual and numerical comparisons to previous single- line illustration approaches.
  • Item
    Quantifying Visual Abstraction ality for Stipple Drawings
    (Association for Computing Machinery, Inc (ACM), 2017) Spicker, Marc; Hahn, Franz; Lindemeier, Thomas; Saupe, Dietmar; Deussen, Oliver; Holger Winnemoeller and Lyn Bartram
    We investigate how the perceived abstraction quality of stipple illustrations is related to the number of points used to create them. Since it is di cult to nd objective functions that quantify the visual quality of such illustrations, we gather comparative data by a crowdsourcing user study and employ a paired comparison model to deduce absolute quality values. Based on this study we show that it is possible to predict the perceived quality of stippled representations based on the properties of an input image. Our results are related to Weber-Fechner's law from psychophysics and indicate a logarithmic relation between numbers of points and perceived abstraction quality. We give guidance for the number of stipple points that is typically enough to represent an input image well.
  • Item
    Benchmarking Non-Photorealistic Rendering of Portraits
    (Association for Computing Machinery, Inc (ACM), 2017) Rosin, Paul L.; Mould, David; Berger, Itamar; Collomosse, John; Lai, Yu-Kun; Li, Chuan; Li, Hua; Shamir, Ariel; Wand, Michael; Wang, Tinghuai; Winnem, Holger; Holger Winnemoeller and Lyn Bartram
    We present a set of images for helping NPR practitioners evaluate their image-based portrait stylisation algorithms. Using a standard set both facilitates comparisons with other methods and helps ensure that presented results are representative. We give two levels of di culty, each consisting of 20 images selected systematically so as to provide good coverage of several possible portrait characteristics. We applied three existing portraitspeci c stylisation algorithms, two generalpurpose stylisation algorithms, and one general learn ing based stylisation algorithm to the rst level of the benchmark, corresponding to the type of constrained images that have o ften been used in portraitspeci c work. We found that the existing methods are generally e ective on this new image set, demon strating that level one of the benchmark is tractable; challenges remain at level two. Results revealed several advantages conferred by portraitspeci c algorithms over generalpurpose algorithms: portraitspeci c algorithms can use domainspeci c information to preserve key details such as eyes and to eliminate extraneous details, and they have more scope for semantically meaningful abstraction due to the underlying face model. Finally, we pro vide some thoughts on systematically extending the benchmark to higher levels of di fficulty.
  • Item
    Shading with Painterly Filtered Layers: A Technique to Obtain Painterly Portrait Animations
    (Association for Computing Machinery, Inc (ACM), 2017) Castaneda, Saif; Akleman, Ergun; Holger Winnemoeller and Lyn Bartram
    In this manuscript, we describe a process that can be used to create still and/or animated portrait paintings to be shown in Expressive Art Exhibit. Our process consists of two stages: (1) Creation of control textures for a Barycentric shader by using color information gathered from photographs to provide realistic looking skin rendering; (2) Filtering and compositing the layers of images that are obtained by control textures, which correspond to effects such as diffuse, specular and ambient. To demonstrate proof-of-concept, we have created a few rigid body animations of painterly portraits under different lighting conditions.