17 results
Search Results
Now showing 1 - 10 of 17
Item Depth-aware Neural Style Transfer(Association for Computing Machinery, Inc (ACM), 2017) Liu, Xiao-Chang; Cheng, Ming-Ming; Lai, Yu-Kun; Rosin, Paul L.; Holger Winnemoeller and Lyn BartramNeural style transfer has recently received signi cant a ention and demonstrated amazing results. An e cient solution proposed by Johnson et al. trains feed-forward convolutional neural networks by de ning and optimizing perceptual loss functions. Such methods are typically based on high-level features extracted from pre-trained neural networks, where the loss functions contain two components: style loss and content loss. However, such pre-trained networks are originally designed for object recognition, and hence the high-level features o en focus on the primary target and neglect other details. As a result, when input images contain multiple objects potentially at di erent depths, the resulting images are o en unsatisfactory because image layout is destroyed and the boundary between the foreground and background as well as di erent objects becomes obscured. We observe that the depth map e ectively re ects the spatial distribution in an image and preserving the depth map of the content image a er stylization helps produce an image that preserves its semantic content. In this paper, we introduce a novel approach for neural style transfer that integrates depth preservation as additional loss, preserving overall image layout while performing style transfer.Item Real-Time Panorama Maps(Association for Computing Machinery, Inc (ACM), 2017) Brown, S. Alex; Samavati, Faramarz; Holger Winnemoeller and Lyn BartramPanorama maps are stylized paintings of terrain often seen at tourist destinations. They are difficult to create since they are both artistic and grounded in real geographic data. In this paper we present techniques for rendering real-world data in the style of Heinrich Berann's panorama maps in a real-time application. We analyse several of Berann's paintings to identify the artistic elements used. We use this analysis to form algorithms that mimic the panorama map style, focusing on replicating the terrain deformation, distorted projection, terrain colouring, tree brush strokes, water rendering, and atmospheric scattering. In our approach we use freely available digital earth data to render interactive panorama maps without needing further design work.Item A taxonomy of motion applications in data visualization(Association for Computing Machinery, Inc (ACM), 2017) Arenas, Irene de la Torre -; Cruz, Pedro; Holger Winnemoeller and Lyn BartramWe propose a new taxonomy that explains the roles of motion in data visualization, focusing especially on their communicative aspects. Our taxonomy clarifies the main axis in how visualization designers can employ motion in data portrayal.Item Front- and Backmatter: NPAR 2017(Association for Computing Machinery, Inc (ACM), 2017) Holger Winnemoeller; Lyn Bartram; Holger Winnemoeller and Lyn BartramItem Mixed Illumination Analysis in Single Image for Interactive Color Grading(Association for Computing Machinery, Inc (ACM), 2017) Duchêne, Sylvain; Aliaga, Carlos; Pouli, Tania; Pérez, Patrick; Holger Winnemoeller and Lyn BartramColorists often use keying or rotoscoping tools to access and edit particular colors or parts of the scene. Although necessary, this is a time-consuming and potentially imprecise process, as it is not possible to fully separate the influence of light sources in the scene from the colors of objects and actors within it. To simplify this process, we present a new solution for automatically estimating the color and influence of multiple illuminants, based on image variation analysis. Using this information, we present a new color grading tool for simply and interactively editing the colors of de- tected illuminants, which fits naturally in color grading workflows. We demonstrate the use of our solution in several scenes, evaluating the quality of our results by means of a psychophysical study.Item Modeling Go: A mobile sketch-based modeling system for extracting objects(Association for Computing Machinery, Inc (ACM), 2017) Lai, Chun-An; Chiang, Pei-Ying; Holger Winnemoeller and Lyn BartramThis article presents an easy to use mobile application which allows users to create 3D digital copies of their interested objects anywhere and anytime. An advanced 3-sweep modeling technique is developed to construct 3D primitives not only from generalized cylinder and cuboid, but also objects with symmetrical or non-uniformly scaled profiles. In addition, our system supports the texture and structure refinement which combine results created from multiple source images. The constructed 3D model will be the combination of our 3D primitives. The combined result can preserve more features which may not be seen from a single photo.Item Edge- and substrate-based effects for watercolor stylization(Association for Computing Machinery, Inc (ACM), 2017) Montesdeoca, Santiago E.; Seah, Hock Soon; Bénard, Pierre; Vergne, Romain; Thollot, Joëlle; Rall, Hans-Martin; Benvenuti, Davide; Holger Winnemoeller and Lyn BartramWe investigate characteristic edge- and substrate-based effects for watercolor stylization. These two fundamental elements of painted art play a significant role in traditional watercolors and highly influence the pigment's behavior and application. Yet a detailed consideration of these specific elements for the stylization of 3D scenes has not been attempted before. Through this investigation, we contribute to the field by presenting ways to emulate two novel effects: dry-brush and gaps & overlaps. By doing so, we also found ways to improve upon well-studied watercolor effects such as edge- darkening and substrate granulation. Finally, we integrated con- trollable external lighting influences over the watercolorized result, together with other previously researched watercolor effects. These effects are combined through a direct stylization pipeline to produce sophisticated watercolor imagery, which retains spatial coherence in object-space and is locally controllable in real-time.Item Neural Style Transfer: A Paradigm Shift for Image-based Artistic Rendering?(Association for Computing Machinery, Inc (ACM), 2017) Semmo, Amir; Isenberg, Tobias; Döllner, Jürgen; Holger Winnemoeller and Lyn BartramIn this meta paper we discussimage-based artistic rendering (IB-AR)based onneural style transfer(NST) and argue, while NST may represent a paradigm shift for IB-AR, that it also has to evolve as an interactive tool that considers the design aspects and mecha- nisms of artwork production. IB-AR received signifficant attention in the past decades for visual communication, covering a plethora of techniques to mimic the appeal of artistic media. Example-based renderingrepresents one the most promising paradigms in IB-AR to (semi-)automatically simulate artistic media with high fidelity, but so far has been limited because it relies on pre-defined image pairs for training or informs only low-level image features for texture transfers. Advancements in deep learning showed to alleviate these limitations by matching content and style statistics via activations of neural network layers, thus making a generalized style trans- fer practicable. We categorize style transfers within the taxonomy of IB-AR, then propose a semiotic structure to derive a technical research agenda for NSTs with respect to the grand challenges of NPAR. We finally discuss the potentials of NSTs, thereby identifying applications such as casual creativity and art production.Item Sketch and Shade : An interactive assistant for sketching and shading(Association for Computing Machinery, Inc (ACM), 2017) Parakkat, Amal Dev; Joshi, Sarang Anil; Pundarikaksha, Uday Bondi; Muthuganapathy, Ramanathan; Holger Winnemoeller and Lyn BartramWe present a drawing assistant for sketching and for assisting users in shading a hand drawn sketch. The augmented reality based system uses a sketch made by a professional and uses it to help inexperienced users to do sketching and shading. The input image is converted to a set of points based on simple heuristics for providing a “connect the dots'' interface for a user to aid sketching. With the help of a 2.5D mesh generated by our algorithm, the system assists the user by providing information about the colors that can be given in different parts of the sketch. The system was tested with users of different age groups and skill levels, indicating its usefulness.Item Characterizing User Behavior for Speech and Sketch-based Video Retrieval Interfaces(Association for Computing Machinery, Inc (ACM), 2017) Altıok, Ozan Can; Sezgin, Tev k Metin; Holger Winnemoeller and Lyn BartramFrom a user interaction perspective, speech and sketching make a good couple for describing motion. Speech allows easy speci cation of content, events and relationships, while sketching brings in spatial expressiveness. Yet, we have insu cient knowledge of how sketching and speech can be used for motionbased video retrieval, because there are no existing retrieval systems that support such interaction. In this paper, we describe a WizardofOz protocol and a set of tools that we have developed to engage users in a sketch and speechbased video retrieval task. We report how the tools and the protocol t together using ''retrieval of soccer videos'' as a use case scenario. Our so ware is highly customizable, and our protocol is easy to follow. We believe that together they will serve as a convenient and powerful duo for studying a wide range of multimodal use cases.