Search Results

Now showing 1 - 10 of 16
  • Item
    A Practical Approach to Physically-Based Reproduction of Diffusive Cosmetics
    (The Eurographics Association and John Wiley & Sons Ltd., 2018) Kim, Goanghun; Ko, Hyeong-Seok; Fu, Hongbo and Ghosh, Abhijeet and Kopf, Johannes
    In this paper, we introduce so-called the bSX method as a new way to utilize the Kubelka-Munk (K-M) model. Assuming the material is completely diffusive, the K-M model gives the reflectance and transmittance of the material from the observation of the material applied on a backing, where the observation includes the thickness of the material application. By rearranging the original K-M equation, we propose that the reflectance and transmittance can be calculated without knowing the thickness. This is a practically useful contribution. Based on the above finding, we develop the bSX method which can (1) capture the material specific parameters from the two photos - taken before and after the material application, and (2) reproduce its effect on a novel backing. We experimented the proposed method in various cases related to virtual cosmetic try-on, which include (1) capture from a single color backing, (2) capture from human skin backing, (3) reproduction of varying thickness effect, (4) reproduction of multi-layer cosmetic application effect, (5) applying the proposed method to makeup transfer. Compared to previous image-based makeup transfer methods, the bSX method reproduces the feel of the cosmetics more accurately.
  • Item
    ExpandNet: A Deep Convolutional Neural Network for High Dynamic Range Expansion from Low Dynamic Range Content
    (The Eurographics Association and John Wiley & Sons Ltd., 2018) Marnerides, Demetris; Bashford-Rogers, Thomas; Hatchett, Jon; Debattista, Kurt; Gutierrez, Diego and Sheffer, Alla
    High dynamic range (HDR) imaging provides the capability of handling real world lighting as opposed to the traditional low dynamic range (LDR) which struggles to accurately represent images with higher dynamic range. However, most imaging content is still available only in LDR. This paper presents a method for generating HDR content from LDR content based on deep Convolutional Neural Networks (CNNs) termed ExpandNet. ExpandNet accepts LDR images as input and generates images with an expanded range in an end-to-end fashion. The model attempts to reconstruct missing information that was lost from the original signal due to quantization, clipping, tone mapping or gamma correction. The added information is reconstructed from learned features, as the network is trained in a supervised fashion using a dataset of HDR images. The approach is fully automatic and data driven; it does not require any heuristics or human expertise. ExpandNet uses a multiscale architecture which avoids the use of upsampling layers to improve image quality. The method performs well compared to expansion/inverse tone mapping operators quantitatively on multiple metrics, even for badly exposed inputs.
  • Item
    Terrain Super-resolution through Aerial Imagery and Fully Convolutional Networks
    (The Eurographics Association and John Wiley & Sons Ltd., 2018) Argudo, Oscar; Chica, Antonio; Andujar, Carlos; Gutierrez, Diego and Sheffer, Alla
    Despite recent advances in surveying techniques, publicly available Digital Elevation Models (DEMs) of terrains are lowresolution except for selected places on Earth. In this paper we present a new method to turn low-resolution DEMs into plausible and faithful high-resolution terrains. Unlike other approaches for terrain synthesis/amplification (fractal noise, hydraulic and thermal erosion, multi-resolution dictionaries), we benefit from high-resolution aerial images to produce highly-detailed DEMs mimicking the features of the real terrain. We explore different architectures for Fully Convolutional Neural Networks to learn upsampling patterns for DEMs from detailed training sets (high-resolution DEMs and orthophotos), yielding up to one order of magnitude more resolution. Our comparative results show that our method outperforms competing data amplification approaches in terms of elevation accuracy and terrain plausibility.
  • Item
    Watercolor Woodblock Printing with Image Analysis
    (The Eurographics Association and John Wiley & Sons Ltd., 2018) Panotopoulou, Athina; Paris, Sylvain; Whiting, Emily; Gutierrez, Diego and Sheffer, Alla
    Watercolor paintings have a unique look that mixes subtle color gradients and sophisticated diffusion patterns. This makes them immediately recognizable and gives them a unique appeal. Creating such paintings requires advanced skills that are beyond the reach of most people. Even for trained artists, producing several copies of a painting is a tedious task. One can resort to scanning an existing painting and printing replicas, but these are all identical and have lost an essential characteristic of a painting, its uniqueness. We address these two issues with a technique to fabricate woodblocks that we later use to create watercolor prints. The woodblocks can be reused to produce multiple copies but each print is unique due to the physical process that we introduce. We also design an image processing pipeline that helps users to create the woodblocks and describe a protocol that produces prints by carefully controlling the interplay between the paper, ink pigments, and water so that the final piece depicts the desired scene while exhibiting the distinctive features of watercolor. Our technique enables anyone with the resources to produce watercolor prints.
  • Item
    Controlling Stroke Size in Fast Style Transfer with Recurrent Convolutional Neural Network
    (The Eurographics Association and John Wiley & Sons Ltd., 2018) Yang, Lingchen; Yang, Lumin; Zhao, Mingbo; Zheng, Youyi; Fu, Hongbo and Ghosh, Abhijeet and Kopf, Johannes
    Controlling stroke size in Fast Style Transfer remains a difficult task. So far, only a few attempts have been made towards it, and they still exhibit several deficiencies regarding efficiency, flexibility, and diversity. In this paper, we aim to tackle these problems and propose a recurrent convolutional neural subnetwork, which we call recurrent stroke-pyramid, to control the stroke size in Fast Style Transfer. Compared to the state-of-the-art methods, our method not only achieves competitive results with much fewer parameters but provides more flexibility and efficiency for generalizing to unseen larger stroke size and being able to produce a wide range of stroke sizes with only one residual unit. We further embed the recurrent stroke-pyramid into the Multi-Styles and the Arbitrary-Style models, achieving both style and stroke-size control in an entirely feed-forward manner with two novel run-time control strategies.
  • Item
    Binocular Tone Mapping with Improved Overall Contrast and Local Details
    (The Eurographics Association and John Wiley & Sons Ltd., 2018) Zhang, Zhuming; Hu, Xinghong; Liu, Xueting; Wong, Tien-Tsin; Fu, Hongbo and Ghosh, Abhijeet and Kopf, Johannes
    Tone mapping is a commonly used technique that maps the set of colors in high-dynamic-range (HDR) images to another set of colors in low-dynamic-range (LDR) images, to fit the need for print-outs, LCD monitors and projectors. Unfortunately, during the compression of dynamic range, the overall contrast and local details generally cannot be preserved simultaneously. Recently, with the increased use of stereoscopic devices, the notion of binocular tone mapping has been proposed in the existing research study. However, the existing research lacks the binocular perception study and is unable to generate the optimal binocular pair that presents the most visual content. In this paper, we propose a novel perception-based binocular tone mapping method, that can generate an optimal binocular image pair (generating left and right images simultaneously) from an HDR image that presents the most visual content by designing a binocular perception metric. Our method outperforms the existing method in terms of both visual and time performance.
  • Item
    Automatic Mechanism Modeling from a Single Image with CNNs
    (The Eurographics Association and John Wiley & Sons Ltd., 2018) Lin, Minmin; Shao, Tianjia; Zheng, Youyi; Ren, Zhong; Weng, Yanlin; Yang, Yin; Fu, Hongbo and Ghosh, Abhijeet and Kopf, Johannes
    This paper presents a novel system that enables a fully automatic modeling of both 3D geometry and functionality of a mechanism assembly from a single RGB image. The resulting 3D mechanism model highly resembles the one in the input image with the geometry, mechanical attributes, connectivity, and functionality of all the mechanical parts prescribed in a physically valid way. This challenging task is realized by combining various deep convolutional neural networks to provide high-quality and automatic part detection, segmentation, camera pose estimation and mechanical attributes retrieval for each individual part component. On the top of this, we use a local/global optimization algorithm to establish geometric interdependencies among all the parts while retaining their desired spatial arrangement. We use an interaction graph to abstract the inter-part connection in the resulting mechanism system. If an isolated component is identified in the graph, our system enumerates all the possible solutions to restore the graph connectivity, and outputs the one with the smallest residual error. We have extensively tested our system with a wide range of classic mechanism photos, and experimental results show that the proposed system is able to build high-quality 3D mechanism models without user guidance.
  • Item
    Cosine-Weighted B-Spline Interpolation on the Face-Centered Cubic Lattice
    (The Eurographics Association and John Wiley & Sons Ltd., 2018) Rácz, Gergely Ferenc; Csébfalvi, Balázs; Jeffrey Heer and Heike Leitte and Timo Ropinski
    Cosine-Weighted B-spline (CWB) interpolation [Csé13] has been originally proposed for volumetric data sampled on the Body-Centered Cubic (BCC) lattice. The BCC lattice is well known to be optimal for sampling isotropically band-limited signals above the Nyquist limit. However, the Face-Centered Cubic (FCC) lattice has been recently proven to be optimal for low-rate sampling. The CWB interpolation is a state-of-the-art technique on the BCC lattice, which outperforms, for example, the previously proposed box-spline interpolation in terms of both efficiency and visual quality. In this paper, we show that CWB interpolation can be adapted to the FCC lattice as well, and results in similarly isotropic signal reconstructions as on the BCC lattice.
  • Item
    Deep Painting Harmonization
    (The Eurographics Association and John Wiley & Sons Ltd., 2018) Luan, Fujun; Paris, Sylvain; Shechtman, Eli; Bala, Kavita; Jakob, Wenzel and Hachisuka, Toshiya
    Copying an element from a photo and pasting it into a painting is a challenging task. Applying photo compositing techniques in this context yields subpar results that look like a collage - and existing painterly stylization algorithms, which are global, perform poorly when applied locally. We address these issues with a dedicated algorithm that carefully determines the local statistics to be transferred. We ensure both spatial and inter-scale statistical consistency and demonstrate that both aspects are key to generating quality results. To cope with the diversity of abstraction levels and types of paintings, we introduce a technique to adjust the parameters of the transfer depending on the painting. We show that our algorithm produces significantly better results than photo compositing or global stylization techniques and that it enables creative painterly edits that would be otherwise difficult to achieve.
  • Item
    Instant Stippling on 3D Scenes
    (The Eurographics Association and John Wiley & Sons Ltd., 2018) Ma, Lei; Guo, Jianwei; Yan, Dong-Ming; Sun, Hanqiu; Chen, Yanyun; Fu, Hongbo and Ghosh, Abhijeet and Kopf, Johannes
    In this paper, we present a novel real-time approach to generate high-quality stippling on 3D scenes. The proposed method is built on a precomputed 2D sample sequence called incremental Voronoi set with blue-noise properties. A rejection sampling scheme is then applied to achieve tone reproduction, by thresholding the sample indices proportional to the inverse target tonal value to produce a suitable stipple density. Our approach is suitable for stippling large-scale or even dynamic scenes because the thresholding of individual stipples is trivially parallelizable. In addition, the static nature of the underlying sequence benefits the frame-to-frame coherence of the stippling. Finally, we propose an extension that supports stipples of varying sizes and tonal values, leading to smoother spatial and temporal transitions. Experimental results reveal that the temporal coherence and real-time performance of our approach are superior to those of previous approaches.