16 results
Search Results
Now showing 1 - 10 of 16
Item Geometry-aware Video Registration(The Eurographics Association, 2010) Palma, Gianpalo; Callieri, Marco; Dellepiane, Matteo; Corsini, Massimiliano; Scopigno, Roberto; Reinhard Koch and Andreas Kolb and Christof Rezk-SalamaWe present a new method for the accurate registration of video sequences of a real object over its dense triangular mesh. The goal is to obtain an accurate video-to-geometry registration to allow the bidirectional data transfer between the 3D model and the video using the perspective projection defined by the camera model. Our solution uses two different approaches: feature-based registration by KLT video tracking, and statistic-based registration by maximizing the Mutual Information (MI) between the gradient of the frame and the gradient of the rendering of the 3D model with some illumination related properties, such as surface normals and ambient occlusion. While the first approach allows a fast registration of short sequences with simple camera movements, the MI is used to correct the drift problem that KLT tracker produces over long sequences, due to the incremental tracking and the camera motion. We demonstrate, using synthetic sequences, that the alignment error obtained with our method is smaller than the one introduced by KLT, and we show the results of some interesting and challenging real sequences of objects of different sizes, acquired under different conditions.Item Mapping highly detailed color information on extremely dense 3D models: the case of David s restoration(The Eurographics Association, 2007) Dellepiane, Matteo; Callieri, Marco; Ponchio, Federico; Scopigno, Roberto; David B. Arnold and Andrej FerkoThe support of advanced Information Technology (IT) to preservation, restoration and documentation of Cultural Heritage is becoming a very important goal for the research community. Michelangelo's David was one of the first applications of 3D scanning technology on a highly popular work of art. The subsequent restoration campaign, started in 2002 and concluded in 2004, was also a milestone for the adoption of modern scientific analysis procedures and IT tools in the framework of a restoration process. One of the focuses in this restoration was also methodological, i.e. to plan and adopt innovative ways to document the restoration process. In this paper we present the results of an integration of different restoration data (2D and 3D datasets) which has been concluded recently. The recent evolution of HW and SW graphics technologies gave us the possibility to interactively visualize an extremely dense 3D model which incorporates the color information provided by two professional photographic campaigns, made before and after the restoration. Moreover, we present the results concerning the mapping, in this case on the 2D media, of the reliefs produced by restorers to assess and document the status of the marble surface before the restoration took place. This result could lead to new and fascinating applications of computer graphics for preservation, restoration and documentation of Cultural Heritage.Item Principles and Practices of Robust, Photography-based Digital Imaging Techniques for Museums(The Eurographics Association, 2010) Mudge, Mark; Schroer, Carla; Earl, Graeme; Martinez, Kirk; Pagi, Hembo; Toler-Franklin, Corey; Rusinkiewicz, Szymon; Palma, Gianpaolo; Wachowiak, Melvin; Ashley, Michael; Matthews, Neffra; Noble, Tommy; Dellepiane, Matteo; Alessandro Artusi and Morwena Joly and Genevieve Lucet and Denis Pitzalis and Alejandro RibesThis full day tutorial will use lectures and demonstrations from leading researchers and museum practitioners to present the principles and practices for robust photography-based digital techniques in museum contexts. The tutorial will present many examples of existing and cutting-edge uses of photography-based imaging including Reflectance Transformation Imaging (RTI), Algorithmic Rendering (AR), camera calibration, and methods of imaged-based generation of textured 3D geometry. Leading museums are now adopting the more mature members of this family of robust digital imaging practices. These practices are part of the emerging science known as Computational Photography (CP). The imaging family's common feature is the purpose-driven selective extraction of information from sequences of standard digital photographs. The information is extracted from the photographic sequences by computer algorithms. The extracted information is then integrated into a new digital representations containing knowledge not present in the original photographs, examined either alone or sequentially. The tutorial will examine strategies that promote widespread museum adoption of empirical acquisition technologies, generate scientifically reliable digital representations that are born archival', assist this knowledge's long-term digital preservation, enable its future reuse for novel purposes, aid the physical conservation of the digitally represented museum materials, and enable public access and research.Item Multiple Uses of 3D Scanning for the Valorization of an Artistic Site: the Case of Luni(The Eurographics Association, 2008) Dellepiane, Matteo; Callieri, Marco; Paribeni, Emanuela; Sorge, Elena; Sulfaro, Nino; Marianelli, Veronica; Scopigno, Roberto; Vittorio Scarano and Rosario De Chiara and Ugo ErraThe heritage site of Luni is a very interesting location, which tells the story of an ancient roman colony, and of an area where different cultures left their heritage. In particular, the remains of the pediments of an ancient temple represent a very interesting case and an open field of study for art historians. The scanning of a group of statue belonging to the pediments showed that the produced 3D models could be used in several ways, not only for archival and presentation purposes but also to provide interactive support for the work of the restorers and the scholars. In particular, the use of 3D models to propose and validate hypothesis about the original position of the fragments in the context of the fronton could be an alternative solution to the direct manipulation of them. Moreover, the analysis of the original color of the statues, and the representation different hypothesis about the ancient appearance can be produced through the interactive editing of the 3D models of the statues. In this paper we present the scanning campaign which resulted in the acquisition of five statues,the preliminary results of some of the uses of the models produced with acquired data, and a brief description of other possible future applications of them. This shows how 3D scanning can be considered by now a mature technology for the support of restoration and preservation of Cultural Heritage.Item High Quality PTM Acquisition: Reflection Transformation Imaging for Large Objects(The Eurographics Association, 2006) Dellepiane, Matteo; Corsini, Massimiliano; Callieri, Marco; Scopigno, Roberto; Marinos Ioannides and David Arnold and Franco Niccolucci and Katerina ManiaReflection Transformation Imaging has proved to be a powerful method to acquire and represent the 3D reflectance properties of an object, displaying them as a 2D image. Recently, Polynomial Texture Maps (PTM), which are relightable images created from a set of photos of the object taken under several different lighting conditions, have been used in Cultural Heritage field to document and virtually inspect several sets of small objects, such as cuneiform tablets and coins. In this paper we explore the possibility of producing high quality PTM of medium or large size objects. The aim is to analyze the acquisition pipeline, resolving all the issues related to the size of the object, and the conditions of acquisition. We will discuss issues regarding acquisition planning and data gathering. We also present a new tool to interactively browse high resolution PTMs. Moreover, we perform some quality assessment considerations, in order to study the degradation of quality of the PTMs respect to the number and position of lights used to acquire the PTM. The results of our acquisition system are presented with some examples of PTMs of large artifacts like a sarcophagus of 2.4 × 1 m size. PTM can be a good alternative to 3D scanning for capturing and representing certain class of objects, like bas-relieves, having lower costs in terms of acquisition equipment and data processing time.Item Removing Shadows for Color Projection Using Sun Position Estimation(The Eurographics Association, 2010) Dellepiane, Matteo; Benedetti, Luca; Scopigno, Roberto; Alessandro Artusi and Morwena Joly and Genevieve Lucet and Denis Pitzalis and Alejandro RibesThe result of an outdoors 3D scanning acquisition campaign is usually an accurate 3D model of the site, but in most of the cases the quality of the color acquired by the scanner is not satisfying. Alternative solutions, like the projection of a photographic dataset acquired in a different stage, are still dependent on the quality of the initial images. The short time for the acquisition campaigns and the weather conditions often force the shooting of images taken under a strong direct sun illumination. This generates colored models of poor quality. In this paper we present a method to estimate the sun position starting from a geo-referenced 3D model and a set of images. The sun position can enhance both the image alignment and color projection phases. Moreover, the detection and removal of the shadows from the images produces a better and more coherent color in the final 3D model. Using this kind of approach, outdoor sites can be acquired producing a high quality color information together with an accurate geometric measurement.Item Pushing Time-of-Flight Scanners to the Limit(The Eurographics Association, 2009) Callieri, Marco; Cignoni, Paolo; Dellepiane, Matteo; Scopigno, Roberto; Kurt Debattista and Cinzia Perlingieri and Denis Pitzalis and Sandro SpinaThe paper describes a pipeline for 3D scanning acquisition and processing that allow to exploit the utmost precision and quality out of ToF scanners. The proposed approach capitalize on the knowledge of the distribution of the noise to apply sophisticated fairing techniques for cleaning up the data. Leveraging on the very dense sampling of this kind of scanners we show that is possible to attain high accuracy. We present a practical application of the proposed approach for the scanning of a large (5mt) statue with millimetric precision.Item Instant Sound Scattering(The Eurographics Association, 2007) Tsingos, Nicolas; Dachsbacher, Carsten; Lefebvre, Sylvain; Dellepiane, Matteo; Jan Kautz and Sumanta PattanaikReal-time sound rendering engines often render occlusion and early sound reflection effects using geometrical techniques such as ray or beam tracing. They can only achieve interactive rendering for environments of low local complexity resulting in crude effects which can degrade the sense of immersion. However, surface detail or complex dynamic geometry has a strong influence on sound propagation and the resulting auditory perception. This paper focuses on high-quality modeling of first-order sound scattering. Based on a surface-integral formulation and the Kirchhoff approximation, we propose an efficient evaluation of scattering effects, including both diffraction and reflection, that leverages programmable graphics hardware for dense sampling of complex surfaces. We evaluate possible surface simplification techniques and show that combined normal and displacement maps can be successfully used for audio scattering calculations. We present an auralization framework that can render scattering effects interactively thus providing a more compelling experience. We demonstrate that, while only considering first order phenomena, our approach can provide realistic results for a number of practical interactive applications. It can also process highly detailed models containing millions of unorganized triangles in minutes, generating high-quality scattering filters. Resulting simulations compare well with on-site recordings showing that the Kirchhoff approximation can be used for complex scattering problems.Item Mutual Correspondences: An Hybrid Method for Image-to-geometry Registration(The Eurographics Association, 2010) Sottile, Michele; Dellepiane, Matteo; Cignoni, Paolo; Scopigno, Roberto; Enrico Puppo and Andrea Brogni and Leila De FlorianiImage registration is an important task in several applications of Computer Graphics and Computer Vision. Among the large number of proposed approaches, currently there is no solution which is automatic and robust enough to handle any general case. The most robust methods usually require a significant intervention by the user to specify many 2D-3D correspondences, while automatic techniques often rely on strong assumptions about the quality of 2D and 3D data. In this paper we present Mutual Correspondences, which is based on a minimization function which combines correspondences based and Mutual Information based approaches, and takes advantage of the strong points of both. Mutual Correspondences give the user the possibility to "guide" Mutual Information with only a few 2D- 3D correspondences. The proposed approach results in a wider convergence range and in higher registration accuracy, regardless of the quality of both the image and the 3D model. Mutual Correspondences were applied on some practical cases, where state-of-the-art approaches tended to fail, and they provided a mean to obtain accurate results. This led to a simple, robust and practical approach that can provide a way to register images in a few seconds.Item Using 3D Scanning to Analyze a Proposal for the Attribution of a Bronze Horse to Leonardo da Vinci(The Eurographics Association, 2007) Dellepiane, Matteo; Callieri, Marco; Fondersmith, Mark; Cignoni, Paolo; Scopigno, Roberto; D. Arnold and F. Niccolucci and A. ChalmersIn this paper we present how technologies developed in the context of 3D graphics (3D scanning and image-to- 3D-model mapping) have been used to evaluate in a metrically objective way the plausibility of an attribution hypothesis of a Renaissance artifact. The artifact considered is a small bronze horse (Archeological Museum, Florence, Italy), which was discovered to be very similar to a silverpoint drawing by Leonardo (Leonardo drawing #358, Windsor Royal Library, UK), thus originating an attribution hypothesis. A highly accurate digital replica of this small bronze statue was reconstructed by means of triangulation-based 3D scanning technology. Using image-to-3D-model mapping techniques the Leonardo s drawing depicting a very similar horse has been aligned to the digital 3D model, reconstructing in a virtual manner the ideal vantage points which could have been used to sketch the drawings of the horse (in the hypothesis that Leonardo had drawn it by directly looking at the bronze). The same approach has been also tried with other Leonardo s drawings depicting a similar subject, but none of those was sufficiently compatible in shape with the bronze horse to allow convergence of the image-to-3D mapping process. The approach proposed allows us to give some visually objective evidences about the shape similarity issue, which was the origin of this attribution attempt. At the same time, a purely technical evaluation does not close the attribution issue. Further archival research and expertise will be needed to solve and assess the issue of this disputed hypothesis.