Modeling-in-Context: User Design of Complementary Objects with a Single Photo

Abstract

The products that we use everyday are typically designed and produced for mass consumption. However, it is difficult for such products to satisfy the needs of individual users. We present a framework that allows the end-user to participate in the entire process of designing their own objects, from the initial concept stage to the production of a new real-world object that fits well with the existing complementary objects. We advocate using a single photo as a rough guide for the user to sketch a new customized object that does not exist in the photo. Our system provides a 2D interface for sketching the outline of the new object and annotating certain geometric properties of it directly on the photo. We introduce a Modified Lipson optimization method for generating the 3D shape. We design a variety of real-world everyday objects that are complementary to the existing objects and environment in the photo. We show that novice users can learn and create new objects with our system within minutes.