Discovering Regularity in Point Clouds of Urban Scenes. I defended my thesis Wednesday the 11th of December 2013. The thesis presents two algorithms for finding regular patterns in 3D images. The abstract to the document follows:< br /> Despite the apparent chaos of the urban environment, cities are actually replete with regularity. From the grid of streets laid out over the earth, to the lattice of windows thrown up into the sky, periodic regularity abounds in the urban scene. Just as salient, though less uniform, are the self-similar branching patterns of trees and vegetation that line streets and fill parks. We propose novel methods for discovering these regularities in 3D range scans acquired by a time-of-flight laser sensor. The applications of this regularity information are broad, and we present two original algorithms. The first exploits the efficiency of the Fourier transform for the real-time detection of periodicity in building facades. Periodic regularity is discovered online by doing a plane sweep across the scene and analyzing the frequency space of each column in the sweep. The simplicity and online nature of this algorithm allow it to be embedded in scanner hardware, making periodicity detection a built-in feature of future 3D cameras. We demonstrate the usefulness of periodicity in view registration, compression, segmentation, and facade reconstruction. The second algorithm leverages the hierarchical decomposition and locality in space of the wavelet transform to find stochastic parameters for procedural models that succinctly describe vegetation. These procedural models facilitate the generation of virtual worlds for architecture, gaming, and augmented reality. The self-similarity of vegetation can be inferred using multi-resolution analysis to discover the underlying branching patterns. We present a unified framework of these tools, enabling the modeling, transmission, and compression of high-resolution, accurate, and immersive 3D images.
The Electric Jewels are a set of interactive, wearable electronics. They include massage gloves, drawing bracelets, video helmets and twinkling necklaces.
Each jewel is a Printed Circuit Board (PCB) attached to a necklace chain or embedded in soft cloth like felt or velvet.
The jewels use joysticks, gyroscopes, accelerometers, and microphones to sense the environment. Some jewels contain LCD screens where little digital drawings can be made. Others have small vibrating motors that provide an invigorating hand massage. The jewels twinkle with LEDs and silkscreen artworks on their surfaces.