We overview a technique known as Super Image Vector Inner Product as applied to Facial pose estimation. The method is mathematically similar to correlation based methods but is numerically more efficient. The Vector Inner Product approach attains its pose and position estimation by embedding these distortions in its phase response. We demonstrate for the first time, that that the Super Image Vector Inner Product can be used for facial identification. We present a method by which segmenting the face into a set of feature regions, individual Super Images can be combined together using mesh techniques to track facial expressions.

We introduce a new and efficient distortion-invariant super image tracker and pose estimator based on a linear phase coefficient composite filter. The super image consists of a weighted sum of training images chosen to span the distortion range under analysis. Unlike correlation-based composite filter design, the super image is implemented by means of a complex vector inner product operation. A super image vector inner product is implemented by elementwise multiplication of a super image template by a window of interest in the input scene and summation of the elementwise operations. The resulting amplitude indicates target detection, and the resulting phase indicates the value of scale, orientation, or movement of the target object. The mathematical characteristics of the super image vector inner product are presented, and its application is demonstrated.

LIDAR-based systems measure the time-of-flight of a laser source onto the scene and back to the sensor, building a wide field of view 3D raster image, but as a scanning process, there are problems associated with motion inside the scene over the duration of the scan. By illuminating the entire scene simultaneously using a broad laser pulse, a 2D camera equipped with a high speed shutter can measure the time-of-flight over the entire field of view (FOV), thereby, recording an instantaneous snap-shot of the entire scene. However, spreading the laser reduces the range. So what is required is a programmable system that can track multiple regions of interest by varying the field of regard to (1) a single direction, (2) the entire FOV, or (3) intermediate views of interest as required by the evolving scene environment. In this project, the investigators intend to add this variable illumination capability to existing instantaneous ranging hardware by using a liquid crystal spatial light modulator (SLM) beam steering system that adaptively varies the (single or multi) beam intensity profiles and pointing directions. For autonomous satellite rendezvous, docking, and inspection, the system can perform long-range sensing with a narrow FOV while being able to expand the FOV as the target object approaches the sensor. To this end in a previous paper, we analyzed the performance of a commercially available TOF sensor (3DVSystems' Zmini) in terms of the depth sensitivity versus target range and albedo. In this paper, we will analyze the laser system specifications versus range of field-of-view when beam steering is performed by means of a Boulder Nonlinear Systems' phase-only liquid crystal SLM. Experimental results show that the adjustable laser beam FOV extensively compensate the reflected image grayscale from objects at long range, and prove the feasibility of expanding range with the projection from the SLM.

Our objective is the complete surface scan of the canal, concha and external lobe of a human ear. We present two applications, (1) canal and concha scanning for hearing aid design and, (2) biometric detection, tracking and discrimination of the ear lobe shape. Over recent years, the possibility of reconstructing three dimensional models from images has lead to an active research field. There are two common non-contact methods to extract 3D surface contours. They are stereo vision and structured light illumination. Much of the theory of stereo vision is very well understood, meanwhile, there still remain numerous problems associated with axial motion stereo vision. An ear scanning system is built for biomedical and biometrics applications. There are many challenging problems in this system such as small space, concavity, accuracy, and scale range from canal to entire lobe, as well as the merging of all the data. The traditional stereo vision methods cannot be used in this system because of these problems. The axial stereo vision method is used for canal scanning and structured light illumination method is used for concha scanning. The mathematical and geometric models of axial motion stereo vision system and structured light illumination system are presented in this study and the advantages of the stereo vision and structured light illumination systems are examined. The ear scanning prototype system and the experimental results are shown in this dissertation. The surface scan of canal and concha can be used for biomedical application to create computer aided design model for hearing aid. The surface scan of concha and lobe can be used for biometrics application for tracking and identification. Given the 3D scan results of the ear concha and lobe, a new and efficient distortion-invariant "super image" is introduced to track and identify the biometrics. It is based on linear phase coefficient composite filter. The super image consists of a weighted sum of training images chosen to span the distortion range under analysis. Unlike correlation based composite filter design, the super image is implemented using a complex vector inner product operation. A super image vector inner product is implemented by element-wise multiplying a super image template by a window of interest in the input scene and then summing the element-wise operations. The resulting amplitude indicates target detection and the resulting phase indicates the value of scale, orientation or movement of the target object. The mathematical characteristics of super image vector inner product are presented and its application is demonstrated. Keywords. Structured Light, Axial Stereo Vision, Composite Filters, Synthetic Discriminant Functions, Target Tracking

Phase-only spatial light modulators provide active pattern projection. Unlike incoherent techniques, the pattern energy is inversely proportional to the total pattern area. If the patterns consist of spots or regions of light energy, it is possible to achieve a high signal-to-noise ratio within these regions. A 3DV Systems' Zmini range finder works with fast switching of the illumination source to form the "light wall" and fast gating of the reflected image entering the camera. Zmini operates by using a high speed shutter to temporally clip the energy field going to one camera chip while allowing the full pulsed energy to go to a second camera chip. The second chip captures the albedo which is effectively pixelwise divided out of the shuttered chip, leaving values that are proportional to depth. Thus, video rate time of flight depth information is attained. By combining these two technologies, we can extend the operating range of the Zmini shuttered depth finder significantly. In this paper, we present a feasibility report on the range property of the Zmini. The spatial light modulator under investigation is a 512 x 512 element, phase-only, liquid crystal device recently produced by Boulder Non-linear Systems Incorporated.

Phase-only spatial light modulators provide active pattern projection. Unlike incoherent techniques, the pattern energy is inversely proportional to the total pattern area. We refer to this flexible pattern/beamsteering system as the real-time adaptive multi-spot laser beamsteering system (RAMS-LBS). The spatial light modulator under investigation is a, 512x512 element, phase-only liquid crystal device recently produced by Boulder Non-linear Systems Incorporated. A laser tweezer is a powerful micromanipulation tool in both the physical and life sciences. In this study, we introduce the detection and tracking of the movement of particles that are controlled by the laser tweezers. The detection and tracking philosophy of these methods are to use optical flow and matched filter techniques. Our discussion will include different tracking protocol and some demonstrations of shape recognition. We have also developed a numerical simulation integrated with experimental implementation.

For consumer imaging applications, multi-spectral color refers to capturing and displaying images in more than three primary colors in order to achieve color gamuts significantly larger than those produced by RGB devices. In this paper, we describe the building of both a multi-camera recording system and multi-projector display system using off-the-shelf components that, unlike existing multi-camera/projector systems that rely on expensive and time consuming optical alignment of camera/projector views, relies upon the virtual alignment of views performed in software. Once images are properly aligned, the described systems represent recording/display platforms that scale linearly in cost with the number of color primaries where new colors are added by simply attaching more devices. In this paper, we illustrate frames of the color video produced using a five camera system as well as an image of the aligned six projectors of the display system.

A Phase-only spatial light modulator can provide active spot pattern projection with high signal-to-noise ratio and form near-arbitrary phase modulation surfaces. As a result they can diffract laser beams into a near-arbitrary pattern of laser spots. Depending on the sequence of phase images loaded onto the SLM, the spots can be scanned on independent and continuous two-dimensional trajectories. We refer to this flexible beamsteering system as the real-time adaptive multispot laser beamsteering system (RAMS-LBS). This paper presents work under progress, in developing 2D and 3D calibration algorithms for a spot pattern projection system. In the 2D calibration process, spot grids are projected with successively more spot locations. After each projection, a higher order model is determined for camera to projector coordinate transforms. The accuracies of different model orders are measured. In the 3D calibration process, grids of spots are projected onto non-coplanar target grid to construct the transformation matrix between different coordinates. Perspective distortions are included in the transformation vectors after the calibration. Therefore, 3D information of the target can be obtained in the calibrated system. Applications such as 3D target surface topology measurement and target detection using 2D and 3D information are described in this paper.