Full Record

New Search | Similar Records

Title Locally Tuned Nonlinear Manifold for Person Independent Head Pose Estimation
Publication Date
Degree PhD
Discipline/Department Electrical Engineering
Degree Level doctoral
University/Publisher University of Dayton
Abstract Fine-grain head pose estimation from imagery is an essential operation for many human-centered systems, including pose independent face recognition and human-computer interaction systems. It is only recently that estimation systems have evolved past a coarse level classification of pose and concentrated on fine-grain estimation. In particular, the state of the art of such systems consists of nonlinear manifold embedding techniques, such as Locally Linear Embedding and Isomap, that capture the intrinsic relationship of a pose varying face dataset. The success of these solutions can be attributed to the acknowledgment that image variation corresponding to pose change is nonlinear in nature. Yet, these algorithms are limited by the complexity of embedding functions that describe the relationship and provide no clear method for projecting novel data to the latent space. On the other hand, linear methods and nonlinear approximation techniques permit a simple embedding process, but lack the representational quality to globally describe the nonlinear image variation. In this dissertation, a pose estimation framework that seeks to describe the global nonlinear relationship in terms of localized linear functions is presented. A locally tuned nonlinear manifold is formulated using a two-layer system based on the assumptions that coarse pose estimation can be performed adequately using supervised linear methods, and fine pose estimation can be achieved using linear regressive functions if the scope of the pose manifold is limited. The localized linear approach results in a simplistic model for which probe input can be embedded through a cascade of linear transformations. Additionally, new methods for modeling the localized structures using feature enhanced Canonical Correlation Analysis are developed, where pose variation is regarded as a continuous variable and is represented by a manifold in feature space. The feature enhanced methods are used to identify the modes of correlation between the observed input images and the head pose angle. These techniques exploit oriented filters which serve two key purposes: (a) eliminate noise features, while boosting image elements that are associated with head pose (b) provide multiple dimensions of the input, allowing the correlation analysis process to extract more basis vectors to provide higher accuracy. A pose estimation system is implemented utilizing simple linear subspace methods, phase congruency, and Gabor features. The framework is tested using conventional test strategies and widely accepted pose-varying face databases. The proposed method is first tested using homogeneous datasets, where the training and testing face images are sampled from the same database. The generalization capabilities of the system are then tested using heterogeneous tests, where the training data is taken from a different database than the testing set. The proposed system is shown to perform fine head pose estimation with competitive accuracy when compared with state of the art nonlinear manifold…
Subjects/Keywords Computer Engineering; Electrical Engineering; Head Pose Estimation; Piecewise Linear Manifold; Pose Sensitive Representations; Coarse to Fine; Head Orientation; Phase Congruency
Contributors Asari, Vijayan (Committee Chair)
Language en
Rights unrestricted ; This thesis or dissertation is protected by copyright: all rights reserved. It may not be copied or redistributed beyond the terms of applicable copyright laws.
Country of Publication us
Format application/pdf
Record ID oai:etd.ohiolink.edu:dayton1311968002
Repository ohiolink
Date Retrieved
Date Indexed 2021-01-29
Grantor University of Dayton

Sample Search Hits | Sample Images

…modeling the face pose manifold. 1.1 Focus and Contributions The focus of this research is to simplistically model the latent nonlinear pose manifold using a locally tuned piecewise linear representation that is capable of embedding novel inputs. The…

…2.3.3 Locally Linear Embedding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 2.3.4 Biased Manifold Embedding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 III LOCALLY TUNED NONLINEAR MANIFOLD FOR PERSON…

…testing strategy . . . . . . . . . . . . . . . . . . . . . . . 56 4.3 Linear manifold Pointing ’04 results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 x 4.4 Accuracy analysis of phase congruency features…

…to distinct pose angles. Detector arrays are computationally expensive and are unable to perform fine/continuous pose estimation. Dimensionality reduction and manifold learning A linear or nonlinear embedding process is used to describe the latent…

…for estimating head pose from imagery that is based on the following assumptions: • Head pose changes in imagery are a nonlinear form of variation that is too complex to be globally described by linear functions. • Regions of the nonlinear manifold can…

linear functions [43, 49]. From these assumptions we seek to create a nonlinear manifold that describes the pose variation of face images independent of face identity. We present a locally tuned method where continuous pose variation is modeled…

…with local linear functions to describe portions of the global pose manifold. These local pose models are supported by a supervised neighborhood estimation process. In effect, a coarse to fine pose estimation method is defined with the intent of…

…quality of the nonlinear systems and produce relatively poor results, yet are simpler and computationally inexpensive. The proposed framework assumes that for local patches of the latent manifold, neighborhooddependent linear functions can be used to…