Secure Multimodal Access with 2D and 3D Ears

Abstract

This chapter introduces a multimodal technique that uses 2D and 3D ear images for secure access. The technique uses 2D-modality to identify keypoints and 3D-modality to describe keypoints. Upon detection and mapping of keypoints into 3D, a feature descriptor vector is computed around each mapped keypoint in 3D. We perform a two-stage, coarse and fine alignment to fit the 3D ear image of the probe to the 3D ear image of the gallery. The probe and gallery image keypoints are compared using feature vectors, where very similar keypoints are used as coarse alignment correspondence points. Once the ear pairs are matched fairly closely, the entire data is finely aligned to compute the matching score. A detailed systematic analysis using a large ear database has been carried out to show the efficiency of the technique proposed. © 2021, Springer Nature Singapore Pte Ltd.