Hidden Surface Removal in Augmented Reality: Hand Region Extraction using PCA
Takahiro Ishizu1, Makoto Sakamoto2, Kenji Sakoma3
1Takahiro Ishizu, Department of Computer Science and System Engineering, University of Miyazaki, Japan.
2Makoto Sakamoto*, Department of Computer Science and System Engineering, University of Miyazaki, Japan.
3Kenji Sakoma, Department of Computer Science and System Engineering, University of Miyazaki, Japan.
Manuscript received on January 05, 2020. | Revised Manuscript received on January 25, 2020. | Manuscript published on January 30, 2020. | PP: 4149-4155 | Volume-8 Issue-5, January 2020. | Retrieval Number: E6775018520/2020©BEIESP | DOI: 10.35940/ijrte.E6775.018520
Open Access | Ethics and Policies | Cite | Mendeley | Indexing and Abstracting
© The Authors. Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open access article under the CC-BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)
Abstract: Recently, augmented Reality (AR) is growing rapidly and much attention has been focused on interaction techniques between users and virtual objects, such as the user directly manipulating virtual objects with his/her bare hands. Therefore, the authors believe that more accurate overlay techniques will be required to interact more seamlessly. On the other hand, in AR technology, since the 3-dimensional (3D) model is superimposed on the image of the real space afterwards, it is always displayed on the front side than the hand. Thus, it becomes an unnatural scene in some cases (occlusion problem). In this study, this system considers the object-context relations between the user’s hand and the virtual object by acquiring depth information of the user’s finger using a depth sensor. In addition, the system defines the color range of the user’s hand by performing principal component analysis (PCA) on the color information near the finger position obtained from the depth sensor and setting a threshold. Then, this system extracts an area of the hand by using the definition of the color range of the user’s hand. Furthermore, the fingers are distinguished by using the Canny method. In this way, this system realizes hidden surface removal along the area of the user’s hand. In the evaluation experiment, it is confirmed that the hidden surface removal in this study make it possible to distinguish between finger boundaries and to clarify and process finger contours.
Keywords: Occlusion Problem, Principal Component Analysis (PCA), Canny Edge Detection, Image Processing.
Scope of the Article: Image Analysis and Processing.