COSTECH Integrated Repository

Learning Hand Latent Features For Unsupervised 3D Hand Pose Estimation

Show simple item record

dc.creator Banzi, Jamal
dc.creator Bulugu, Isack
dc.date 2020-04-07T05:09:56Z
dc.date 2020-04-07T05:09:56Z
dc.date 2019-05-06
dc.date.accessioned 2021-05-03T13:17:02Z
dc.date.available 2021-05-03T13:17:02Z
dc.identifier IEEE
dc.identifier 2630-5046
dc.identifier http://hdl.handle.net/20.500.11810/5410
dc.identifier 10.32629/jai.v2i1.36
dc.identifier.uri http://hdl.handle.net/20.500.11810/5410
dc.description Recent hand pose estimation methods require large numbers of annotated training data to extract the dynamic information from a hand representation. Nevertheless, precise and dense annotation on the real data is difficult to come by and the amount of information passed to the training algorithm is significantly higher. This paper presents an approach to developing a hand pose estimation system which can accurately regress a 3D pose in an unsupervised manner. The whole process is performed in three stages. Firstly, the hand is modelled by a novel latent tree dependency model (LTDM) which transforms internal joints location to an explicit representation. Secondly, we perform predictive coding of image sequences of hand poses in order to capture latent features underlying a given image without supervision. A mapping is then performed between an image depth and a generated representation. Thirdly, the hand joints are regressed using convolutional neural networks to finally estimate the latent pose given some depth map. Finally, an unsupervised error term which is a part of the recurrent architecture ensures smooth estimations of the final pose. To demonstrate the performance of the proposed system, a complete experiment is conducted on three challenging public datasets, ICVL, MSRA, and NYU. The empirical results show the significant performance of our method which is comparable or better than state-of-the-art approaches.
dc.subject Hand pose estimation; Convolutional neural networks; Recurrent neural networks; Human-machine interaction; Predictive coding; Unsupervised learning
dc.title Learning Hand Latent Features For Unsupervised 3D Hand Pose Estimation
dc.type Journal Article, Peer Reviewed


Files in this item

Files Size Format View

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record

Search COSTECH


Advanced Search

Browse

My Account