Please use this identifier to cite or link to this item: http://hdl.handle.net/11455/4903
標題: 盲人手勢即時辨識
Real-time Hand Gesture Recognition for Visually Impaired
作者: 張馨之
Chang, Hsin-Chih
關鍵字: 手勢辨識;Hand Gesture Recognition;Kinect;盲人點字;深度影像;Depth image;Kinect;Braille
出版社: 通訊工程研究所
引用: [1] http://www.xbox.com/zh-TW/kinect [2] http://commons.wikimedia.org/wiki/File:Xbox-360-Kinect-Standalone.png [3] http://advising.ccu.edu.tw/ResourceClass/tool_eye.html [4] http://www.yfes.tn.edu.tw/yfesvi/tools.htm [5] Choi, Junyeong, and Jong-Il Park. "Hand posture recognition using shape decomposition." VR Innovation (ISVRI), 2011 IEEE International Symposium on. IEEE, 2011. [6] Choi, Junyeong, Hanhoon Park, and Jong-II Park. "Hand shape recognition using distance transform and shape decomposition." Image Processing (ICIP), 2011 18th IEEE International Conference on. IEEE, 2011. [7] 鄭喬勻,“3D立體視覺於手勢切割之應用” 國立成功大學電機工程所碩士論文, 2012. [8] Van den Bergh, Michael, and Luc Van Gool. "Combining RGB and ToF cameras for real-time 3D hand gesture interaction." Applications of Computer Vision (WACV), 2011 IEEE Workshop on. IEEE, 2011. [9] http://www.primesense.com/ [10] http://msdn.microsoft.com/zh-tw/hh367958.aspx [11] Xia, Lu, Chia-Chih Chen, and J. K. Aggarwal. "Human detection using depth information by Kinect." Computer Vision and Pattern Recognition Workshops (CVPRW), 2011 IEEE Computer Society Conference on. IEEE, 2011. [12] Kondori, Farid Abedan, et al. "3D head pose estimation using the kinect."Wireless Communications and Signal Processing (WCSP), 2011 International Conference on. IEEE, 2011. [13] Fanelli, Gabriele, et al. "Real time head pose estimation from consumer depth cameras." Pattern Recognition (2011): 101-110. [14] Chen, Chia-Ping, et al. "Real-time hand tracking on depth images." Visual Communications and Image Processing (VCIP), 2011 IEEE. IEEE, 2011. [15] Szu-Chun Yen ,Yu-Yuan Chen, Tzu-Chung Shang, et al. "Real Time Dynamic Hand Gesture Recognition with 3D Depth Sensing. "CVGIP 2011. [16] Liao, Yun, et al. "Fingertips Detection Algorithm Based on Skin Colour Filtering and Distance Transformation." Quality Software (QSIC), 2012 12th International Conference on. IEEE, 2012. [17] He, Guan-Feng, et al. "Real-time gesture recognition using 3D depth camera. "Software Engineering and Service Science (ICSESS), 2011 IEEE 2nd International Conference on. IEEE, 2011. [18] Biswas, K. K., and Saurav Kumar Basu. "Gesture Recognition using Microsoft KinectR." Automation, Robotics and Applications (ICARA), 2011 5th International Conference on. IEEE, 2011. [19] Ren, Zhou, Junsong Yuan, and Zhengyou Zhang. "Robust hand gesture recognition based on finger-earth mover''s distance with a commodity depth camera." Proceedings of the 19th ACM international conference on Multimedia. ACM, 2011. [20] Ren, Zhou, et al. "Minimum near-convex decomposition for robust shape representation." Computer Vision (ICCV), 2011 IEEE International Conference on. IEEE, 2011. [21] Ren, Zhou, Jingjing Meng, and Junsong Yuan. "Depth camera based hand gesture recognition and its applications in Human-Computer-Interaction." Information, Communications and Signal Processing (ICICS) 2011 8th International Conference on. IEEE, 2011. [22] Ren, Zhou, et al. "Robust hand gesture recognition with kinect sensor. "Proceedings of the 19th ACM international conference on Multimedia. ACM, 2011. [23] Li Yi. "Hand gesture recognition using Kinect." Software Engineering and Service Science (ICSESS), 2012 IEEE 3rd International Conference on. IEEE, 2012. [24] http://www.apostar.com.tw/ptgrey.html [25] Jimenez, Javier, et al. "Biography of Louis Braille and invention of the braille alphabet." Survey of ophthalmology 54.1 (2009): 142-149. [26] http://www.ntl.edu.tw/lp.asp?CtNode=759&CtUnit=256&BaseDSD=7 &mp=10 國語點字自學手冊 [27] 點字符號彙編,張訓誥主持,教育部編,民國89年。 [28] http://www.ntl.edu.tw/ct.asp?xItem=1866&ctNode=759&mp=10國語點字記號 [29] http://www.openni.org/, OpenNI官方網站 [30] http://blog.candescent.ch/2011/03/finger-tip-detection-part-2.html, K-Means分群演算法 [31]http://nicolas.burrus.name/index.php/Research/KinectCalibration影像校正
摘要: 
手勢在人機互動中是最自然且最簡單的溝通方式,並且科技發達使手勢操控更容易實現,因此手勢成為近期熱門的研究議題。Kinect for Xbox 360是近幾年最常用來抓取手勢的深度感應器,它的出現讓非接觸式的操控容易執行,並且讓肢體操控在遊戲與生活中也越來越常見,只因它有著低成本與品質不錯的深度影像。
本篇論文主要將手勢與盲人點字結合,利用左手與右手的大拇指、食指、中指取代盲人點字的六點點字,讓視障者不須重新學習並且能快速適應操作方式。方法過程為利用Kinect for Xbox 360來擷取深度影像,設一段深度區間獲取手勢轉成二值影像即使在複雜的背景之下,轉成二值影像可使後續的影像處理變得簡單快速,接著影像經形態學處理過後再執行手腕切割,再完成偵測指尖個數後即可進行手勢辨識,加上語音撥放提供驗證。

Hand gesture in Human-Computer-Interaction is the most natural and easiest way to communicate. Furthermore, that is the easy way to achieve gesture control due to technology advancements. Thus, that’s the reason why hand gesture is a hot research topic recently. Moreover, Kinect for Xbox 360 of 3D depth sensing is usually being used to get hand gesture image. Because of cheap and depth image in high-quality, Kinect makes non-contact control easier to execute and body control more common in the games.
In this paper, we propose hand gesture recognition method through combining hand gesture and Braille by using thumb, index finger and middle finger of both of hand to replace six dots of Braille. Braille let visually impaired people don’t need to re-learn and quickly adapt to operation. First of all, the procedure of method is convert depth image obtained from Kinect sensor into binary image by setting threshold, even though background is complex. The advantage of binary image is that the subsequent image processing becomes simple and rapid. Secondly, hand shape segmented by cutting hand’s wrist in the image after morphological image processing. Finally, executing hand gesture recognition with voice playback to provide authentication when fingertip detection finished.
URI: http://hdl.handle.net/11455/4903
其他識別: U0005-0708201316593400
Appears in Collections:通訊工程研究所

Show full item record
 
TAIR Related Article

Google ScholarTM

Check


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.