WSEAS Transactions on Communications

Print ISSN: 1109-2742
E-ISSN: 2224-2864

Volume 16, 2017

Notice: As of 2014 and for the forthcoming years, the publication frequency/periodicity of WSEAS Journals is adapted to the 'continuously updated' model. What this means is that instead of being separated into issues, new papers will be added on a continuous basis, allowing a more regular flow and shorter publication times. The papers will appear in reverse order, therefore the most recent one will be on top.

Human-Machine Interfaces Using Fuzzification of Facial Movements to Remotely Control Robots by means of Xmpp Internet Protocol

AUTHORS: Jesus A. Romualdo Ramirez, Enrique Mendez Franco, David Tinoco Varela

Download as PDF

ABSTRACT: Currently there is a great development with respect to the creation of different types of human-machine interfaces that allow interacting people with electronic, mechanical or computational elements. Today, these interfaces are necessary due to the large number of technological aspects with which we find ourselves daily, being able to have control of technologies as diverse as remote control toys, industrial robots, and even fully automated houses. Classic interfaces present designs that require cumbersome or complex elements when they are used, resulting in rigid and unnatural communication with the devices we want to control, in addition, they may not be tools that can be easily usable by people who do not count with prior technical knowledge, or even by persons who have physical disabilities Due to the aforementioned, it is necessary to generate human-machine interfaces that present natural interaction between the entities involved, as well as being easy to use by any type of person, without the need for prior specialized training or the need for physical manipulation to its use. This work shows the development of an interface that can control a remote device by characterizing facial movements using fuzzy logic. Creating a natural interaction between the individual and the device to be controlled. This implementation is able to establish a remote communication with any electronic device through the Internet via XMPP protocol, which gives a dynamism of control over virtually any geographical position in the world where exist an Internet connection, in this way, it is possible to be able to integrate it into the Internet of things.

KEYWORDS: Human-machine interfaces, Fuzzy controllers, XMPP, facial movements


[1] Zadeh, L. A. Fuzzy sets. Information and control, 8(3), 338-353, 1965.

[2] Cubero, S., Aleixos, N., Moltó, E., GómezSanchis, J., & Blasco, J. Advances in machine vision applications for automatic inspection and quality evaluation of fruits and vegetables. Food and Bioprocess Technology, 4(4), 487- 504, 2011.

[3] Bertozzi, M., Broggi, A., Cellario, M., Fascioli, A., Lombardi, P., & Porta, M. Artificial vision in road vehicles. Proceedings of the IEEE, 90(7), 1258-1271, 2002.

[4] Bertozzi, M., Broggi, A., & Fascioli, A. Vision-based intelligent vehicles: State of the art and perspectives. Robotics and Autonomous systems, 32(1), 1-16, 2000.

[5] Dobelle, W. H. Artificial vision for the blind by connecting a television camera to the visual cortex. ASAIO journal, 46(1), 3-9, 2000.

[6] Chader, G. J., Weiland, J., & Humayun, M. S. Artificial vision: needs, functioning, and testing of a retinal electronic prosthesis. Progress in brain research, 175, 317-332, 2009.

[7] Youssif, A. A., & Asker, W. A. Automatic facial expression recognition system based on geometric and appearance features. Computer and Information Science, 4(2), 115, 2011.

[8] Uke, N., & Thool, R. Moving vehicle detection for measuring traffic count using opencv. Journal of Automation and Control Engineering, 1(4), 2013.

[9] Pulli, K., Baksheev, A., Kornyakov, K., & Eruhimov, V. Real-time computer vision with OpenCV. Communications of the ACM, 55(6), 61-69, 2012.

[10] Saint-Andre, P. Extensible messaging and presence protocol (XMPP): Core, 2011.

[11] Atzori, L., Iera, A., & Morabito, G. The internet of things: A survey. Computer networks, 54(15), 2787-2805, 2010.

[12] Upton, E., & Halfacree, G. Raspberry Pi user guide. John Wiley & Sons, 2014.

[13] Maksimović, M., Vujović, V., Davidović, N., Milošević, V., & Perišić, B. Raspberry Pi as Internet of things hardware: performances and constraints. Design issues, 3, 8, 2014.

[14] Bose, B. K. Expert system, fuzzy logic, and neural network applications in power electronics and motion control. Proceedings of the IEEE, 82(8), 1303-1323, 1994.

[15] Castro, J. L. Fuzzy logic controllers are universal approximators. IEEE transactions on systems, man, and cybernetics, 25(4), 629-635, 1995.

[16] Zadeh, L. A. Fuzzy logic=computing with words. IEEE transactions on fuzzy systems, 4(2), 103-111, 1996.

[17] Isermann, R. On fuzzy logic applications for automatic control, supervision, and fault diagnosis. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 28(2), 221-235, 1998.

[18] Pires, G., & Nunes, U. A wheelchair steered through voice commands and assisted by a reactive fuzzy-logic controller. Journal of Intelligent & Robotic Systems, 34(3), 301-314, 2002.

[19] Wu, D. Fuzzy sets and systems in building closed-loop affective computing systems for human-computer interaction: Advances and new research directions. In Fuzzy Systems (FUZZ-IEEE), 2012 IEEE International Conference on (pp. 1-8). IEEE, 2012.

[20] Ilbeygi, M., & Shah-Hosseini, H. A novel fuzzy facial expression recognition system based on facial feature extraction from color face images. Engineering Applications of Artificial Intelligence, 25(1), 130-146, 2012.

[21] Chaudhary, A., Raheja, J. L., Das, K., & Raheja, S. Intelligent approaches to interact with machines using hand gesture recognition in natural way: a survey. arXiv preprint arXiv:1303.2292, 2013.

[22] Rautaray, S. S., & Agrawal, A. Vision based hand gesture recognition for human computer interaction: a survey. Artificial Intelligence Review, 1-54, 2015.

[23] Ye, C., Yung, N. H., & Wang, D. A fuzzy controller with supervised learning assisted reinforcement learning algorithm for obstacle avoidance. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 33(1), 17-27, 2003.

[24] Kim, D., & Jeon, D. Fuzzy-logic control of cutting forces in CNC milling processes using motor currents as indirect force sensors. Precision Engineering, 35(1), 143- 152, 2011.

[25] Shamir, L. Human Perception-based Color Segmentation Using Fuzzy Logic. IPCV, 2, 96- 502, 2006.

[26] Feng, G. A survey on analysis and design of model-based fuzzy control systems. IEEE Transactions on Fuzzy systems, 14(5), 676-697, 2006.

WSEAS Transactions on Communications, ISSN / E-ISSN: 1109-2742 / 2224-2864, Volume 16, 2017, Art. #13, pp. 94-106

Copyright © 2017 Author(s) retain the copyright of this article. This article is published under the terms of the Creative Commons Attribution License 4.0

Bulletin Board


The editorial board is accepting papers.

WSEAS Main Site