1
FACIAL EXPRESSION AND RECOGNITION USING LOCAL DIRECTIONAL NUMBER PATTERN
Ms.A.Kanimozhi1., Dr.R.C.Karpagalakshmi, Ph.D2.,
PG Scholar, Department of Computer Science, Gnanamani College of Technology, Tamilnadu1 Professor, Department of Computer Science, Gnanamani College of Technology, Tamilnadu2 ABSTRACT
A
n early native feature descriptor, Local Directional Number pattern (LDN), because rear analysis, i.e., face and expression recognition. LDN encodes the directional data regarding the face’s textures (i.e., the texture’s structure) among a tight way, producing a more discriminative code than current methods. We tell the structure regarding every micro-pattern including the aid concerning a range masks as extracts directional information, then we encode certain information the usage of the prominent route indices (directional numbers) and sign as approves to us after discriminate among comparable structural patterns up to expectation hold different intensity transitions. We part the surface of quite a few regions, and then suck the parceling regarding the LDN capabilities from them. Then, we concatenate it services in a feature vector, then we makes use of it as much a back descriptor. We operate quite a few experiments, within which our descriptor performs constantly below illumination, noise, expression, and epoch lapse variations. Moreover, we check our descriptor with unique masks to analyze its overall performance among distinctive back evaluation duties.Key Words: emotion recognition, mobile applications, feature extraction, local binary pattern. 1. INTRODUCTION
Face analysis has a diverse range concerning applications, particularly biometric authentication, surveillance, human-computer interaction, or multimedia management. Due in conformity with the limitless possibility over its software or the pastime generated, lookup yet development in automated surface
analysis which consist on surface cognizance or appearance awareness follows naturally. A helpful descriptor holds a excessive difference amongst classes i.e. among one of a kind individuals then expressions, but tiny yet no variation within classes i.e. equal man or woman then exposure between distinctive conditions. These descriptors are chronic within a number of areas, such as, facial issue
2 yet rear recognition. Local Directional Number Pattern (LDN) acts as a rear descriptor for recognizing strong faces yet encodes the facts associated in accordance with structural and depth variants regarding the face’s texture. The structure of a regional neighborhood is encoded by means of analyzing its directional information. This demand bill represents a approach because of back and facial expression consciousness extra successfully then Herculean as compared after the existing methods. It is a young encoding scheme, named as, Local Directional range pattern (LDN) encodes correctly of a tight articles through reception expertise regarding unique structural surface textures.
2. RELATED WORK
Due to the ongoing growth along with the extensive use of smart phones, services and applications, emotion recognition is becoming an essential part of providing emotional care to people. Provisioning emotional care can greatly enhance users’
experience to improve the quality of life. The conventional method of emotion recognition may not cater to the need of mobile application users for their value-added emergent services. Moreover, because of the dynamicity and heterogeneity of mobile applications and services, it is a challenge to provide an emotion recognition system that
can collect, analyze, and process emotional communications in real time and highly accurate manner with a minimal computation time.
There exist a number of emotion recognition systems in the literature. The emotion can be recognized from speech, image, video, or text. There are many applications of the emotion recognition in mobile platforms. In mobile applications, for example, the text of the SMS can be analyzed to detect the mood or the emotion of the users. Once the emotion is detected, the system can automatically put a corresponding ‘emoji’ in the SMS. By analyzing a video in the context of emotion, a smart phone can automatically change the wallpaper, or play some favorite songs to coop with the emotion of the user. The same can be applied using oral conversation through a smart phone; an emotion can be detected from the conversational speech, and an appropriate filtering can be applied to the speech.
Fig-1 System Architecture
3 3. EXISTING SYSTEM
In the literature, there are many methods for the holistic class, such as, Eigenfaces and Fisherfaces, which are built on Principal Component Analysis (PCA); the more recent 2D PCA and Linear Discriminate Analysis. These methods are Local Features Analysis, Gabor features, Elastic Bunch Graph Matching, and Local Binary Pattern (LBP).
The LBP feature that was originally designed for texture description, applied to face recognition. The last method encodes the directional information in the neighborhood, instead of the intensity.
The use of higher order local derivatives (LDeP) to produce better results than LBP. Both methods use other information, instead of intensity, to overcome noise and illumination variation problems.
Disadvantages
• However, these methods still suffer in non-monotonic illumination variation, random noise, and changes in pose, age, and expression conditions.
• Although some methods, like Gradient faces, have a high discrimination power under illumination variation, they still have low recognition capabilities for expression and age variation conditions.
4. PROPOSED SYSTEM
In this paper, we endorse a back descriptor, Local Directional Number Pattern (LDN), because of Herculean surface recognition up to expectation encodes the structural statistics and the intensity versions regarding the face’s texture. LDN encodes the shape of a partial neighborhood by using examining its directional information.
Consequently, we count the facet responses in the neighborhood, between eight one of a kind directions together with a gyre mask. Then, from every the directions, we pick the top advantageous or negative directions in conformity with birth a meaningful descriptor because exclusive textures together with comparable structural patterns. Hence, our strategy conveys more facts of the code, and such is greater close so such is six bit long.
We discovered up to expectation the inclusion more than one encoding levels produces an improvement in the discovery process. Newer methods tried to overcome the shortcomings of LBP, like Local Ternary Pattern (LTP), and Local Directional Pattern (LDiP).
Advantages
• The coding intention is based on directional numbers, instead on bite strings, which encodes the records on the local within a more efficient way
• The consistent makes use of concerning signal information, between evaluation
4 together with preceding directional and by-product techniques encode greater data into much less space, and, at the same time, try extra textures.
• The uses about gradient facts make the technique strong in opposition to effulgence changes and noise.
• Both methods use other information, instead of intensity, to overcome noise and clarification of the variation problems.
5. METHODOLOGIES Face recognition
In the first module, we design the system such that first the image dataset folder should be indexed by the user. After index is made, it shows the number of images in the folder which we indexed. Next the query image is selected by the user. The LH and MLH are used during the face recognition process. The objective is to compare the encoded feature vector from one person with all other candidate’s feature vector with the Chi-Square dissimilarity measure. This measure between two feature vectors, F1and F2, of length N is measured. The corresponding face of the feature vector with the lowest measured value indicates the match found.
Histogram generation
In this module, the histogram is generated based on the query image selected
from the image dataset. The horizontal axis of the graph represents the tonal variations, while the vertical axis represents the number of pixels in that particular tone. The left side of the horizontal axis represents the black and dark areas, the middle represents medium grey and the right hand side represents light and pure white areas. The vertical axis represents the size of the area that is captured in each one of these zones. Thus, the histogram for a very dark image will have the majority of its data points on the left side and center of the graph.
Conversely, the histogram for a very bright image with few dark areas and/or shadows will have most of its data points on the right side and center of the graph.
6. CONCLUSION AND FUTURE WORK
6.1 CONCLUSION
Biometric technique is very beneficial in contrast in imitation of other traditional methods kind of remembering concerning Password and PIN‟s because individual’s identity. Introduced a novel encoding scheme, LDN, that takes advantage of the structure of the face’s textures and that encodes it efficiently into a compact code. LDN uses directional information that is more stable against noise than intensity, to code the different patterns from the face’s textures.
Additionally, we analyzed the use of two different compass masks (a derivative- Gaussian and Kirsch) to extract this
5 directional information, and their performance on different applications. In general, LDN, implicitly, uses the sign information of the directional numbers which allows it to distinguish similar texture’s structures with different intensity transitions.
6.2 FUTURE WORK
Face recognition system is more useful because individual’s identity due to the using of dead few less expensive cameras and doesn’t require user lively participation or any health risks. In the proposed system we uses LDN method, as is six bit even articles attain by way of Convolving the kirsch‟s as much filter along together with Sobel Tranter along enter image. This six bit LDN code is compact as like in contrast in accordance with mean technique like LBP which is eight snack even code. This coding plan is based on the directional information, instead regarding younger piece strings, which encodes the information concerning the neighborhood in a more advantageous way.
7. REFERENCES
[1] M. Chen, Y. Zhang, Y. Li, S. Mao and V.
C. Leung. ”EMC: emotion-aware mobile cloud computing in 5G.” IEEE Network, 2015, vol. 29, no. 2, pp. 32-38.
[2] R.M. Mehmood, and H.J. Lee, “A novel feature extraction method based on late positive potential for emotion recognition in
human brain signal patterns,” Computers &
Electrical Engineering, vol. 53 , no. 2016, pp.
418-420, 2016.
[3] M. Chen, Y. Ma, Y. Hao, Y. Li, Di Wu, Y.
Zhang, E. Songet., "CP-Robot: Cloud-assisted Pillow Robot for Emotion Sensing and Interaction", In Proc. Industrialiot 2016, Guangzhou, China, Mar. 2016.
[4] M. Chen, Y. Hao, Y. Li, D. Wu, D. Huang,
"Demo: LIVES: Learning through Interactive Video and Emotion-aware System",in Proc.
ACM Mobihoc 2015 (demo paper), Hangzhou, June 22-25, 2015.
[5] M. S. Hossain, G. Muhammad, M. F. Al Hamid and B. Song, “Audio-Visual Emotion- aware Big Data Recognition towards 5G,”
Mobile Networks and Applications, vol. 21, no. 5, pp. 753-763, October 2016.
[6] M. S. Hossain, G. Muhammad, B. Song, M. M. Hassan, A. Alelaiwi and A. Almari,
"Audio-Visual Emotion-Aware Cloud Gaming Framework," IEEE Trans. Circuits Syst.
Video Technol., Vol. 25, No. 12, pp. 2105- 2118, December 2015.
[7] W. Zhang et al. ‘Deep Learning Based Emotion Recognition from Chinese Speech,”
In Proc. the 14th Intl. Conf. Inclusive Smart Cities and Digital Health - Volume 9677 (ICOST 2016), Carl K. Chang, Lorenzo Chiari, Yu Cao, Hai Jin, Mounir Mokhtari,
6 and Hamdi Aloulou (Eds.), Vol. 9677.
Springer-Verlag New York, Inc., New York, NY, USA, 49-58.
[8] C. Shan, S. Gong, and P.W. McOwan,
“Facial Expression Recognition based on Local Binary Patterns: A Comprehensive Study,” Image Vision Computing, vol. 27, no.
6, pp. 803-816, 2009.
[9] J.W. Ragsdale et al., “Recognizing Patients' Emotions: Teaching Health Care Providers to Interpret Facial Expressions,”
Acad Med. Vol. 91, no. pp. 1270-5, Sep 2016.
[10] M. S. Hossain and G. Muhammad,
“Audio-Visual Emotion Recognition using Multi-directional Regression and Ridgelet Transform,” J. Multimodal User Interfaces, vol. 10, no. 4, pp. 325-333, December 2016.
[11] S. Tivatansakul, M. Ohkura, S.
Puangpontip and T. Achalakul, "Emotional healthcare system: Emotion detection by facial expressions using Japanese database,"
Computer Science and Electronic Engineering Conference (CEEC), 2014 6th, Colchester, 2014, pp. 41-46.
[12] Y. Zhang, et al., "iDoctor: Personalized and Professionalized Medical Recommendations Based on Hybrid Matrix Factorization", Future Generation Computer Systems, vol. 66, pp. 30-35, 2017.
[13] M. Ali, A. H. Mosa, F. Al Machot and K.
Kyamakya, "EEG-based emotion recognition approach for e-healthcare applications," 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN), Vienna, 2016, pp. 946-950.
[14] K. K. Rachuri et al. “EmotionSense: a mobile phones based adaptive platform for experimental social psychology research,” In Proc. the 12th ACM international conference on Ubiquitous computing (UbiComp '10).
Copenhagen, Denmark, September 26-29, 2010.
[15] J. C. Castillo et al, “Software Architecture for Smart Emotion Recognition and Regulation of the Ageing Adult,”
Cognitive Computation, vol.8, no. 2, pp 357–
367, April 2016.
