Integrated Face and Pose Identification with Facial Sketch through SIFT Matching Algorithm

© 2016, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal

| Page 1457

Integrated Face and Pose Identification with Facial Sketch through SIFT

Matching Algorithm

Author 1-Namrata Chandraker,

Author 2 -Neelabh sao

MTech Student (Software Engineering)

Rungta College of Engineering and Technology

Bhilai (C.G.), India

[email protected]

Assistant Professor (computer science)

Rungta College of Engineering and Technology

Bhilai (C.G.), India

[email protected]

Abstract

: -

This paper presents a completely unique

facial sketch image or face-sketch recognition

approach supported facial feature extraction. To

acknowledge a face-sketch, we've targeting a group of

geometric face options like eyes, nose, eyebrows, lips,

etc and their length and breadth magnitude relation as

a result of it's troublesome to match photos and

sketches as a result of they belong to 2 completely

different modalities. during this system, 1st the facial

features/components from coaching pictures square

measure extracted, then ratios of length, width, and

space etc. square measure calculated and people

square measure keep as feature vectors for individual

pictures. Subsequently the mean feature vectors square

measure computed and subtracted from every feature

vector for centering of the feature vectors. Within the

next part, feature vector for the incoming probe

face-sketch is additionally computed in similar fashion.

Here, NN classifier is employed to acknowledge probe

face-sketch. it's by experimentation verified that the

planned technique is powerful against faces square

measure in a very frontal create, with traditional

lighting and neutral expression and haven't any

occlusions. The experiment has been conducted with

eighty male and feminine face pictures from

completely different face databases. Its helpful

applications for each enforcement and digital

diversion

.

Key point- Viola Jones algorithm, SIFT algorithm,

nearest neighbor classifier.

1 INTRODUCTION

© 2016, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal

| Page 1458

It is renowned that viewing a person’s eyes, mouth is

crucial to grasping the knowledge and emotions they

convey and face parts like eyes, nose, eyebrows, lips,

etc along describe the general form of the face.

Because of nice distinction between face picture and

face-sketch it's out of the question to match directly,

thus during this system comparison has been done

solely between facial components/features of face

photos and face-sketches. Lots of works on biometric

identification and facial feature extraction are

according in . However, because of the good

distinction between sketches and photos and

therefore the unknown psychological mechanism of

sketch generation, face sketch recognition is way

tougher than traditional face recognition supported

picture pictures. It’s troublesome to match photos

and

sketches

in

2

completely

different

modalities.[28]

There was solely restricted analysis work on face

sketch recognition as a result of this drawback is

harder than photo-based face recognition and no

massive face sketch information is offered for

experimental study. ways directly mistreatment

ancient photo-based face recognition techniques like

the eigenface ways and therefore the elastic graph

matching ways were tested on 2 terribly tiny sketch

information sets with solely seven and thirteen

sketches, severally. In, a face sketch synthesis and

recognition

system

mistreatment

eigentransformation was projected. In projected a

nonlinear face sketch synthesis and recognition

methodology. It followed the similar framework as in.

The disadvantage of this approach is that the native

patches square measure synthesized severally at a

hard and fast scale and face structures in massive

scale, particularly the face form, can't be well learned.

In projected Associate in nursing approach

mistreatment Associate in Nursing embedded hidden

Andrei Markov model and a selective ensemble

strategy to synthesize sketches from photos. The

transformation was conjointly applied to the total

face pictures and therefore the hair region was

excluded. In, projected a face sketch synthesis and

recognition approach supported native face

structures at completely different scale employing a

Andrei Markov Random Fields model. However the

disadvantage of this approach is that it needs a

coaching set containing photo-sketch pairs. In

projected ways for extraction of facial expression. In,

projected Associate in Nursing example-based face

cartoon generation system. it had been conjointly

restricted to the road drawings and needed the

proper match between photos and line drawings in

form. These systems relied on the extraction of face

form mistreatment face alignment algorithms like

Active look Model (AAM) . These line drawings

square measure less communicative than the

sketches with shading texture.[28]

© 2016, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal

| Page 1459

parameter inside the face that is that the length

between upper-lip and therefore the naris. as a result

of some folks have tiny nose and a few folks have

massive nose. That the length between higher lip and

naris are completely different. Throughout face

sketch recognition stage, 1st facial expression square

measure extracted from coaching photos so notice

their length or breadth or space. at that time

represent every image options as a vector, if there

square measure n pictures then there'll be n vectors

and for every vector, the mean of the vectors square

measure computed and deducted from every feature

vector to induce a group of vectors referred to as

zero-mean vector. Second, facial expression square

measure extracted from input face sketch pictures in

similar manner that of face picture pictures and hold

on as a vector. this is often conjointly focused with

relevance mean computed earlier. Third, a renowned

classifier, K-NN classifier has been employed in a

simple thanks to acknowledge input sketch. Here,

we've thought of K=5 and geometrician distance live.

The experiment has been conducted on eighty male

and feminine face pictures from completely different

face information. Section II describes the general

system style, details of the experiments conducted

alongside results square measure given in section III,

and section IV concludes the paper.[28]

2 LITERURE REVIEW

2.1 William Robson Schwartz, , HuiminGuo, , Jonghyun Choi, and Larry S. Davis, in this paper present Identification Using Large Feature Sets With the intention of matching unknown faces in opposition to a gallery of regarded human beings, the face identity undertaking has been studied for several many years. There are very accurate strategies to perform face identification in managed environments, mainly when large numbers of samples are available for every face. but, face identity underneath out of control environments or with a lack of education facts remains an unsolved trouble. We rent a large and wealthy set of function descriptors (with greater than 70 000 descriptors) for face identification the usage

of partial least squares to carry out multichannel characteristic weighting. Then, we amplify the technique to a tree-based discriminative shape to lessen the time required to assess probe samples. The technique is evaluated on Facial recognition generation (FERET) and Face popularity Grand mission (FRGC) data units. Experiments display that our identity method outperforms contemporary modern-day consequences, mainly for figuring out faces obtained throughout various conditions [7].

2.2 Heng Yang and Ioannis Patras, in this paper present Regression Forest Votes for Facial Feature Detection in the Wild recommend a way for the localization of multiple facial capabilities on challenging face picas. In the regression forests (RF) framework, observations (patches) which can be extracted at numerous image places cast votes for the localization of several facial features. so as to filter out out votes that are not relevant, we skip them through two styles of sieves, which can be organized in a cascade, and which enforce geometric constraints. the primary sieve filters out votes that aren't consistent with a hypothesis for the vicinity of the face middle. Several sieves of the second kind, one associated with every man or woman facial point, filter out distant votes. We advocate a technique that adjusts on the- fly the proximity threshold of every 2d type sieve by way of applying a classifier which, based on center-stage capabilities extracted from vote casting maps for the facial function in query, makes a series of decisions on whether or not the brink should be decreased or not. We validate our proposed technique on two difficult datasets with snap shots collected from the net in which we achieve country of the artwork results without resorting to express facial shape models. We also show the blessings of our approach for proximity threshold adjustment specifically on ’difficult’ face pix.[26]

© 2016, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal

| Page 1460

to conventional algorithms, EGM has 3 blessings: (1) an

affine-invariant shape constraint is found out on line from similar exemplars to better adapt to the take a look at face; (2) the most excellent landmark configuration may be immediately acquired by fixing a graph matching trouble with the learned from constraint; (three) the graph matching trouble can be optimized effectively by way of linear programming. To our first-rate knowledge, that is the primary try and observes a graph matching approach for facial landmark localization. Experiments on several difficult datasets demonstrate the Advantages of EGM over state-of-the-art methods. [27]

2.4 Akshay Asthana1 Stefanos Zafeiriou1 Shiyang Cheng1 Maja Pantic , in this paper present a Robust Discriminative Response Map Fitting with Constrained , singular discriminative regression based totally technique for the limited nearby models (CLMs) framework, Referred to as the Discriminative response Map becoming (DRMF) approach, which suggests fantastic performance inside the everyday face becoming state of affairs. The inducement at the back of This approach is that, in contrast to the holistic texture based functions used within the discriminative AAM methods, the reaction map can be represented with the aid of a small set of parameters and these parameters may be very efficiently used for reconstructing unseen reaction maps. Furthermore, we show that through adopting quite simple off-the-shelf regression strategies, it is feasible to examine strong functions from response maps to the form parameters updates. The experiments, performed on Multi-PIE, XM2VTS and LFPW database, display that the proposed DRMF technique outperforms state of- the-art algorithms for the assignment of everyday face fitting. Furthermore, the DRMF approach is computationally very green and is actual-time capable. The current MATLAB implementation takes 1 2nd consistent with image. To facilitate future comparisons, we launch the MATLAB code1 and the pertained [8]

3

. FACE SKETCH RECOGNITION USING FACIAL

FEATURE EXTRACTION

In this section, the system description for sketch face recognition supported facial feature extraction is given. We have a tendency to divide this section into 2 parts: (i)

face expression extraction and analysis and (ii) recognition task.

3.1 Facial Features Extraction

To explain an character, usually we will be inclined to use his/her function options like eye, eyebrow, lips, nostril, hair, face cutting, and many others as normal description. The face description that our gadget accepts has been decided with the aid of a psychological look at. The observe exhibits that seven facial components, in particular Face slicing, right eye, proper hair, Left eye, Left hair, nose, Lip ar normally referred in describing a person's face .projected a gadget FIDA that maps photos in associate current data to a 14-dimensional descriptive function location victimization soft ax regression. In . projected a machine FASY for creation of human faces from remember description anyplace they need notion-about seven facial components like Face cutting, right eye, right hair, Left eye, Left hair, nostril and Lip for construction of face.

In the present work, we have considered eight facial features which are shown in below.

 Face Cutting: Area of face.  Left Eye: Length, Width.  Right Eye: Length, Width.  Left Eyebrow: Length.  Right Eyebrow: Length.  Nose: Length.

 Lip: Length, Width, Area.

 Distance between upper-lip and nostril [28]

IV METHODILOGY

Train data Test data

Region cropping SIFT Matching Image Sketch conversion Preprocessing Region cropping Feature of matching key point Stores reduce Technic SIFT Classify Region cropping Sketch conversion Pre Processing Image

© 2016, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal

| Page 1461

3.1.1 Preprocessing

Earlier than extraction of the facial features some preprocessing tasks on training images and take a look at comic strip face are wanted. within the preprocessing step, photos are in coloration, first transformed the RGB colour to the grey degree snap shots and all of the faces are cropped with the size of a hundred and fifty × 2 hundred pixels. Fig.1 suggests (a) colour photo, (b) corresponding gray photo, (c) corresponding cropped photo. [28]

3.1.2 REGION CROPPING

Extraction methodology: -inside the gift work, to understand a face-sketch, extraction of facial thing from images of human faces is required. The appearance of facial components are one-of-a-kind from each different. It isn't viable to extract all of the facial additives with one algorithm. Consequently, we have designed separate set of rules for every facial factor. the first and the maximum crucial step in facial component detection is to track the location of the eyes. Thereafter, the symmetry belongings of the face with appreciate to the eyes is used for tracking relaxation of the components like eyebrows, lips, and nose. right here we've got used a geometrical model proven in fig to expect the vicinity of hobby or the approximate positions where the facial components can also seem and then the real regions of the facial components are extracted by making use of the right algorithms over the area across the predicted areas. here, we have considered two points (x1, y1) and (x2, y2) because the co-ordinates of the pinnacle left nook and bottom proper corner of the expected square place for each facial component. all of the calculations for the predicted areas in the geometrical version, used on this paper, are represented with recognize to the width W and the length L of the face, in which W is defined in terms of the variety of columns and L is described in phrases of the number of the rows

3.1.3 FEATURES OF MARCHING KEY POINTS-

SIFT Algorithm SIFT basic step as described in , consists of four major stages: (1) scale-space peak selection; (2) keypoint localization; (3) orientation assignment; (4) keypoint descriptor. Inside the first degree, capacity interest elements are diagnosed thru scanning the picture over place and scale. this is implemented correctly with the resource of manner of building a Gaussian pyramid

and seeking out network peaks (termed keypoints) in a series of difference-of-Gaussian (dog) pictures. Within the 2nd degree, candidate keypoints are localized to sub-pixel accuracy and removed if located to be risky. The 1/3 identifies the dominant orientations for each keypoint primarily based on its neighborhood image patch. The assigned orientation(s), scale and location for every keypoint let’s in SIFT to bring together a canonical view for the keypoint this is invariant to similarity transforms. The final stage builds a community picture descriptor for each keypoint, based definitely upon the picture gradients in its neighborhood network (referred to beneath in greater detail). The primary 3 tiers will no longer be noted similarly in this paper for the reason that our paintings makes no contributions to the photo.

3.1.4 Classify

© 2016, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal

| Page 1462

notably lowering garage and searching for expenses at

check time.

4 EXPERIMENTAL RESULTS

In this part, we offer our experimental results. We have divided our experimental result into 2 components. the primary one shows the results for extraction of the facial elements and the other shows the acknowledge faces adore the face-sketch.

4.1 Experimental Result for extraction of the

facial components

-

For extraction of the facial components, we have used geometric approach. we have examined this method on 80 male and female face pictures. The photos are gathered from CUHK schooling cropped images face database. Suggests some woman and male face picas amassed from CUHK education cropped picas face database. To eleven suggests the predicted area for some of the facial components for face pictures. right here we've additionally shown some face-sketches and their expected place for numerous facial components. Fig.6 suggests some male and lady face-caricature collected from CUHK education cropped sketches database. To sixteen shows the some of the predicted place for facial additives for comic strip faces. The overall performance measure for extraction of the facial components has been achieved by the equation 1.The fulfillment rate for extraction of facial additives from face photo and face sketch given in desk-1

Fig.5 (A)-(D) Face photos from CUHK training cropped database

Fig.6 (A1)-(D1) face sketches from CUHK training cropped sketches database

Fig.7 Extraction of right eyes from face photos

Fig.8 Extraction of right eyebrows from face photos

Fig.9 Extraction of lips from face photos

[image:7.612.36.244.135.222.2]

© 2016, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal

| Page 1463

Fig.11 Extraction of actual nose region from predicted

region

Fig.12 Extraction of left eyes from face-sketches

[image:7.612.36.256.253.343.2]

Fig.13 Extraction of left eyebrows from face-sketches

[image:7.612.37.236.486.571.2]

Fig.14 Extraction of lips from face-sketches

Fig.15 Extraction of predicted region of nose from face-sketches

Fig.16 Extraction of actual nose region from predicted region

4.2 Experimental result for Recognize a face

sketch

In this section, we've given a snap to acknowledge a question face-sketch through face picture info. In our system, input may be a face-sketch and output is 5 face photos that are best matching with input question face-sketch and rank them one to five. In table-II, we tend to compare our projected methodology with Eigen face methodology and Sketch rework methodology. The leads to table-II clearly show the advantage of our methodology over these 2 ways. first the first} match for Eigen face methodology is not any quite half-hour and fifth rank is not any quite hour and therefore the 1st match for Sketch rework methodology is not any quite seventy fifth and fifth rank is not any quite ninetieth. Our methodology greatly improves the first match to eightieth and fifth match to ninety two.4%. In Fig, shows the question face-sketch and Fig. eighteen shows the experimental result that shows 5 face photos (in order) that ar best matching with the question face-sketch. In among the 5 face photos, original face picture comparable to the question face sketch shows within the Figure two image .

VI CONCLUSION

[image:7.612.36.215.621.685.2]

© 2016, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal

| Page 1464

REFERENCES

1. Cohn Y, Tian J, Kanade T: Recognizing action units for facial expression analysis. IEEE Trans. Pattern Anal. Mach. Intell 2001, 23[2]:97-114. 10.1109/34.908962

2 Pantic M, Rothkrantz LJM: Automatic analysis of facial expressions: the state of the art. IEEE Trans. Pattern Anal.

Mach. Intell 2000, 22(12):1424-1445. 10.1109/34.895976

3 Heng Yang*, Renqiao Zhang* and Peter Robinson, Human and Sheep Facial Landmarks Localization by Triplet Interpolated Features, RESEARCH · SEPTEMBER 2015

4. Xiaowei Zhao, Shiguang Shan, Xiujuan Chai, Xilin Chen, Cascaded Shape Space Pruning for Robust Facial Landmark Detection I, in CVF pages 1033- 1040 ,2013

5. Park U, Jain AK: 3D face reconstruction from stereo images. In Proc. of Int. Workshop on Video Processing for

Security. Quebec City, Canada; 2006:41-4

6. Salah , Alyüz N, Akarun L: Registration of 3D face scans with average face models. J. Electron. Imag. 2008, 17(1):011006. 10.1117/1.2896291

7 William Robson Schwartz, HuiminGuo, Jonghyun Choi,

Larry S. Davis , Face Identification Using Large Feature Sets, in IEEE, pages 2245-2255

8 Akshay Asthana1 Stefanos Zafeiriou1 Shiyang Cheng1 Maja Pantic Robust Discriminative Response Map Fitting with Constrained d, pages 3444- Local Models, in ICCV 3451, 2013

9. Wiskott L, Fellous JM, Kruger N, von der Malsburg C: Face recognition by elastic bunch graph. IEEE Trans. Pattern Anal. Mach. Intell1997, 7: 775-779.

10. Heng Yang1, Wenxuan Mou2 ,Yichi Zhang3 ,Ioannis Patras2 , Computer Laboratory University of Cambridge Cambridge, UK Face Alignment Assisted by Head Pose Estimation

11. Dornaika F, Davoine F: Online appearance-based face and facial feature tracking. In Proc. of Int. Conf. on Pattern

Recognition. Washington, DC, USA; 2004:814-817.

12. Cohn J, Zlochower A, Lien JJJ, Kanade T: Feature-point tracking by optical flow discriminates subtle differences in

facial expression. In Proc. of IEEE Int. Conf. on Automatic Face and Gesture Recognition. Nara, Japan; 1998:396-401

13. Qi Zhu 1, Daoqiang Zhang 1, Han Sun 1, Zhengming Li 2 Combining L1-norm and L2-norm based representations for face recognition , in INTERNATIONAL JOURNAL FOR LIGHT AND ELECTRON OPTICS · APRIL , pages 2015

14Parkinson B: Do facial movements express emotions or communicate motives? Pers. Soc. Psychol. Rev 2005, 9: 278-311. 10.1207/s15327957pspr0904_1

15 Ekman P, Friesen WV: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Palo Alto: Consulting Psychologists Press; 1978.

16 Akakın HÇ, Sankur B: Robust classification of face and head gestures in video. Image Video Comput 2011, 29: 470-483. 10.1016/j.imavis.2011.03.001View Article

17 Bailenson J, Pontikakis E, Mauss I, Gross J, Jabon M, Hutcherson C, Nass C, John O: Real-time classification of evoked emotions using facial feature tracking and physiological responses. Int. J. Hum.-Comput. Stud 2008, 66(5):303-317. 10.1016/j.ijhcs.2007.10.011View Article d, pages 3444- Local Models, in ICCV 3451, 2013

18Pentland A, Moghaddam B, Starner T: View-based and Modular Eigen spaces for Face Recognition. In Proc. of IEEE Int. Conf. on Computer Vision and Pattern Recognition. Seattle, Washington; 1994. pp. 84–91

19. Heisele B, Ho P, Poggio T: Face recognition with support vector machines: global versus component-based approaches. In Proc. of IEEE Int. Conf. on Computer Vision. Vancouver, British Columbia, Canada; 2001:688-694

20. Shi J, Samal A, Marx D: How effective are landmarks and their geometry for face recognition? Comput. Vis. Image Understand. 2006, 102: 117-133. 10.1016/j.cviu.2005

21. Tong Y, Ji Q: Multiview facial feature tracking with a multi-modal probabilistic model. In Proc. of Int. Conf. on

Pattern Recognition. Washington, DC, USA; 2006:307-

© 2016, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal

| Page 1465

23. Wieghardt RPW J, von der Malsburg C: Gabor-based

feature point tracking with automatically learned constraints. In Proc. of European Conferenceon Computer

Vision. Copenhagen; 2002.

24. Teijeiro-Mosquera L, Alba-Castro JL: Performance of active appearance model-based pose-robust face recognition. Comput. Vis 2011, 5(6):348-357. 10.1049/iet-cvi.2010.018

25. Hu Y, Zhou M, Wu Z: A dense point-to-point alignment method for realistic 3D face morphing and animation. Int. J.

Comput. Games Technol 2009, 2009: 9.

26. Heng Yang, Ioannis Patras, Sieving Regression Forest Votes for Facial Feature Detection in the Wild, in ICCV , pages 1936-1943 ,2013

27. Feng Zhou , Jonathan Brandt, Zhe Lin, Exemplar-based Graph Matching for Robust Facial Landmark Localization, in ICCV, pages 1025-1032, 2013