Report
Survey of Attributes Annotation for Persons on the Web Proposal of Attribute for the evaluation
January/15/2007
Satoshi Sekine (New York University)
We are planning to make a new task of “attribute extraction” on Web People Search (WePS) task. In order to decide the “set of attributes” for the evaluation, we conducted a survey of attributes using WePS data, and made a proposal of “attribute classes”.
Overview
This is a report on what attributes of people on the web can be found. All datasets of this survey consist of collections of Web People Search data (WePS), obtained from 60 - 100 results for four person name. If information about the person exists in the obtained pages or pages linked to them, values of attributes are searched among those pages. If the annotators find a value of an attributes, it will be recorded. The attribute names are created by the annotators, if there is not an explicit attribute name in the page.
The names and the number of the data from which at least one attributes are extracted are as follows (So this total is the base of the statistics):
NAME Number of Data
Andrew Powell 72
Thomas Baker 33
Young Dawkins 29
Paul Collins 22
TOTAL 156
Names used in this survey
Based on the survey, we propose 16 attribute classes to be used for the evaluation. The detail follows.
Attributes
Attributes are very different from page to page and people to people. For example, musicians
have “name of songs” as an attributes, but architect has “building names” as an attribute. By annotating a
page, the annotators usually extract attribute by those names, however, once we overlook the results,
those attributes can be merged by the name of “work”. By looking at the entire annotated results, we created 123 attributes, as shown in the following table. In the table, frequency is counted one for each page, even if there are many values for the attribute mentioned in the page (i.e. if there are 100 songs in the page, the frequency of attribute “song” is counted as one). So the percentage indicates what percentage of the pages the attributes exist.
Attribute Class
The annotated attributes are so diverse and large. For example, “wife”, “father”, “mother” etc can be merged into “relatives”. Also, we don’t want have minor or domain dependent attributes, otherwise it will be very hard to make a system to extract attributes. In order to make the number of possible attributed in a manageable number and meaningful for the evaluation on WePS-2, we made a draft proposal for the “class of attributes.
No. Attribute Class Total freq.
Attributes
1 Date of birth 21 Date of birth
2 Birth place 24 Birth Place/Hometown
3 Other name 56 Full name, nickname
4 Occupation 141 Occupation/Position/Title, Previous Occupation/Position 5 Affiliation 83 Affiliation, Previous Affiliation
6 Work 70 Work
7 Award 26 Award/Honour, Result of competition
8 Education 79 Alma Mater, Academic Degree, Major 9 Mentor 48 Person to work with, Teacher/Coach/Boss
10 Location 63 Location, Previous Location
11 Nationality 5 Nationality
12 Relatives 45 Wife/Fiancee, Child, Father, Mother, Brother/Sister
13 Phone 27 Phone number
14 FAX 11 FAX number
15 Email 25 Email
16 Web site 13 Web site
Proposed Attributes for the evaluation
Attribute Class (Proposal)
F. % Examples of Value
1 Occupation/Position/Title Occupation 116 74.4 plastic surgeon, record producer, Dr., chair
2 Work Work 70 44.9 Bohemian Rhapsody, Studs Terkel
3 Affiliation Affiliation 70 44.9 UNH Foundation, American Law Institute 4 Full Name Other name 55 35.3 David Andrew Powell, Young Dawkins III 5 Person to Work with Mentor 41 26.3 James M. Stuzin, Alan Parsons
6 Alma Mater Education 41 26.3 Dartmouth College, Clewiston HS 7 Location Location 39 25.0 Arizona, Los Angeles
8 Date of Work 38 24.4 1973, 1984, 2000
9 Phone Number Phone 27 17.3 305-348-8342, (254) 791-5353, 905 473 5640 10 Previous Occupation/Position Occupation 25 16.0 Assistant Operations Officer, reporter, editor 11 E-mail Address Email 25 16.0 [email protected],[email protected] 12 Previous Location Location 24 15.4 England, Ohio, Hilton Head Island
13 Birthplace/Hometown Birth place 24 15.4 Lanchester, Durham, Toronto, England 14
Award/Honor Award
23 14.7 GE Edison Award of Merit, National Honor Society
15 Date of Birth DOB 21 13.5 September 14, 1656, 1737 16 Academic Degree Education 21 13.5 M.D., B.S., J.D.
17
Specialization/Skill 18 11.5 Insurance Law, Electrical and Illumination Engineering
18 Major Education 17 10.9 archaeology, trombone
19 Wife/Fiancee Relatives 16 10.3 Teresa, Eliza, Phoebe Ann Yates 20 Web Site Web site 13 8.3 http://www.tombakerlaw.com
21 Previous Affiliation Affiliation 13 8.3 University of London, Central Bank of Argentina 22 Date of Academic Degree 11 7.1 1968, 1978, 1980
23 Child Relatives 11 7.1 Jacob Baker, Abigail Jackson, Dennis 24 Fax Number FAX 11 7.1 410-332-1682, (616) 752-4607 25 Father Relatives 8 5.1 Bernie, Humphrey, Lewis
26 Competition 7 4.5 the NCAA Championships, the Six Nations 27 Teacher/Coach/Boss Mentor 7 4.5 Stockhausen, Data, Blake
28 Mother Relatives 6 3.8 Sarah Wood, Beverly Mary HICKERSON 29 Role on Music Work 6 3.8 production, mixing, keyboard
30 Hobby/Interest 6 3.8 Drums, fishing, contemporary electronic music 31 Date of Award/Honor 5 3.2 1989, 1999, 2000
32 Publisher of Work 5 3.2 Lexis-Nexis Publishing Co, Thomson Learning
33 Nationality Nationality 5 3.2 English
34 Conference to Present at 5 3.2 Face To Face Technology Symposium 35 License/Certification 5 3.2 Pediatric Cardiology, Commercial Pilot
36 Age 4 2.6 20-year-old, 36-year-old, 37
37 Class 4 2.6 Sr, Senior, Junior
38 Age in Previous Location 4 2.6 14
39 Date of Marriage 4 2.6 June, 1855, about 1849, 2370 40 Brother/Sister Relatives 4 2.6 John, George, Sandra Baker
41 Starship 4 2.6 USS Enterprise-D.
42 GPA 4 2.6 3.52, 3.46, 2.7
43 Genre of Work 3 1,9 Rock
44 Number of Works 3 1.9 6000, 1000
45 Industry 3 1.9 Online Media, Staffing and Recruiting 46 Date of Death 3 1.9 November 3, 2000, July 2, 1746 47 Result of Competition Award 3 1.9 the gold medal, champion, fourth 48 Hospital of Internship 3 1.9 Children's Hospital Boston
49 Hospital of Residency 3 1.9 Children's Hospital Boston 50 Hospital of Fellowship 3 1.9 Children's Hospital Boston 51 Friend/Teammate 3 1.9 Sweet Jelly Fontaine, A. Johnson
52 Show 3 1.9 Beat Night with Larry Simon
53 Date of Conference 3 1.9 2002, 2003, Tuesday, April 29, 2003
54 Player Host 2 1.3 Curtis Stowers
55 Period of Occupation 2 1.3 25 years
56 Date of Show 2 1.3 11 JUL 04
57
Deathplace 2 1.3 Estill Co., Kentucky, Clinton, Sampson Co., NC
58 Occupation of Wife 2 1.3 Nurse
59 Date of Birth of Wife 2 1.3 5 MAR 1974, May 1834 60 Birthplace of Wife 2 1.3 Silver Spring, MD, Moscow 61 Date of Birth of Father 2 1.3 1790, 2-8-1953
62 Date of Birth of Child 2 1.3 24 MAR 1994, Dec 04, 1932
63 Media to Appear on 2 1.3 LAW.COM, C-SPAN
64
State to Admit 2 1.3 Maryland and U.S. Court of Appeals, British Columbia
65 Date of Admittance 2 1.3 1999, 1973
66 Date of Joining Affiliation 2 1.3 1996
67 Date of Competition 2 1.3 07/15/2006, 2000
68 Species 2 1.3 Human
69 Actor to Play 2 1.3 Brian Demonbreun
70 Episode 2 1.3 TNG 271 - Genesis
71 Similar Artist 2 1.3 Vangelis, Trevor Jones
72 Height 2 1.3 6-foot-1
73 Weight 2 1.3 305 pounds
74 Bench Max 2 1.3 360 pounds
75 Squat Max 2 1.3 450 pounds
76 Running Time 2 1.3 3:40.65, 5.2 secs
77 Sponsor 2 1.3 BAE SYSTEMS, Columbia Management Group
78 Topic of Talk at Conference 2 1.3 Making the Case for the Academic Unit 79 Nickname Other name 1 0.6 Baron von Nosegay
80 Period of Previous
Occupation 1 0.6 20 years
82 Year of Class 1 0.6 2003
82 Date of Joining Previous
Affiliation 1 0.6 1983
83 Branch Office 1 0.6 Temple Office, Killeen Office 84 Museum Displaying Work 1 0.6 Fine Arts Museum of San Francisco 85 All-time Record for
Attainment 1 0.6 single-year and consecutive-year fundraising totals
86 Venue of Show 1 0.6 The Cornelia Street Café 87 Address of Venue of Show 1 0.6 29 Cornelia Street, NYC
88 Running Time of Work 1 0.6 55-minute
89 Conference to Sponsor 1 0.6 Baker Gordon Symposium on Cosmetic Surgery 90 Date in Previous Location 1 0.6 19 June to 7 July 1944
91 Nationality of Parents 1 0.6 Welsh
92 Age at Death 1 0.6 67
93 Cause of Death 1 0.6 heart attack
94 Place of Marriage 1 0.6 Severn, MD (Ann Arundel Co)
95 Date of Divorce 1 0.6 1975
96 Date of Birth of Wife 1 0.6 11-14-1960 97 Date of Death of Wife 1 0.6 April 27, 2005
98 Birthplace of Child 1 0.6 Laurel, MD (Prince George's Co) 99 Date of Death of Child 1 0.6 September 28, 1849
100 Date of Birth of
Brother/Sister 1 0.6 8-14-1994
101 License Number 1 0.6 145624
102 Date of License/Certification 1 0.6 1996
103 Date of Internment 1 0.6 2000/7/12
104 Tribe 1 0.6 the Blackfoot tribe
105 Meaning of Name 1 0.6 “Rue Monsieur Paul Collins” in Senegal 106 Judge of Competition 1 0.6 Christine Walker
107 Language 1 0.6 English, Spanish
108 Company Reviewing Work 1 0.6 Boston Globe, Rocky Mountain News
109 Vertical 1 0.6 25 inches
110 Jersey Number 1 0.6 94
111 Career Points 1 0.6 70
112 Career Assists 1 0.6 50
113 Season Assists 1 0.6 32
114 Reviewed Movie 1 0.6 Alien
115 Favourite Track 1 0.6 Brands Hatch
116 Racing Car 1 0.6 Royale RP26 Pink Panther
117 Date of Racing Car 1 0.6 1979
118 Engine Tuner 1 0.6 Powell Speed
119 Course 1 0.6 Tech Calculus I, The Arts
120 Original Dish 1 0.6 mushroom bonanza sandwich
121 Opponent 1 0.6 Thurston
122 Campaign 1 0.6 The Next Horizon
123 Date of Campaign 1 0.6 1999