The Biometric Evaluation And Testing (BEAT) platform

(1)

(2)

Utrecht – Netherland, 03.02.2015

Didier Meuwly

Principal scientist, NFI

Forensic biometrics chair, UT

UNIVERSITY OF TWENTE.

Faculty of Electrical Engineering,

Mathematics and Computer Science

The Biometric

Evaluation And Testing

(BEAT) platform

A solution for a

data privacy and

open data policy

(3)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

The Biometric Evaluation And Testing

(BEAT) platform 03.02.2015

Outline

N

etherlands Forensic Ins2tute

C

asework

– R

&D

– E

duca2on

F

orensic Biometrics

D

eﬁni2ons

M

odali2es

F

inger, face, speaker, so> biometrics (body measurements)

S

cenarios

I

D veriﬁca2on, intelligence, inves2ga2on, evalua2on

(4)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Outline

R

eproducible forensic biometric research

B

EAT plaGorm

M

ain objec2ves

L

egal aspects

D

ata protec2on/privacy, intellectual property

T

echnical aspects

S

ecurity, user management

C

onclusion

(5)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Netherlands Forensic Ins2tute

@NFI.nl

F

ocuses on criminalis2cs

M

akes use of science

for criminal inves2ga2on

and evidence evalua2on

5

Staff

0 175 350 525 700 2001 2003 2005 2007 2009 2011 0 22500 45000 67500 90000 2001 2003 2005 2007 2009 2011

Cases

A

n integrated model

Products

and services

R&D

Innovation

Education

& Training

(6)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

6

Digitale Technologie en Biometrie

1200

Front O

ﬃ

ce

300

Forensisch Chemisch Onderzoek 8000

Humane Biologische Sporen

41600

Microsporen

1300

Medisch Forensisch Onderzoek 2900

Netherlands Forensic Ins2tute

(7)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

P

roducts

& services

R

&D

E

duca2on

and training

Main tasks

7

I

nterna2onal

United nations

International criminal court

International forensic

institutes

International Criminal

Tribunal Former Yugoslavia

Special Tribunal Lebanon

Court special Sierra Leone

International agency for

Nuclear Energy

International organisation for

migration

Prosecution

Law enforcement

Defense ministery

Secret services

Antitrust

Customs

Tax services

Immigrations

services

D

utch

(8)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

P

roducts

& services

R

&D

E

duca2on

and training

Main tasks

8

R

eal 2me, on site chemical iden2ﬁca2on

F

orensic recogni2on and individualisa2on

B

ig Data and Intelligent Data Analysis

F

rom source to ac2vity

A

dvancing Forensic Medicine

C

SI Innova2ons

C

BRN Forensics

E

merging technologies

(9)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Main tasks

Casework

R&D

Educa2on

Main tasks

9

N

FI and other prac22oners

D

utch and interna2onal law enforcement

prac22oners (police and legal)

U

niversity students (MSc, PhD) Amsterdam,

Leiden, Twente

E

uropean Network of Forensic Science

Ins2tutes (ENFSI)

(10)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

10

B

iometric data:

means any personal data rela2ng to the physical,

physiological or behavioural characteris2cs, such as facial

images or dactyloscopic data, which allow to recognise

individuals to a certain degree, depending on the:

-‐

M

odality: a complete ﬁngerprint is more discriminant

than a complete facial image

-‐

Q

uality of the data: a ﬁngerprint is more discriminant

than a ﬁngermark

-‐

A

pplica2on: an open set of 500 millions of people is

more challenging than a closed set of 10 persons

(11)

F

orensic biometrics:

H

uman-‐based and computerised biometric methods used

to analyse and interpret forensic biometric traces to:

–

D

emonstrate the existence of an oﬀence

–

I

nves2gate an oﬀense

–

D

escribe the modus operandi (ac2vity level inference)

–

I

ndividualise a perpetrator (source level inference)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

11

(12)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Forensic biometrics modali2es

(13)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Forensic biometric scenarios

13

Biometric

Trace

Intelligence

Forensic

evaluation

IDentity

verification

Investigation

Criminal

jus2ce ID

management

List of M candidates

Trace

Reference

DataBase

Strength of evidence

Trace

ﬁngermark

ﬁngerprint

Suspect

Disaster Vic2m

Iden2ﬁca2on

(DVI)

(14)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Reproducible

forensic biometric research

One terms that aggregates work comprising of:

A

publica2on describing a scien2ﬁc experiment in all

relevant details

C

ode to reproduce all results

D

ata required to reproduce the results

P

rotocols to interpret the results

I

nstruc2ons on how to apply the code-‐data-‐protocol

to replicate the results on the paper

(15)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

15

Reproducible Research (RR)

R

esults

(16)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

16

Data privacy

Standardisation

Intellectual Property

(17)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

17

Data privacy

Standardisation

Intellectual Property

(18)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Data Privacy and Protec2on

E

nsure professional and social security principles

D

emonstrate legal and regula2on compliance

E

nsure

security and privacy of data owners

P

romote awareness at personal and organisa2on level

E

nsure safe handling of available data

E

nsure con2nuity in the use of data

P

revent unsafe use and leakage of data

M

aintain incidents to an acceptable level

(19)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Take the measures – Create the condi2ons

19

Availability

Integrity

Confidentiality/exclusivity

Law and

regulation

Business

continuity

Security awareness

M

easures

P

reven2ve

D

etec2ve

R

epressive

C

orrec2ve

C

ondi2ons

P

olicy

O

rganiza2on

H

uman-‐

centered

P

hysical

T

echnical

(20)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Common criteria evalua2on

20

T

ippet plot

D

etec2on Trade-‐oﬀ Curve

(DET)

(21)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Hardware -‐ So>ware compa2bility

21

(22)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Biometric Evalua2on And Tes2ng

B

eat PlaGorm main objec2ves

F

ramework for standard opera2onal evalua2ons of

biometric technologies

E

valuate

performance

of biometric technology

E

valuate

vulnerabili2es

of biometric systems

E

valuate

privacy preserva2on

mechanisms

Standardise

protocols and documents (

cer2ﬁca2on

)

O

ther legal aspects (IPR)

22

(23)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

B

EAT infrastructure in forensic environment

23

F

orensic

B

iometric

S

ystems

B

iometric data

F

ingerprints

F

ace images

A

udio recordings

beat-eu.org

B

EAT back-end server

B

iometric data

(finger, face, speech)

F

orensic scenarios

C

omputer power

B

EAT front-end server

A

lgorithms uploader

R

esults downloader

R

esults publisher

(24)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

B

EAT infrastructure for forensic research

24

B

EAT back-end server

B

iometric data

F

orensic scenarios

C

omputer power

B

A

lgorithms uploader

R

esults downloader

R

esults publisher

F

orensic

B

iometric

S

ystems

B

iometric data

F

ingerprints

F

ace images

A

udio recordings

beat-eu.org

(25)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

beat-eu.org

B

25

B

EAT back-end server

B

iometric data

F

orensic scenarios

C

omputer power

B

A

lgorithms uploader

R

esults downloader

R

esults publisher

Developed algorithms

F

orensic

B

iometric

S

ystems

B

iometric data

F

ingerprints

F

ace images

A

udio recordings

Research

(26)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

beat-eu.org

B

26

B

EAT back-end server

B

iometric data

F

orensic scenarios

C

omputer power

Uploaded algorithms

B

A

lgorithms uploader

R

esults downloader

R

esults publisher

F

orensic

B

iometric

S

ystems

B

iometric data

F

ingerprints

F

ace images

A

udio recordings

Research

(27)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

beat-eu.org

B

EAT infrastructure for forensic development

27

B

EAT back-end server

B

iometric data

F

orensic scenarios

C

omputer power

Uploaded algorithms

B

A

lgorithms uploader

R

esults downloader

R

esults publisher

F

orensic

B

iometric

S

ystems

B

iometric data

F

ingerprints

F

ace images

A

udio recordings

Develop-

ment

Research

(28)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

beat-eu.org

B

28

B

EAT back-end server

B

iometric data

F

orensic scenarios

C

omputer power

Uploaded algorithms

B

A

lgorithms uploader

R

esults downloader

R

esults publisher

F

orensic

B

iometric

S

ystems

B

iometric data

F

ingerprints

F

ace images

A

udio recordings

Selected algorithms

Develop-

ment

Research

(29)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

B

29

B

EAT back-end server

B

iometric data

F

orensic scenarios

C

omputer power

Uploaded algorithms

B

A

lgorithms uploader

R

esults downloader

R

esults publisher

NEW F

orensic

B

iometric

S

ystems

B

iometric data

F

ingerprints

F

ace images

A

udio recordings

Selected algorithms

Develop-

ment

Research

beat-eu.org

(30)

U

ser and time

management

U

ser and time

management

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

beat-eu.org

30

B

EAT back-end server

B

iometric data

F

orensic scenarios

C

omputer power

Uploaded algorithms

B

A

lgorithms uploader

R

esults downloader

R

esults publisher

NEW F

orensic

B

iometric

S

ystems

B

iometric data

F

ingerprints

F

ace images

A

udio recordings

Selected algorithms

Develop-

ment

Research

Biometric Evalua2on And Tes2ng

P

hysical and

network security

I

ntellectual

property

(31)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

beat-eu.org

31

B

EAT back-end server

B

iometric data

F

orensic scenarios

C

omputer power

Uploaded algorithms

B

A

lgorithms uploader

R

esults downloader

R

esults publisher

Developed algorithms

NEW F

orensic

B

iometric

S

ystems

B

iometric data

F

ingerprints

F

ace images

A

udio recordings

Selected algorithms

Develop-

ment

Research

EU-Open

data policy

✔

EU-data

privacy

✔

Biometric Evalua2on And Tes2ng

(32)

R

&D current and future projects

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

32

B

EAT back-end server

B

iometric data

F

orensic scenarios

C

omputer power

Uploaded algorithms

B

A

lgorithms uploader

R

esults downloader

R

esults publisher

NEW F

orensic

B

iometric

S

ystems

B

iometric data

F

ingerprints

F

ace images

A

udio recordings

Selected algorithms

Develop-

ment

Research

beat-eu.org

Data protection of

fingermark/prints in

forensic science

LLM thesis

UTilburg-NFI 2014

Chloe Baartmans

Physical and

network security of

the BEAT

infrastructure

Master thesis

U?-NFI 2016

X - Y

Fingerprint databases

Speaker databases

Face databases

NFI intern projects

Fingermark interpretation tool

Speaker recognition tool

NFI intern projects

W

orldw

i

de

R

esearch

E

nvironment

EU-project proposal – 2015

(33)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Conclusion

F

orensic biometric R&D need

T

o select the most appropriate biometric technology for

forensic systems (inves2ga2on, intelligence, evalua2on, ID

veriﬁca2on)

B

iometric data for R&D and casework

A

data protec2on and privacy framework

P

hysical and network security

C

ompa2ble so>ware and hardware

C

ommon criteria for evalua2on

(34)

T

he BEAT plaGorm oﬀers a solu2on for reproducible

research

Online open plaGorm to test biometric technology in forensic

scenarios

Data security, protec2on and privacy

Management and 2me monitoring of the users of the data

Validated benchmarks

Sustainability of the ressources through the availability and

security of the data, experiments, results and protocols

Management of the Intellectual Property Rights used and

created in the the BEAT plaGorm

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Conclusion

(35)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Credits

Results

Dr. Rudolf Haraksim, University of Lausanne, Switzerland

BEAT-‐WIRE

Dr. Sébas2en Marcel, IDIAP, coordinator BEAT and WIRE

Dr. André Anjos, IDIAP, BEAT plaGorm designer

NFI data protec2on and privacy

Dhr. Joop Bijlsma, NFI, adviseur Integrale Beveiliging

(36)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

Tijd voor vragen

(37)

(38)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

38

Abstract

In het kader van zakenonderzoek en R&D processen maakt Het Nederlands Forensisch

Instituut (NFI) gebruik van biometrische gegevens. De primair vraag aan het NFI, in

verband met biometrische gegevens is: wie is de bron van het spoor? Dit maakt dat

het primaire doel van het NFI is om de bewijskracht van een biometrische spoor

te kunnen toewijzen, op basis van de vergelijking van dit spoor met een referentie

monster van een persoon, meestal verdachte of slachtoffer in een strafrechtelijke

zaak. Met de term spoor kan bijvoorbeeld gedacht worden aan een vingerspoor, een

gezicht/foto of een stemopname.

Een van de R&D programma's van het NFI heet “Forensic Recognition and

individualisation”. Meerdere R&D projecten focusen zich op het kunnen toewijzen van

een meer objectieve bewijskracht, op basis van biometrische vergelijkingstechnologie

en grote aantallen gepseudonimiseerde biometrische data.

Echter zelfs al zijn biometrische gegevens gepseudonimiseerd, blijft de privacy van de

betrokkene tot wie deze biometrische gegevens behoren in het geding. Met deze reden

is het NFI op zoek naar een duurzame oplossing om parallel aan het hanteren van een

open data policy, gegevensbescherming te kunnen hanteren.

(39)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

39

Abstract

bezig met de ontwikkeling van een platform dat ook beide aspecten

(gegevensbescherming/privacy en open data policy) integreert. Het concept van BEAT

is het gebruik maken van de gegevens zonder direct toegang te verschaffen aan deze

gegevens. Het BEAT platform biedt ook belangrijke operationele oplossingen voor het

forensische biometrische R&D proces:

- de fysieke en netwerk beveiliging van de biometrische gegevens,

- de management en tijd monitoring van de gebruikers van de gegevens,

- de mogelijkheid voor reproduceerbare forensische onderzoek door een online open

platform om biometrische systemen in forensische scenarios (opsporing, intelligence,

bewijsvoering, identiteit verificatie) transparant en onafhankelijk te kunnen evalueren

tegen gevalideerde benchmarks,

- de duurzaamheid van de middelen door de constant beschikbaarheid en beveiliging

van de gegevens, de experimenten, de resultaten, het ontwerpen van protocollen en

instrumenten voor de kwetsbaarheid van de analyse, en het ontwikkelen van

standaardisatie documenten voor Common Criteria evaluaties.

- de aanpak van de intellectuele eigendom die in het kader van BEAT worden gebruikt

en gecreëerd.

(40)

Didier Meuwly

UNIVERSITY OF

TWENTE.

EEMCS

40

CV

Didier Meuwly is born in 1968 in Fribourg, Switzerland. After a classical education (Latin/

Philosophy), he graduated (1993) and obtained his PhD (2000) at the School of Forensic

Science (IPS) of the University of Lausanne.

Currently he shares his time between the Forensic Institute of the Ministry of Security and

Justice of the Netherlands (NFI) where he is a principal scientist and the University of

Twente where he holds the chair of Forensic Biometrics. He specialises into the automation

and validation of the probabilistic evaluation of forensic evidence, and more particularly of

biometric traces. He was previously the leader of a project about the probabilistic

evaluation of fingermark evidence, and responsible of the fingerprint section within the

NFI.

From 2002 to 2004, he worked as a senior forensic scientist within the R&D department of

the Forensic Science Service (UK-FSS), at the time an executive agency of the British

Home Office.

From 1999 to 2002 he was responsible of the biometric research group of the IPS.

He is also a founding member of 2 working groups of the European Network of Forensic

Science Institutes (ENFSI): the Forensic Speech and Audio Analysis Working Group

(FSAAWG) in 1997 and the European Fingerprint Working Group (EFPWG) in 2000. He is

still active within the EFWPG. He is also a member of the editorial board and a guest editor

of Forensic Science International (FSI).

NFI.nl

beat-eu.org