Roundtable 5
Harnessing Innova4on Opportuni4es from
Open Data and Big Data
Co-‐Chairs:
Roger Longhorn
Secretary-‐General, Global Spa6al Data Infrastructure (GSDI) Associa6on
www.gsdi.org
Contact: [email protected] / [email protected]
Gabor Remetey-‐Fülöpp
Secretary General, Hungarian Associa6on for Geo-‐informa6on (HUNAGI)
www.hunagi.hu
Contact: [email protected]
Relevances from the keynotes
QEEII Conference Center London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference 2
•
Neil Thompson:
Data availability is an issue
: 60% vs 38% in previous year
•
Jane Dickerson:
Content,
Context, Conveience, Consequences Principles of
Robert Cardello (NGI).
Flexible sharing, full interoperability, 4mely service and
mul4-‐na4onal partnership
–
Stuart Blundel’ interven4on (Exelis, based on ad hoc discussion with the next si^ngs): agencies
should not compete with private sector but leveraging their services
•
Éric Laliberté: clear
vision and strategy
is prepequisite for successful
implementa4on (the case of CSA)
•
Dan Jablonsky (DigitalGlobe): set up some dedicated
homeland security areas
where also Open and Big Data play important role
•
Robert B, Murec (INSCT):
expanded range of sensors and data management are
needed to handle the global commons: air, space, high seas and cyber.
Challanges include how to get more with less, commin/data transfer, data
sharing
•
Craig Clarke:
OSINT Impact of the social media
: smart phones 2005 – 2014
•
Anne Cathrine Frostrup (Kartverk)
importance of availability, accessibility and
usability of reliable geospa4al data
Agenda
•
Introduc4on
•
Open Data Issues and Challenges
•
Open Data Discussion – Key Issues
•
Big Data Issues and Challenges
•
Big Data Discussion – Key Issues
Introduc4on
QEEII Conference Center London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference 4
•
What is Open Data?
Open Defini4on from the Open Knowledge Founda4on:
–
defines “openness” in rela4on to data and content,
–
precisely defines “open” in the terms “open data” and “open
content”,
–
ensures interoperability (shared access) between different
collec4ons of open material.
“A piece of data or content is open if anyone is free to use, reuse,
and redistribute it — subject only, at most, to the requirement to
a;ribute and/or share-‐alike.”
Introduc4on
•
What Open Data defini4on covers?
•
Access
•
Redistribu4on
•
Reuse
•
Absence of Technological Restric4on
•
Acribu4on
•
Integrity
•
No Discrimina4on Against Persons or Groups
•
Distribu4on of License
•
License Must Not Be Specific to a Package
•
License Must
Open Data Policies
QEEII Conference Center London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference 6
The G8 Open Data Charter
•
Principle 1 – Open Data by default
•
Principle 2: Quality and Quan4ty
•
Principle 3: Usable by All
•
Principle 4: Releasing Data for Improved Governance
GEO/GEOSS Data Sharing Principles
•
G
EO – mandate for the 2nd decade to implement GEOSS, a global,
coordinated, comprehensive and sustained System of Observa4on
Systems
providing informa4on for the benefit of the society (9 dedicated Society
Benefit Areas)
•
Implementa4on requirement: se^ng up Data Sharing Principles
–
Recognizing Relevant Interna4onal and Na4onal Policies and Legisla4on
•
Data and Products (space based and in situ) at minimum 4me delay
and minimum cost
•
Free of Charge
or
Cost of reproduc6on
for research and edu
Objec4ve: improve coordina4on, avoid duplica4on, provide easier and
more open data access, foster use, building capacity and iden4fy gaps
Source: Douglas Cripe (PhD), Group on Earth Observa4ons (GEO) Secretariat at IGIT2015, 16
January, 2015 Székesfehérvár, Hungary
www.earthobserva4ons.org
GSDI involvement in GEO ac4vi4es
Integrated Geo-‐spa4al Informa4on and Interoperable Services
supported by Global Spa4al Data Infrastructure Associa4on (GSDI)
www.gsdi.org
,
www.igs.org
GSDI delegates since 2007 (FGDC, CIESIN, Esri, HUNAGI)
ac4ve in
Data Sharig Principles
Architecture and Data Com
User Interface Com
GEO Common Infrastructure
Plenaries
Ministerial Summits
(*)
Roundtable 5 on Open Data and Big Data Defense Geospatial Intelligence Conference
GSDI World Conference lRocerdam
CEOS WGISS CODATA, GEO_OGC (*) GSDI Statement to
Cape Town Declara4on GSDI Statement to At GEO V Bucarest
GSDI contribu4on at GEO VIII Istanbul
GSDI Statement at GEO X Foz Do Iguazu
(*) GSDI Statement at GEO X Geneva GSDI delegate at GEO IV 2007 GSDI delegate at GEO IX 2012 GSDI delegate at GEO VIII 2011 GSDI delegate at GEO VII 2010 GSDI delegate at GEO X 2014 GSDI delegate at GEO V 2008 (*) GSDI Statement at GEO VII Beijing
Regiona/cross borderl EURISY, DanubeRegStrategy
QEEII Conference Center London, 20 January 2015
GSDI World Conference Singapore
GSDI World Conference Quebec City
GSDI World Conference Addis Ababa
The European Open Data Policy
Roberto Viola of DG Connect said in an interview to EUROGI in
Ocober 2014
–
It is an4cipated, that the opportunity to innovate with GI
will largerly increased thanks to the revision of PSI
direc4ve the legal cornerstone of the Open Data Ini4a4ve
–
The new rules to be implemented by July 2015
–
All the public data should become re-‐usable as default at
no or much less costs
–
Expected impact on the governmental agencies such as
cadastre
The European Open Data Policy
QEEII Conference Center London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference 10
Open data and its economic impacts
Authen4c overview made by the representa4ve of the DG CNECT Dr.Márta Nagy-‐
Rothengass at
Open Data Open Source for GI Session, EUROGI Imagine Conference in October 2014
•
EU is towards a data-‐driven economy. Open data is significant part of it. The big data market
rises from 10 bn € to 50 bn € between 2011-‐2015 and revolu4onises the decision making
•
Open data offers opportuni4es for growth, jobs, becer quality, becer efficiency and
innova4ve services and develops ecosystems across the economy and society
•
Open govt’l data: an untapped business est. 140 bn € in the former EU28, Becer governance,
empower ci4zens, address societal challenges and accelerate scien4fic progress
•
Industry involvement is a key (PPP is open – join it!)
•
The EU Open Data Strategy – milestones incude: EC Communica4onon Open Data (2011),
Revision of PSI Direc4ve (2013) Guidelines on PSI re-‐use (July 2014).
•
Now we are speaking on
EU open data infrastructure
•
Research and Innova4on funding available to foster cross-‐sectral re-‐use with merging
different types of data
Open Data Issues and Challenges
What data should be made public?
1.
Economic drivers
–
Recent studies reveal the value to economies of opening up public datasets for
unrestricted use, including commercially.
2.
Principles for governance of society
–
Reactive versus proactive release of government data?
–
Privacy concerns
–
Existing regulations
How to make data publicly ‘open’?
Lessons learned by the EU PSI Direc4ve
How to efficiently implement and monitor Open Data policy?
–
Voluntary v mandatory? Regula4ons? Infringements to be applied?
How to judge the effec4veness of an Open Data policy?
–
Defining effec4veness benefits for Gov, Society and business? Cost-‐Benefit Analysis
Open Data Issues and Challenges
QEEII Conference Center London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference 12
Some academic viewpoints
Open Source, Open Data and Content are founda4ons for Open Educa4onal Resources
(Prof. J. Strobl, Salzburg Uni):
Open educa4onal resources are considered as a transforma4onal and poten4ally
disrup4ve game changer
Stages are: spa4al literacy, spa4al awareness and spa4al thinking
Open educa4onal resources not equal open educa4on
Need to share a higher level: not only data but knowledge as well
Open data and content(Prof. P.Baumann Jacobs Uni):
Outreach to science, communi4es and ci4zens.
New, advanced technical solu4ons helps database visualiza4on, parallel/distributed
query processing, secured archive integra4on
ISO standard for mul4-‐dimensional spa4o-‐temporal arrays has been approved
Note: Open Source Open Data at the FOSS4G (Seoul) &
FOSS4G-‐Europe (PoliMi Como, July, 2015)
Big Data Issues and Challenges
Intergeo 2015 Berlin 17,000 professionals
•
In focus: UAVs,/UASs
•
S4ll lack of legisla4on
keeping privacy
ESA Big Data Conference
Frasca4, November 2014
ISDE and ICSU CODATA
Conference in Beijing
July, 2014
(Science related)
GEO-‐OGC Think Tank
in Frasca4, Sept 2013
, w
GISS-‐37,38, 2014
EUROGI policy paper on Big and Linked Data
(GI-‐related)
QEEII Conference Center London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Big Data Issues and Challenges
Data
acqusi4on,
Data from posi4oning, Earth observa4on, imaging, social networks,
ci4zen science
Processing
and Analysis
Facebook 300 petabytes of data (daily increase: 600 TB)
Google web index: 100 PB , 600 queries/s) Data Torrent can process 1.5 bn events per second
Use of extremely large and realistcally complex datasets, real-‐4me
cross-‐stream analysis
Management and Service
Legal framework,Interoperability, Data sharing, Capacity building,
Collabora4on, Usability: 4mely, reliable, ready to support in
temporaly cri4cal decision (eg. Disaster response or other
homeland security measures)
Big Data Discussion – Key Issues
•
Homeland security
(disaster management, rescue and mi4ga4on cri4cal
infrastructures, land, water, etc) suppor4ng solu4ons):
•
Dynamic real-‐4me loca4on-‐ and object to object communica4on–based services
Sensor webs, RFIDs, IoTs (enabling traceabili4y) in transporta4on, logis4cs,, animal
and plant health, food security, human health monitoring – unique digital
iden4fiers
•
Integrated and interoperable indoor-‐outdoor posi4oning and
naviga4on
(for orienta4on support, rescue opera4on)
•
Mobile GI, crowdsourcing, VGI, social networks, autonomous
data collec4on, UAVs,/UUVs,
real-‐4me data flows from ubiquitous sensors
•
Need for Strategy
, (Coordina4on, Implementa4on, Collabora4onfor major Societal
Benefit Areas)
•
Need for appropriate legisla4on
(e.g. UAVs keeping privacy as much as possible)
•
Need for awareness raising
(role of NGOs, e.g. EUROGI policy paper) and PPPs.
•
Need for Capacity Building in Big Data Analitycs
•
Need for Research and Innova4on
QEEII Conference Center London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Research needs and programmes
Background on the EU Horizon 2020 RTD Programme
Topic ICT-‐16 2015 "Big Data: Research”
•
Scope
•
Expected impact
•
Challenges and issues to be addressed
•
The Horizon 2020 Big Data ‘Ac4on’ (Budget: 561 M EUR)
•
Research and Innova4on ac4ons
References
QEEII Conference Center London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference 18
Background on the EU Horizon 2020 RTD Programme. Topic ICT-‐16 2015 "Big
Data: Research" Handout. Please ask copy by email from the moderators.
Addi6onal references from the moderators incl.:
Shared and Open Data – European efforts
23
rdICSU CODATA Conference, Taipei
Oct 27-‐31, 2012
(with K.Janssen KU.Leuven and C. Bamps EUROGI
Roger Longhorn
Open Data Meets Big Data
Thank you for your par4cipa4on!
Dr Gábor Remetey-‐Fülöpp,
Secretary General, Hungarian Associa6on
for Geo-‐informa6on (HUNAGI) –
www.hunagi.hu
Contact:
Roger Longhorn
Secretary-‐General, Global Spa6al Data Infrastructure (GSDI)
Associa6on –
www.gsdi.org
