The Future of Real Time Services Delivery for IoT

(1)

The Future of Real Time Services Delivery for IoT

Schahram Dustdar

Pacific Controls Systems, Advisory Board Member

(2)

(3)

Future ICT Services – Common Themes

Forces Shaping The Future Of ICT Services Services Usage Access Business Model Industry Structure

Innovation Shifts From Core Applications To The Edge Of The Enterprise and Analytics

• Ubiquitous, seamless open access becomes norm

• Internet of Things (IoT) drives the integration of the

physical and digital worlds

• A new generation of supplier collaboration/integration emerges on cloud/SaaS platform

• Analytics, not business applications, improve business decisions and insights

Barriers Between New Content And Services Providers And Traditional Network Providers Blur • Demand And Growth Will Shift To New Services With Higher Margins • De-coupling of network traffic and revenue

• New classes of offerings will emerge for services orchestration and services integration

• New services competitors will emerge as the lines between tech segments blur; old ones will fade

Need For Advancements Within Network and Managed Services Infrastructure

• All environments (home, office, car) are

context‐aware

• Market for ultra-low-cost devices grows

• New multi‐access wireless architectures are needed

• Radical new architectures and technologies are needed in order to cope with the massive exchange of data

“As-A-Service” Becomes The Norm

• The “per-use” pricing model with the ability to scale up and down as the business requires

• More standardized offerings with lower management overhead for the customer

• Multitenant delivery to reduce costs; and • The substitution of capex for opex outlays

• Nascent services today — security, data management, and product development — fully develop

Shared Services & Data Brokerage

• Multi-Sided business models

• Integrates diverse needs • Stages new services innovations • Creates significant differentiation

(4)

eHealth & Smart Health networks Game Machine Telephone PC DVD Audio TV STB DVC Smart Homes

Smart eGovernments & eAdministrations

Smart Energy Networks

Smart Evolution –

People, Services,Things

Elastic Systems

Smart Transport Networks

(5)

Autonomic

Nervous

System

(6)

Think Ecosystems:

People, Services, Things

Diverse users with complex networked dependencies and intrinsic adaptive behavior – has: 1. Robustness mechanisms: achieving stability in the presence of disruption 2. Measures of health: diversity, population trends, other key indicators

(7)

Pacific Controls – Connecting Cloud Computing to IoT

 From physically isolated verticals to

virtual verticals

 Software-defined elastic data centers and IoT ecosystems

 SD units are described with

well-defined API

 Provisioning units for

customized gateways

 Dynamically

composing units into runtime topologies

 Runtime controlling and optimization

via configuration

policies (DevOps principle)

(8)

Virtual verticals

• From physically isolated verticals to

virtual verticals

– Shared common software services and computing resources – Configurable IoT solutions

– Easy integration with heterogeneous IoT infrastructure – Facilitate development and delivery of new services

(9)

(10)

Ultra Large-scale IoT Pacific Controls

(11)

Some 10 to 50 billion devices and sensors exist for M2M applications

IoT and Cloud Computing enable smart services ecosystem and collaboration opportunities Managed services • Portfolio management • Event management • Analytics Provisioning • Services • SIM profile configuration • Network configuration Controls • Activation • Deactivation • Privacy • Security Transaction Mgmt. • Visibility • Billing • Reporting Integration framework Algorithm engine Chart builder Predictive modeling Incidents manager Expert rule engine FDD Service Mgmt Storage policies Database manger Operations manager Portfolio Mgmt Analyics engine Blackbox module Location awareness GUI builder Event mgmt Data mining Resource mgmt. Regression engine Open integration platform Resource manager Point metering framework

Numerous Forms Of Smart Services…

Access control Environment Compliance

Street Light Management Food Transfer

Process

Public Safety Industrial

process parameters

Parking

Control _ManagementWaste Facilities Control HealthCare Power Quality Control Lighting Control KIOSK Monitoring CCTV Monitoring

Hospitality Sector Healthcare Sector

Education Sector Transport Sector

Datacenters Government Sector

Industrial Sector _{Finance Sector}

Utilities and Smart Grid

Airports, ports and CriticalInfrastructure

(12)

Galaxy 2020

Real-Time Managed Services

Platform

 Development Platform For Edge Devices

 Complex Event-based Processing Systems

 Real-time Situational Awareness  Automated Real-time Analysis

Pacific Controls combines smart connected device management with

complex IT systems & infrastructure to create unified real-time services delivery platform that addresses diverse challenges in a single, scalable solution Vertical Apps 3rd_Party Vertical Apps 3rd_Party Vertical Apps Vertical Apps

Galaxy Core, Including Communications Governance, Database, Visualization, Integrity Rules, Metering, Billing, GBot Management & Deployment

Gbot-Enabled App Store C lo u d Mobile Devices and Workers GBot Gateways “Galaxy Ready” Need: GBot capable of processing: • Time series data • Structured data • Un-structured data • Monitoring • Control

Device Management

Vertical User Group

Telco Connect Comms Drivers Comms Drivers Comms Drivers Aggregation Device (OS) Software-Defined Machines Machine Sensor Instrument Aggregation Device (OS) Software-Defined Machines Machine Sensor Instrument API

(13)

Measurement & Verification

Continuous Commissioning

Carbon Footprint Analysis & GHG Accounting Fault Detection & Diagnostics Asset Performance Management Energy Analysis Maintenance Management Alarm Management Dashboards & Reports Boilers

UPS Pumps Generators

HVTS

Signage

ATMs

Chillers

Database Enterprise Application

Smoke Detector Occupancy Sensor Humidity Sensor Pressure Sensor Power Meter KW Meter Temperature Sensor Cameras Vehicle Tracking Device Presentation Integration End Users Facilities Management Vehicle Tracking System Fire Alarms ICT Network OEM

Third Party Application Developers Service Providers SIM FAHU AHU KW Meter Flow Meter Security System

(14)

DATA CENTER VERTICAL

RETAIL VERTICAL

LIFE & SAFETY VERTICAL SECURITY & SURVEILLANCE HOTELS VERTICAL INDUSTRIAL VERTICAL HEALTH VERTICAL BUILDINGS EDUCATIONAL VERTICAL ENERGY VERTICAL TRANSPORT VERTICAL AIRPORT VERTICAL

(15)

(16)

(17)

(18)

(19)

(20)

• Dynamic business models

• Diverse ecosystem of

stakeholders

• Wide range of cloud

services

– Infrastructure as a Service

– Sensing as a Service

– Platform as a Service

– Data as a Service

– Software as a Service

– Virtual verticals

– Third-party applications

20

Galaxy 2020

Real-Time Managed Services

Platform

(21)

21 Apache jClouds Cloud Infrastructure Cloud Platform PaaS Controller Foundation Services

Messaging Logging Security Registry

Elastic Load Balancer Cloud Controller Deployment Synchronizer Stratos Manager Load Monitor Cloud API U s e r I n te rfa c e Platform Cartridges [Cartridge] ESB [Cartridge] AS [Cartridge] DSS [Cartridge] Cassandra Application Cartridges [Cartridge] Tomcat [Cartridge] PHP [Cartridge] PostgreSQL Galaxy SOA Platform Galaxy SOA Application Apache Stratos OpenStack Cloud Infrastructure Provider Cloud provider Platform provider Customer

Galaxy 2020

Real-Time Managed Services

Platform on the Cloud

(22)

22

Use robust, widely-adopted

technologies for Cloud

Infrastructure to

facilitate underlying

infrastructure more efficiently

 Use PaaS framework to provide cloud-based

environment to build a scalable and reliable

Platform

 Offer several features for PaaS &

Verticals/Applications:

 Elastic scaling, Multi-tenancy

 Automated resource management  Platform-wide monitoring and billing  Extensibility (e.g.: cartridge mechanism) Facilitates: OpenStack and Apache Stratos

Galaxy 2020

Real-Time Managed Services

Platform on the Cloud

(23)

Using Enterprise Service Bus for customizing PaaS framework and developing further platform features and services Providing AppStore for developing and deploying customer-specific Applications Using API Management strategies to support consumer’s Applications/Verticals Scalability, Extensibility, Reliability ....

Galaxy 2020 - PaaS framework

(24)

Software-defined IoT units

• Provide software-defined API for accessing,

configuring and controlling units

• Support fine-grained internal configurations,

e.g, adding functional capabilities like different communication protocols, at runtime.

• Can be composed at higher-level, via

dependency units, creating virtual topologies

(of multiple gateways) that can be (re)configured at runtime.

• Enable decoupled and managed configuration

(via late-bound policies) to provision the units

dynamically and on-demand.

• Have utility cost-functions that enable pricing

the IoT resources as utilities.

Software-defined IoT Unit Fu n ct io n al A P I Utility cost-function

IoT resource and functionality binding Late-bound policies Infrastructure capabilities G o ve rn an ce A P I Dependency units Provisioning API Runtime mechanisms Runtime controllers (e.g, elasticity) _No n -f u n ct io n al a sp ec ts Runtime composition Fu n ct io n al a sp ec ts

(25)

Ecosystem for software-defined IoT systems

 Create an ecosystem of software-defined IoT

units for the creation of software-defined IoT

systems.

 Distributing IoT units in a market-like fashion,

e.g., via IoT AppStore.

Atomic software-defined IoT units

Custom proc. logic IoT data storage Communication In-memory image VPN Messaging Sand box Network overlay Protocol VolatileHistory Key/Value store Security Data quality Outliers filter IoT compute GW runtime Data point controller CEP Component -model Elasticity Auto scaling group controller Functional

capabilities Non-functional_capabilities

... ...

Monitor.

(26)

(27)

Elasticity ≠ Scaleability

Resource elasticity

Software / human-based computing elements, multiple clouds

Quality elasticity

Non-functional parameters e.g., performance, quality of data, service availability, human trust

Costs & Benefit

elasticity

rewards, incentives

(28)

Some diverse types of elasticity requirements…



Application user

: “If the cost is greater than 800 USD, there should be a scale-in action for keeping costs in acceptable limits”



Software provider

: “Response time should be less than amount X varying with the number of users.”



Developer

: “The result from the data analytics algorithm must reach a certain data accuracy under a cost constraint. I don’t care about how many resources should be used for executing this code.”



Cloud provider

: “When availability is higher than 99% for a period of time, and the cost is the same as for availability 80%, the cost should increase with 10%.”

(29)

Service Developer Infrastructure Provider Service Owner Service Developer

Designing and programming software-defined elastic

services

Automatic service deployment

Elasticity monitoring and analysis Elasticity Control Service Owner Infrastructure Provider Service Owner Easy to program elasticity requirements Reduced time to market

+

Easy to understand service’s elasticity boundaries

+

Maintains service’s performance while reducing cost Reduces resources overprovisioning

+

Software Defined Elastic Cloud Services

29

(30)

High Level Description of Elasticity Requirements

• SYBL (Simple Yet Beautiful

Language) for specifying

elasticity requirements

• SYBL-supported requirement

levels

1. Cloud Service Level

2. Service Topology Level

3. Service Unit Level

4. Relationship Level

5. Programming/Code Level

#SYBL.CloudServiceLevel

Cons1: CONSTRAINT responseTime < 5 ms

Cons2: CONSTRAINT responseTime < 10 ms WHEN nbOfUsers > 10000

Str1: STRATEGY CASE fulfilled(Cons1) OR fulfilled(Cons2): minimize(cost)

#SYBL.ServiceUnitLevel

Str2: STRATEGY CASE ioCost < 3 USD: maximize( dataFreshness )

#SYBL.CodeRegionLevel

Cons4: CONSTRAINT dataAccuracy>90% AND cost<4 USD

Georgiana Copil, Daniel Moldovan, Hong-Linh Truong, Schahram Dustdar, "SYBL: an Extensible Language for Controlling Elasticity in Cloud Applications", 13th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), May 14-16, 2013, Delft, Netherlands

(31)

(32)

Elasticity Model for Cloud Services Analytics

Moldovan D., G. Copil, Truong H.-L., Dustdar S. (2013). MELA: Monitoring and Analyzing Elasticity of Cloud Service. CloudCom 2013

Elasticity space functions: to determine if a service unit/service has the intended

“elasticity behavior”

Elasticity Pathway functions: to characterize the elasticity behavior from a general/particular view

(33)

Multi-Level Elasticity Space Analytics

• Service requirement

– COST<= 0.0034$/client/h

– 2.5$ monthly subscription for each service client (sensor)

Elasticity Space “Clients/h” Dimension

Elasticity Space “Response Time” Dimension

 Determined Elasticity Space Boundaries

 Clients/h > 148

(34)

Human augmentation –

Engineering Techniques

(35)

Specifying and controling elasticity of human-based services

What if we need to

invoke a human? #Predictive Maintenance for chiller measurements _#_{SYBL.ServiceUnitLevel}