There and Back Again As Quick As a Flash

(1)

There and Back Again

As Quick As a Flash

Stefan Winkler

Independent Software Developer and IT Consultant

CDO Committer

(2)

CDO in a nutshell

Server

Client

Storage

(3)

CDO in a nutshell

Server

Client

Storage

(4)

CDO in a nutshell

Server

Client

Storage

CDOID attribute reference CDOID

(5)

CDO in a nutshell

Server

Client

Storage

(6)

CDO in a nutshell

Server

Client

Storage

(7)

Storage

CDO in a nutshell

Server

Client

Storage

(8)

Storage

CDO in a nutshell

Server

Client

Storage

attribute reference CDOID attribute reference

(9)

Storage

CDO in a nutshell

Server

Client

Storage

attribute reference CDOID CDOID attribute reference

(10)

Storage

CDO in a nutshell

Server

Client

Storage

(11)

Storage

CDO in a nutshell

Server

Client

Storage

(12)

Storage

CDO in a nutshell

Server

Client

Storage

(13)

Layers

App

Logic

CDO

Client

EMF

Model

CDO

Server

IStore

Code

Storage

(14)

App

Logic

CDO

Client

EMF

Model

CDO

Server

IStore

Code

Storage

(15)

Choose the

Right Storage!

MEM DB (h2 in-proc) DB (h2 net) DB (MySQL) Hibernate (MySQL) MongoDB (net) DB4O (in-proc) 1.701 519.063 22.314 9.381 4.269 1.287 1.121

time to read 10,000 objects (msec)

2.268 1.503 10.151 6.686 5.546 766 283

(16)

Choose the

Right Storage!

Store

Usage Scenarios

Pros

Cons

MEMStore prototyping, testing supports all CDO _features not persistent

DBStore common/default solution supports all CDO _features DB selection and tuning adds _{to complexity} HibernateStore custom DB schema _required custom DB schema _{and mapping} only supports subset of _{CDO features, slower} MongoDB Store _{fast writing speeds required}No SQL DB wanted, fast writing speeds slow reading speeds,_{limited commit size}

DB4OStore _{fast reading speeds required}No SQL DB wanted, fast reading speeds slower writing speeds_{dual licence} ObjectivityStore OODB with commercial performance not commercial licence,

(17)

Choose the Right

Database!

h2 (net) MySQL (net) PostgreSQL (net) 4.231 9.381 4.269

time to read 10,000 objects

6.606 6.686 5.546

(18)

Choose the Right

Database!

h2 (net) MySQL (net) PostgreSQL (net) 4.231 9.381 4.269

6.606 6.686 5.546

time to write 10,000 objects (msec)

Standard Configurations !!!

(19)

App

Logic

CDO

Client

EMF

Model

CDO

Server

IStore

Code

Storage

(20)

Choose the Right

Repository Mode

Time

v1 v2 v3 v4 v5 v6 v7

Audit Mode

(21)

Choose the Right

Repository Mode

Time

v1 v2 v3 v4 v5 v6 v7

Non-Audit Mode

(22)

Choose the Right

Repository Mode

Time

0:v1 v2 v3 v4

v5 v6

Branching Mode

1:v1

2:v1

1:v2

2:v2 2:v3

(23)

Choose the Right

DBStore Mapping!

date

sum

Order

date

sum

Product

date

sum

Product

number

price

Product

Order Order Order Order

id version date sum

1 2 3/29/12 102.34

Product Product Product Product

id version number price

2 2 1-423-4 39.12 3 2 1-485-3 60.71 4 2 1-584-2 2.51 Order_Product_List Order_Product_List Order_Product_List Order_Product_List

id version index value

•

non-audit repo mode

•

no historic („audit“) views

(24)

Choose the Right

DBStore Mapping!

id version date sum

1 2 3/29/12 102.34

2 2 1-423-4 39.12 3 2 1-485-3 60.71 4 2 1-584-2 2.51 Order_Product_List Order_Product_List Order_Product_List Order_Product_List

id version index value

1 2 0 2

1 2 1 3

•

audit repo mode

•

classic

•

always writes complete list

•

range-based

(25)

Choose the Right

DBStore Mapping!

id version date sum

1 2 3/29/12 102.34

2 2 1-423-4 39.12 3 2 1-485-3 60.71 4 2 1-584-2 2.51

•

audit repo mode

•

classic

•

always writes complete list

•

range-based

•

writes deltas

Order_Product_List Order_Product_List Order_Product_List Order_Product_List Order_Product_List

id from to index value

1 1 null 0 2

1 1 1 1 4

1 2 null 1 3

(26)

Choose the Right

DBStore Mapping!

•

branching repo mode

•

classic vs. range-based

•

copy-lazy (default) vs. copy-on-branch

Order_Product_List Order_Product_List Order_Product_List Order_Product_List Order_Product_List Order_Product_List

id branch from to index value

1 1 1 null 0 2

1 1 1 1 1 4

1 1 2 null 1 3

(27)

Choose the Right

DBStore Mapping!

•

branching repo mode

•

1 1 1 null 0 2 1 1 1 1 1 4 1 1 2 null 1 3 1 1 1 1 2 3 Order_Product_List Order_Product_List Order_Product_List Order_Product_List Order_Product_List Order_Product_List

(28)

Choose the Right

DBStore Mapping!

•

branching repo mode

•

(29)

Choose the Right

DBStore Mapping!

•

branching repo mode

•

classic vs. range-based

•

1 1 1 null 0 2

1 1 1 1 1 4

1 1 2 null 1 3

(30)

Choose the Right

DBStore Mapping!

•

branching repo mode

•

1 2 1 null 0 2 1 2 1 null 1 5 1 2 1 null 2 4

(31)

Choose the Right

DBStore Mapping!

2.250 4.500 6.750 9.000 721 1.491 1.481 688 4.581 1.473 1.483 736 8.941 1.506 1.442 681

time to insert 100 objects at beginning

time to insert 100 objects in the middle

time to insert 100 objects at the end

(32)

App

Logic

CDO

Client

EMF

Model

CDO

Server

IStore

Code

Storage

(33)

Choose the Right

Transport Layer!

CDO Client CDO Server CDO Client CDO Server Computer 1 Computer 2

TCP (true client/server)

TCP (same computer)

JVM (same JVM)

(34)

A Word On

Caching

•

Revision Caches in CDO

use Soft references

•

Caches grow until memory

limit is reached

•

View Cache can be

configured to use strong or

weak references instead

CDO

Client

CDO

Server

View Cache (Soft Ref) Session Cache (Soft Ref) Repository Cache (Soft Ref)

(35)

App

Logic

CDO

Client

EMF

Model

CDO

Server

IStore

Code

Storage

(36)

Choose the Right

Model Configuration!

Native Reflective Legacy 11.302 8.882 8.581

4.460 3.076

2.802

(37)

App

Logic

CDO

Client

EMF

Model

CDO

Server

IStore

Code

Storage

(38)

Make Use of

CDO Loading Policies!

•

Lazy Collection Loading

session.options().setCollectionLoadingPolicy(

CDOUtil.createCollectionLoadingPolicy(

/* initial = */ 5, /* onResolve = */ 5));

•

Explicit Prefetching

CDOObject fromCDO = getMyObjectFromCDO();

fromCDO.cdoPrefetch(/* depth = */ 3);

•

Prefetching by Policy

(39)

Leftovers

•

Things I did not talk about

•

unordered collections

•

store queries (use with caution!)

(40)

Summary

•

Choose the Right Storage!

•

Choose the Right Database!

•

Choose the Right Repository Mode!

•

Choose the Right DBStore Mapping!

•

Choose the Right Transport Layer!

•

Choose the Right Model Configuration!