• No results found

JobScheduler. Architecture and Mode of Operation. Software for Open Source

N/A
N/A
Protected

Academic year: 2021

Share "JobScheduler. Architecture and Mode of Operation. Software for Open Source"

Copied!
31
0
0

Loading.... (view fulltext now)

Full text

(1)

Software for Open Source

Architecture and Mode of Operation

(2)
(3)

page: 5

4/8/2012

Open Source JobScheduler

Software for Open Source

Contents

Components

Supported Platforms & Databases

Architecture

Job Configuration

Deployment

Distributed Processing

Security

Failsafe Operation

(4)

Software for Open Source

Components

 Run time Components

 Design time Components

(5)

page: 9

4/8/2012

Open Source JobScheduler

Software for Open Source

Components

 JobScheduler Engine

JOC

:

J

obScheduler

O

perations

C

enter

 Database

 File System: Live Folder

 Configuration Objects

(6)

Software for Open Source

JobScheduler Engine

Run time components

 Running in background (demon / Service)

 C++ and Java

 Build-in http-Server or Jetty

 internal and external API

 Modes of Operation

 single Instance, single Server

(7)

page: 11

4/8/2012

Open Source JobScheduler

Software for Open Source

JOC

:

J

obScheduler

O

perations

C

enter

Run time components

 Browser based application

 Ajax based

 Connection to JS via TCP/IP

 Communication via JSE or Jetty

 http Authentication

(8)

Software for Open Source

JOC

:

J

obScheduler

O

perations

C

enter

(9)

page: 13

4/8/2012

Open Source JobScheduler

Software for Open Source

Database

Run time components

 Access via JDBC

 Usage

 Restart capabilities

 History and logs

 Fail over

 load balancing

 House keeping jobs

 cleanup history

 any host and platform

(10)

Software for Open Source

FileSystem: Live Folder

Run time components

 JobScheduler Objects are Flat Files

 Structured by folders and subfolders

 XML based syntax of objects

 JobScheduler file watching active

 Version control by SVN, Git, …

(11)

page: 15

4/8/2012

Open Source JobScheduler

Software for Open Source

Configuration objects

Run time components

 job

 job chain

 order

 process class

 schedule

 lock

 calender (holidays)

(12)

Software for Open Source

Design time components

JOE : J

obScheduler

O

bject

E

ditor

JITL

:

J

obScheduler

I

ntegrated

T

emplate

L

ibrary

JADE

:

J

obScheduler

A

dvanced

D

ata

E

xchange

(13)

page: 17

4/8/2012

Open Source JobScheduler

Software for Open Source

JobScheduler Objects: Live Folder (hot folder)

Design time Components

JOE : J

obScheduler

O

bject

E

ditor

JITL

:

J

obScheduler

I

ntegrated

T

emplate

L

ibrary

JADE

:

J

obScheduler

A

dvanced

D

ata

E

xchange

JID

:

J

obScheduler

I

nformation

D

ashboard

(14)

Software for Open Source

JOE

:

J

obScheduler

O

bject

E

ditor

(15)

page: 19

4/8/2012

Open Source JobScheduler

Software for Open Source

JITL

:

J

obScheduler

I

ntegrated

T

emplate

L

ibrary

Design time Components

 Predefined Jobs

 platform independent

 File Operations

 Housekeeping

 Data Exchange (JADE, SOSFtp)

 Mail processing

 Agentless scheduling (SSH)

(16)

Software for Open Source

JADE

:

J

obScheduler

A

dvanced

D

ata

E

xchange

Design time Components

 Managed File Transfer

 JobScheduler Adapter (JITL Job Jade)

 CLI

 Class Library

 Ftp, sFtp, Ftps, local, WebDav, http, …

 transactional transfer

(17)

page: 21

4/8/2012

Open Source JobScheduler

Software for Open Source

JID

:

J

obScheduler

I

nformation

D

ashboard

Design time Components

 Single Point of Control

 History Viewer

 Daily plan

 JOE integrated

 JOC integrated

 Event processor

 …

(18)

Software for Open Source

JID

:

J

obScheduler

I

nformation

D

ashboard

(19)

page: 23

4/8/2012

Open Source JobScheduler

Software for Open Source

JID

:

J

obScheduler

I

nformation

D

ashboard (JOC)

(20)

Platforms & Databases

Supported Operating Systems

Microsoft Windows: 2003, 2008, XP,

Vista, 7, 8, 2008 R2, …

Linux (Suse, RedHat, Cent, …)

Solaris (sparc & x86)

HP-UX 11 (IA-64)

IBM AIX

Supported Databases

DB2

Oracle

MS-SQL Server

Sybase

MySQL (MariaDB)

PostgreSQL

H2

(21)

Job Scheduler Editor JOE

Architecture

Using a Database with regard to Compliance

Software- und Organisations-Service GmbH

www.sos-berlin.com

At a Glance:

If you decide to use a data- base, then you can locate it on any host and platform.

Connectivity is established per JDBC.

By the way!

The advantage of using a database is that you keep track of the job history and log files for compliance of your IT processes.

Job history and log files can be accessed directly by the Operations Center (JOC) per browser.

JDBC Connectivity

Engine & Operations Center (JOC)

Job Scheduler

Database

Store job history and log files

supported platforms

any

platform supported dtabase

Manage and configure jobs and job chains

supported platforms Job Browser

Access Operations Center (JOC) to control jobs

any platform

(22)

JobScheduler Editor JOE

Job Configuration

Using Hot Folders

At a Glance:

If you use Hot Folders then JobScheduler will

automatically monitor changes to the configuration.

JOE enables

you to manage configurations in Hot Folders on disk.

The JobScheduler monitors the LiveFolder constantly. Any changes are immediately detected.

The requested changes are applied right away without the need for a restart of JobScheduler.

By the way!

Store jobs and job chains

Jobs and job chains are stored in XML files Monitor Hot Folders and

apply changes to jobs

Engine & Operations Center (JOC)

supported platforms any platform Hot Folders

supported platforms

(23)

Distributed Processing

Remote Execution

Software- und Organisations-Service GmbH

www.sos-berlin.com

At a Glance:

JobScheduler supports the execution of jobs via SSH on remote hosts. No SSH client is required.

JobScheduler supports the execution of jobs on remote JobScheduler instances.

Job chains for execution of individual job steps on remote hosts are supported. .

Execute jobs on a remote Job Scheduler instance

DB Extension

Engine Engine supported platforms supported platforms any platform SSH Server

Execute jobs on a remote host that runs an SSH server

Job Job

Job Job

Job

Distribute a job chain to multiple Job Scheduler instances on different hosts

(24)

Distributed Processing

Remote Execution by Agents

At a Glance:

Job Scheduler supports the execution of jobs via SSH on remote hosts. No SSH client is required.

Job Scheduler supports the execution of jobs on remote Job Scheduler instances.

Job chains for execution of individual job steps on remote hosts are supported. . DB Extension

Engine supported platforms Job Job

Execute job locally

Host A

Host B

Agent

supported platforms

Execute jobs on a remote Job Scheduler instance

(25)

Distributed Processing

Agentless scheduling: Remote Execution by SSH

Software- und Organisations-Service GmbH

www.sos-berlin.com

At a Glance:

JobScheduler supports the execution of jobs via SSH on remote hosts. No SSH client is required.

Job chains for execution of individual job steps on remote hosts are supported. . DB Extension

Engine supported platforms SSH Server any platform

Execute job on a remote host that runs an SSH server

Job

Job Job

Execute job locally

Host A

Host B

(26)

Distributed Processing

Load Balancing

At a Glance:

For Load Balancing you can operate an arbitrary number of Job Schedulers in parallel.

All Job Schedulers use the same job configurations and database.

Job configurations are loaded from a network storage, alternatively from a clustered database

(Managed Jobs).

Job Schedulers concurrently execute jobs and job chains that are synchronized by a central database.

By the way!

DB Extension

Engine

Engine

Fetch Enqueued Orders Store Job History Store Order History

Job Configuration Job Configuration Fetch Enqueued Orders Store Job History Store Order History

supported platforms supported platforms any platform Supervisor

Network Storage

Alternatively Job Scheduler Supervisor or Network Storage can be used

(27)

Failsafe Operation

Automatic Failover from Primary to Backup Job Schedulers

Software- und Organisations-Service GmbH

www.sos-berlin.com

At a Glance:

For automatic failover you have to set up one or more Backup Job Scheduler Instances.

The Backup Instances use the same configuration and database as the Primary Job Scheduler Instance.

Job configurations are loaded from a network storage, alternatively from a clustered database (Managed Jobs).

The backup Job Schedulers constantly check if the Primary Job Scheduler is up and running and will assume control in case of failure of the primary instance.

The Backup Job Schedulers will not execute any jobs, unless the heartbeats of the Primary Job Scheduler instance fail to be detected.

Primary Engine

Job Configuration Job Configuration

Send backup heartbeats Check primary heartbeats Send primary heartbeats

Store Job History Store Order History

Backup Engine

supported

platforms supported platforms

Database

Cluster

Supervisor & Operations Center (JOC)

Alternatively Job Scheduler Supervisor or Network Storage can be used

(28)

Security

Basic Authentication

At a Glance:

If you want to apply an individual authentication, you can choose between Basic HTTP authentication and IP address authentication.

If you use Basic HTTP authentication the user specific passwords are stored MD5 encrypted in the Job Scheduler configuration.

In case you use IP address authentication a fixed address per client or network range is specified in the configuration.

However, this does not apply for the use of terminal servers that assign the same address and for use of HTTP proxies.

PHP

Engine & Operations Center (JOC)

Basic HTTP authentication supported platforms IP address authentication

(29)

Security

External Authentication

Software- und Organisations-Service GmbH

www.sos-berlin.com

At a Glance:

You can choose to use a web server as a proxy between the clients and the Job Scheduler instances.

An arbitrary number of Job Schedulers is addressed by one web server.

LDAP, PAM and subsequent mechanisms supported by Apache can be used for individual authentication.

By the way!

You could authenticate users against existing Unix accounts using passwd.

PHP

Engine & Operations Center (JOC)

Web Server

Engine & Operations Center (JOC)

supported platforms supported platforms any platform any platform Browser

Repo-

sitory

Access Operations Center (JOC)

Access repository for user authentication

Forward access to the Operations Center (JOC)

(30)

Let the rabbit do the job

http://jobscheduler.sourceforge.net

(31)

page: 40

4/8/2012

Open Source JobScheduler

Software for Open Source

Klaus-Dieter Büttner | Managing Partner – CTO

Tel.: +49 30 864 790 24

[email protected]

Dagmar Reimold | Sales Manager

Tel.: +49 30 864 790 28

[email protected]

If you have any questions, please

feel free to contact us

SOS GmbH, Berlin

References

Related documents

Chapter 3 investigated the effects of wetland enhancement techniques on larval pike survival, and described differences in the overall physical environments, zooplankton

Where LEP is log of environmental pollution proxy by per capita emission, LY is log of economic growth proxy by GDP, LOP is the log of openness of the economy proxy by imports

Session III: DSM Revisions’ Impact on Diagnoses & Documentation, Chelle Guttery Session IV: Career Exploration: A Preface to Major, Career, and Advising, Christina Ursin

Analysis of the current state of design tools for reconfigurable systems presented in Sections 1.1 through 1.3 allows a statement of the principal aim of the thesis which is

Transnational corporate bribery carried out between Rolls-Royce and many parties, including public officials and fellow business people, can be defined as direct

Ball State University will continue its efforts to differentiate itself from other public universities by enhancing the quality of the academic experiences offered to all students,

This development has attendant growing integration of markets and capital flows across international borders as its elements; sweeping through the world as a result of its

penumbra relationship with time, collaterals; haemorrhage, oedema relationship with recanalisation; Safety in Stroke Thrombolysis (SITS) registry Stroke outcomes; Deriving a