Software for Open Source
Architecture and Mode of Operation
page: 5
4/8/2012
Open Source JobScheduler
Software for Open Source
Contents
Components
Supported Platforms & Databases
Architecture
Job Configuration
Deployment
Distributed Processing
Security
Failsafe Operation
Software for Open Source
Components
Run time Components
Design time Components
page: 9
4/8/2012
Open Source JobScheduler
Software for Open Source
Components
JobScheduler Engine
JOC
:
J
obScheduler
O
perations
C
enter
Database
File System: Live Folder
Configuration Objects
Software for Open Source
JobScheduler Engine
Run time components
Running in background (demon / Service)
C++ and Java
Build-in http-Server or Jetty
internal and external API
Modes of Operation
single Instance, single Server
page: 11
4/8/2012
Open Source JobScheduler
Software for Open Source
JOC
:
J
obScheduler
O
perations
C
enter
Run time components
Browser based application
Ajax based
Connection to JS via TCP/IP
Communication via JSE or Jetty
http Authentication
Software for Open Source
JOC
:
J
obScheduler
O
perations
C
enter
page: 13
4/8/2012
Open Source JobScheduler
Software for Open Source
Database
Run time components
Access via JDBC
Usage
Restart capabilities
History and logs
Fail over
load balancing
House keeping jobs
cleanup history
any host and platform
Software for Open Source
FileSystem: Live Folder
Run time components
JobScheduler Objects are Flat Files
Structured by folders and subfolders
XML based syntax of objects
JobScheduler file watching active
Version control by SVN, Git, …
page: 15
4/8/2012
Open Source JobScheduler
Software for Open Source
Configuration objects
Run time components
job
job chain
order
process class
schedule
lock
calender (holidays)
Software for Open Source
Design time components
JOE : J
obScheduler
O
bject
E
ditor
JITL
:
J
obScheduler
I
ntegrated
T
emplate
L
ibrary
JADE
:
J
obScheduler
A
dvanced
D
ata
E
xchange
page: 17
4/8/2012
Open Source JobScheduler
Software for Open Source
JobScheduler Objects: Live Folder (hot folder)
Design time Components
JOE : J
obScheduler
O
bject
E
ditor
JITL
:
J
obScheduler
I
ntegrated
T
emplate
L
ibrary
JADE
:
J
obScheduler
A
dvanced
D
ata
E
xchange
JID
:
J
obScheduler
I
nformation
D
ashboard
Software for Open Source
JOE
:
J
obScheduler
O
bject
E
ditor
page: 19
4/8/2012
Open Source JobScheduler
Software for Open Source
JITL
:
J
obScheduler
I
ntegrated
T
emplate
L
ibrary
Design time Components
Predefined Jobs
platform independent
File Operations
Housekeeping
Data Exchange (JADE, SOSFtp)
Mail processing
Agentless scheduling (SSH)
Software for Open Source
JADE
:
J
obScheduler
A
dvanced
D
ata
E
xchange
Design time Components
Managed File Transfer
JobScheduler Adapter (JITL Job Jade)
CLI
Class Library
Ftp, sFtp, Ftps, local, WebDav, http, …
transactional transfer
page: 21
4/8/2012
Open Source JobScheduler
Software for Open Source
JID
:
J
obScheduler
I
nformation
D
ashboard
Design time Components
Single Point of Control
History Viewer
Daily plan
JOE integrated
JOC integrated
Event processor
…
Software for Open Source
JID
:
J
obScheduler
I
nformation
D
ashboard
page: 23
4/8/2012
Open Source JobScheduler
Software for Open Source
JID
:
J
obScheduler
I
nformation
D
ashboard (JOC)
Platforms & Databases
Supported Operating Systems
Microsoft Windows: 2003, 2008, XP,
Vista, 7, 8, 2008 R2, …
Linux (Suse, RedHat, Cent, …)
Solaris (sparc & x86)
HP-UX 11 (IA-64)
IBM AIX
Supported Databases
DB2
Oracle
MS-SQL Server
Sybase
MySQL (MariaDB)
PostgreSQL
H2
Job Scheduler Editor JOE
Architecture
Using a Database with regard to Compliance
Software- und Organisations-Service GmbH
www.sos-berlin.com
At a Glance:
If you decide to use a data- base, then you can locate it on any host and platform.
Connectivity is established per JDBC.By the way!
The advantage of using a database is that you keep track of the job history and log files for compliance of your IT processes.
Job history and log files can be accessed directly by the Operations Center (JOC) per browser.
JDBC Connectivity
Engine & Operations Center (JOC)
Job Scheduler
Database
Store job history and log files
supported platforms
any
platform supported dtabase
Manage and configure jobs and job chains
supported platforms Job Browser
Access Operations Center (JOC) to control jobs
any platform
JobScheduler Editor JOE
Job Configuration
Using Hot Folders
At a Glance:
If you use Hot Folders then JobScheduler willautomatically monitor changes to the configuration.
JOE enablesyou to manage configurations in Hot Folders on disk.
The JobScheduler monitors the LiveFolder constantly. Any changes are immediately detected.
The requested changes are applied right away without the need for a restart of JobScheduler.By the way!
Store jobs and job chains
Jobs and job chains are stored in XML files Monitor Hot Folders and
apply changes to jobs
Engine & Operations Center (JOC)
supported platforms any platform Hot Folders
supported platforms
Distributed Processing
Remote Execution
Software- und Organisations-Service GmbH
www.sos-berlin.com
At a Glance:
JobScheduler supports the execution of jobs via SSH on remote hosts. No SSH client is required.
JobScheduler supports the execution of jobs on remote JobScheduler instances.
Job chains for execution of individual job steps on remote hosts are supported. .Execute jobs on a remote Job Scheduler instance
DB Extension
Engine Engine supported platforms supported platforms any platform SSH Server
Execute jobs on a remote host that runs an SSH server
Job Job
Job Job
Job
Distribute a job chain to multiple Job Scheduler instances on different hosts
Distributed Processing
Remote Execution by Agents
At a Glance:
Job Scheduler supports the execution of jobs via SSH on remote hosts. No SSH client is required.
Job Scheduler supports the execution of jobs on remote Job Scheduler instances.
Job chains for execution of individual job steps on remote hosts are supported. . DB ExtensionEngine supported platforms Job Job
Execute job locally
Host A
Host B
Agent
supported platforms
Execute jobs on a remote Job Scheduler instance
Distributed Processing
Agentless scheduling: Remote Execution by SSH
Software- und Organisations-Service GmbH
www.sos-berlin.com
At a Glance:
JobScheduler supports the execution of jobs via SSH on remote hosts. No SSH client is required.
Job chains for execution of individual job steps on remote hosts are supported. . DB ExtensionEngine supported platforms SSH Server any platform
Execute job on a remote host that runs an SSH server
Job
Job Job
Execute job locally
Host A
Host B
Distributed Processing
Load Balancing
At a Glance:
For Load Balancing you can operate an arbitrary number of Job Schedulers in parallel.
All Job Schedulers use the same job configurations and database.
Job configurations are loaded from a network storage, alternatively from a clustered database(Managed Jobs).
Job Schedulers concurrently execute jobs and job chains that are synchronized by a central database.By the way!
DB ExtensionEngine
Engine
Fetch Enqueued Orders Store Job History Store Order History
Job Configuration Job Configuration Fetch Enqueued Orders Store Job History Store Order History
supported platforms supported platforms any platform Supervisor
Network Storage
Alternatively Job Scheduler Supervisor or Network Storage can be used
Failsafe Operation
Automatic Failover from Primary to Backup Job Schedulers
Software- und Organisations-Service GmbH
www.sos-berlin.com
At a Glance:
For automatic failover you have to set up one or more Backup Job Scheduler Instances.
The Backup Instances use the same configuration and database as the Primary Job Scheduler Instance.
Job configurations are loaded from a network storage, alternatively from a clustered database (Managed Jobs).
The backup Job Schedulers constantly check if the Primary Job Scheduler is up and running and will assume control in case of failure of the primary instance.
The Backup Job Schedulers will not execute any jobs, unless the heartbeats of the Primary Job Scheduler instance fail to be detected.Primary Engine
Job Configuration Job Configuration
Send backup heartbeats Check primary heartbeats Send primary heartbeats
Store Job History Store Order History
Backup Engine
supported
platforms supported platforms
Database
Cluster
Supervisor & Operations Center (JOC)
Alternatively Job Scheduler Supervisor or Network Storage can be used
Security
Basic Authentication
At a Glance:
If you want to apply an individual authentication, you can choose between Basic HTTP authentication and IP address authentication.
If you use Basic HTTP authentication the user specific passwords are stored MD5 encrypted in the Job Scheduler configuration.
In case you use IP address authentication a fixed address per client or network range is specified in the configuration.However, this does not apply for the use of terminal servers that assign the same address and for use of HTTP proxies.
PHP
Engine & Operations Center (JOC)
Basic HTTP authentication supported platforms IP address authentication
Security
External Authentication
Software- und Organisations-Service GmbH
www.sos-berlin.com
At a Glance:
You can choose to use a web server as a proxy between the clients and the Job Scheduler instances.
An arbitrary number of Job Schedulers is addressed by one web server.
LDAP, PAM and subsequent mechanisms supported by Apache can be used for individual authentication.By the way!
You could authenticate users against existing Unix accounts using passwd.PHP
Engine & Operations Center (JOC)
Web Server
Engine & Operations Center (JOC)
supported platforms supported platforms any platform any platform Browser
Repo-
sitory
Access Operations Center (JOC)
Access repository for user authentication
Forward access to the Operations Center (JOC)