Universidade Lusíada
V.N.Famalicão
Grid e-Services for Multi-Layer
SOM Neural Network Simulation
Grid e-Services for Multi-Layer
SOM Neural Network Simulation
Rui Lima
Rui Lima
, Rui Silva
, Rui Silva
Faculdade de Engenharia
Faculdade de Engenharia
Universidade Lus
Universidade Lus
í
í
ada
ada
4760
4760
-
-
108 V. N. Famalicão, Portugal
108 V. N. Famalicão, Portugal
{
{rml,rsilva
rml,rsilva}
}@fam.ulusiada.pt
@fam.ulusiada.pt
2007
Universidade Lusíada V.N.Famalicão
Outline
Outline
•
•
Overview
Overview
•
•
Multi
Multi
-
-
Layer SOM Background
Layer SOM Background
•
•
Architecture and Design
Architecture and Design
•
•
Local Implementation
Local Implementation
•
•
Grid Proposal Environment
Grid Proposal Environment
-
-
GRIDSOM
GRIDSOM
•
Universidade Lusíada V.N.Famalicão
Overview
Overview
ILID
ILID
–
–
Instituto Lus
Instituto Lus
í
í
ada de Investiga
ada de Investiga
ç
ç
ão e
ão e
Desenvolvimento
Desenvolvimento
(
(
Lus
Lus
í
í
ada
ada
R&D Institute)
R&D Institute)
1. Energy e Gestão Industrial (CLEGI)
2. Ciências Sociais e Humanas
3. Ciências Jurídicas
4. Arquitectura
5. Centro Lusíada de Matemática
6. Centro Lusíada de Recursos Humanos (CIDRHU)
7. Centro Lusíada de Turismo, Inovação e Serviços (TIS)
8. Centro Lusíada de Economia e Gestão
Intelligent Tool
Wear Monitoring
http://www.fam.ulusiada.pt/ilid/MIFC/index.htm
Vila Nova de Famalicão
Vila Nova de Famalicão
8 - R&D Centers
Universidade Lusíada
V.N.Famalicão
Intelligent Tool Wear Monitoring
Intelligent Tool Wear Monitoring
Wear monitoring
Wear monitoring
Cutting Process
Universidade Lusíada V.N.Famalicão
Our Problem
Our Problem
Experiments were
conducted on a CNC
Non intrusive sensors
Modeling technique
based on artificial
neural networks
Universidade Lusíada
V.N.Famalicão
Multi-Layer SOM Background
Multi-Layer SOM Background
Division of the output map into several sub
Division of the output map into several sub
-
-
maps
maps
1.
1.
Randomly initiate weights;
Randomly initiate weights;
2.
2.
Present input vector;
Present input vector;
3.
3.
Determine the distance
Determine the distance
between input feature vector
between input feature vector
and each output node;
and each output node;
4.
4.
Adjust weights according to
Adjust weights according to
winning frequency;
winning frequency;
5.
5.
Select neuron with
Select neuron with
minimum distance to input
minimum distance to input
feature vector;
feature vector;
6.
6.
Update weights;
Update weights;
7.
7.
Back to step
Back to step
2.
2
.
Clustering Method
Universidade Lusíada
V.N.Famalicão
Multi-Layer SOM Results
Multi-Layer SOM Results
The sub
The sub
-
-
maps
maps
are treated as
are treated as
jobs in the
jobs in the
GRID
GRID
computing
computing
environment
environment
0.00 1.00 2.00 3.00 4.00 5.00 6.00 7.00 8.00 9.00 0.00 1.00 2.00 3.00 4.00 5.00 6.00 7.00 8.00 9.00 0.00 1.00 2.00 3.00 4.00 5.00 6.00 7.00 8.00 9.00 0.00 1.00 2.00 3.00 4.00 5.00 6.00 7.00 8.00 9.00 0.00 1.00 2.00 3.00 4.00 5.00 6.00 7.00 8.00 9.00 0.00 1.00 2.00 3.00 4.00 5.00 6.00 7.00 8.00 9.00 0.00 1.00 2.00 3.00 4.00 5.00 6.00 7.00 8.00 9.00 0.00 1.00 2.00 3.00 4.00 5.00 6.00 7.00 8.00 9.00Contour plot - tool with VBB=0.05 mm Contour plot - tool with VBB=0.17 mm
Contour plot - tool with VBB=0.21mm Contour plot - tool with VB
Universidade Lusíada
V.N.Famalicão
Our Aim
Our Aim
A
lightweight
architecture to support the execution of
neural networks simulation tasks across the Grid
infrastructure.
•
Security
•
Authentication
•
Encryption
•
Model Design
•
Build Simulation
•
Monitor
•
Results
Universidade Lusíada
V.N.Famalicão
Architecture and Design
Architecture and Design
LCG
LCG
Job Manager
gLite
gLite
Grid middleware
SL (
SL (Linux
Linux
)
)
Operating system
P
P
IV
IV
2GHz
2GHz
Architecture (processor type)
1 TB
1 TB
Cluster Storage
80 GB
80 GB
Disk per node
512 MB
512 MB
Memory per Node
15
15
Number of Nodes
Local Resources:
Universidade Lusíada
V.N.Famalicão
Architecture and Design
Architecture and Design
Layer Model
Universidade Lusíada
V.N.Famalicão
Architecture and Design
Universidade Lusíada
V.N.Famalicão
Neural Network Agent
Neural Network Agent
•
Manage and control tasks.
•
Distribution of work load.
•
Control neural network learning and
recognition.
•
Interface the communication between neural
network layers.
Universidade Lusíada
V.N.Famalicão
Monitor Agent
Monitor Agent
•
Submit jobs that are waiting in the
Database.
•
Querying the Logging and Bookkeeping.
•
Collect those that have already been
successfully finished.
•
Re-submit unfinished jobs.
•
Update the database with the jobs states.
Local Service
Local Database
Universidade Lusíada V.N.Famalicão
Hybrid Approach
Hybrid Approach
•
•
Network Agent
Network Agent
Simulation Algorithm
Simulation Algorithm
Database Store Results
Database Store Results
•
•
Monitor
Monitor
Looks for new Jobs in Database
Looks for new Jobs in Database
Launch Jobs to the GRID
Launch Jobs to the GRID
Universidade Lusíada V.N.Famalicão
GRIDSOM
GRIDSOM
Prototype
Prototype
http
http
://
://
gridsom.fam.ulusiada.pt
gridsom.fam.ulusiada.pt
WEB
WEB
Registration
Registration
Universidade Lusíada V.N.Famalicão
GRIDSOM
GRIDSOM
Start Simulation
Start Simulation
Universidade Lusíada
V.N.Famalicão
Generate .JDL File
Universidade Lusíada V.N.Famalicão
Tasks in Database
Tasks in Database
Current Tasks
Current Tasks
–
–
In the Outbox
In the Outbox
•
•
The Neural Network Agent will queue the
The Neural Network Agent will queue the
initial job of this task
Universidade Lusíada
V.N.Famalicão
Monitor Launch Jobs
Universidade Lusíada
V.N.Famalicão
Queued Jobs in Database
Queued Jobs in Database
Job status stored in (
Universidade Lusíada
V.N.Famalicão
Monitor Getting Job Status
Monitor Getting Job Status
Job re
Job re
-
-
submit !
submit !
Job Done !
Universidade Lusíada
V.N.Famalicão
Monitor Getting Results
Monitor Getting Results
Neural Network Agent
Neural Network Agent
–
–
Generate a new iteration
Generate a new iteration
Job Done !
Job Done !
Monitor
Monitor
–
–
Submit this new iteration:
Submit this new iteration:
Until the
end of
Universidade Lusíada
V.N.Famalicão
End Simulation
End Simulation
Neural Network Agent
Universidade Lusíada
V.N.Famalicão
User Collect Results
User Collect Results
Download de Final Data
Universidade Lusíada V.N.Famalicão
Data Visualization
Data Visualization
Data Analysis
Data Analysis
(outside GRIDSOM)
(outside GRIDSOM)
Universidade Lusíada
V.N.Famalicão
Conclusions and Future Developments
Conclusions and Future Developments
• Prototype successfully tested
• Hybrid approach
• SSL layer
• Migrate to New Scheduling System
•
•
Virtual Organization
Virtual Organization
•
Universidade Lusíada
V.N.Famalicão