• No results found

Investigation into Swarm based Cooperative Behaviour in Execution of Open Field Agricultural Tasks

N/A
N/A
Protected

Academic year: 2020

Share "Investigation into Swarm based Cooperative Behaviour in Execution of Open Field Agricultural Tasks"

Copied!
282
0
0

Loading.... (view fulltext now)

Full text

(1)

Investigation into Swarm-based Cooperative Behaviour in

Execution of Open Field Agricultural Tasks

JANANI, Alireza

Available from Sheffield Hallam University Research Archive (SHURA) at:

http://shura.shu.ac.uk/24182/

This document is the author deposited version. You are advised to consult the publisher's version if you wish to cite from it.

Published version

JANANI, Alireza (2018). Investigation into Swarm-based Cooperative Behaviour in Execution of Open Field Agricultural Tasks. Doctoral, Sheffield Hallam University.

Copyright and re-use policy

See http://shura.shu.ac.uk/information.html

Sheffield Hallam University Research Archive

(2)

Investigation into Swarm-based Cooperative Behaviour in Execution of Open Field Agricultural Tasks

Alireza Janani

A doctoral project report submitted in partial fulfilment of the requirements of Sheffield Hallam University

for the degree of Doctor of Professional Studies Doctor of Philosophy

Sheffield Hallam Univeristy

Materials and Engineering Research Institute UK

(3)
(4)

Abstract

Because of the significant drop in the number of farmers and increase in the earth

population, the use of autonomous farming units including unmanned tractors is

be-coming more and more popular. However, relying on a single autonomous farming

unit to carry out the entire task on a large field is inefficient. Using multiple

au-tonomous tractors bring more efficiency, however, without cooperation this attempt

will fail (Mataric et al., 1995). This cooperation can be achieved by an appropriate

task allocation and coordination mechanism between the participating units. The

current trend in this field is to use direct forms of communication in any form of

directional or broadcasting meaningful messages among the group. The messages

assist the group to identify the state of the task, assigned workload, collision and

congestion avoidance, and etc. These forms of approaches are fast and efficient when

units are within the communicating signal range.

In this thesis, we aim to investigate the feasibility of cooperative execution of open

field farming task including spraying and ploughing while inter-team interaction

is other than direct communication methods. For every task, an algorithm is

sug-gested and an appropriate mathematical model is presented. Then, using ROS Stage

simulation environment, each algorithm is implemented and multiple tests are

con-ducted. Finally, the simulation results and the correspondent mathematical results

(5)

Candidate’s Statement

I declare that this work has been conducted in accordance with the regulations of

Sheffield Hallam University and is the author’s own work apart from where indicated

by specific reference to other sources. The work has not been submitted as part of

any other award or presented to any other institution.

(6)

Acknowledgement

I would like to, firstly, thank my wife who supported me through thick and thin in

this journey. I couldn’t complete this program without her support and patience.

My gratitude goes to my Director of Studies, Prof. Jacques Penders, for his

contin-ued invaluable support, advice and guidance and with whom my robotic life began.

I am also grateful to Dr Lyuba Alboul, my Doctoral supervisor, who challenged my

thinking and made me realise the importance of each small achievement. Both of

you have been inspirational and this journey would not have been possible without

you. Finally, I would like thank my sister and parents, who also supported me in

(7)

Contents

Contents . . . i

List of Figures . . . vi

List of Tables . . . ix

1 AGRICULTURE AND ROBOTICS: TRENDS AND CHALLENGES 1 1.1 Agriculture: Everlasting Tension . . . 1

1.2 Agriculture: Current Trends and Methods . . . 3

1.2.1 Mechanisation . . . 3

1.2.2 Precision Farming . . . 4

1.2.3 Multi Robot Approach . . . 5

1.3 Research Question, Aim and Objectives . . . 8

1.4 Thesis Contribution . . . 8

1.5 Thesis Layout . . . 10

1.6 Research Location . . . 11

2 LITERATURE REVIEW . . . 13

2.1 From Multi Agent System to Multi Robot System . . . 13

2.2 Multi Robot System . . . 14

2.3 Application Domain of Multi Robot System . . . 15

2.3.1 Foraging . . . 15

2.3.2 Area Coverage and Exploration . . . 15

2.3.3 Multi-Target Observation . . . 16

2.3.4 Object Transportation . . . 16

(8)

2.3.6 Soccer . . . 17

2.4 Team Characteristics . . . 17

2.4.1 Control Structure . . . 18

2.4.2 Differentiation . . . 21

2.4.3 Communication Structure . . . 23

2.4.4 Representative Architecture . . . 27

2.5 Main Questions in Multi Robot System . . . 29

2.5.1 Task Partitioning and Allocation . . . 30

2.5.2 Coordination . . . 32

2.5.3 Congestion Avoidance and Clearance . . . 34

2.6 Cooperative Farming: Review and Analysis . . . 36

2.6.1 Agricultural Tasks . . . 37

2.6.2 Analysis of the Related Works . . . 38

2.6.3 The Problem of Localisation in Agricultural Robotics . . . 42

2.7 Conclusion . . . 48

3 COOPERATIVE PLOUGHING: DESIGN AND IMPLEMEN-TATION . . . 49

3.1 Ploughing Analysis . . . 49

3.1.1 Ploughing Patterns . . . 50

3.1.2 Ploughing Restrictions . . . 52

3.1.3 Ploughing Mouldboards and Furrow Transitioning . . . 52

3.1.4 Ploughing Cost . . . 54

3.2 Design Requirements and Considerations . . . 56

3.3 Interaction Model . . . 58

3.3.1 Furrow Detection . . . 58

3.3.2 Vision Based Furrow Detection . . . 60

3.3.3 Accuracy of the Vision Based Furrow Detection . . . 61

3.4 Points of Failure . . . 63

3.5 Congestion Clearance . . . 63

(9)

3.5.2 Proposed Solution to Spatial Resource Conflict . . . 64

3.5.3 Collision Avoidance . . . 67

3.6 Challenges in Obstacle Detection Implementation . . . 70

3.6.1 Differentiation between other team members and the rest of the obstacles in the environment . . . 70

3.6.2 Entering the Field due to Collision Avoidance . . . 78

3.6.3 Combination of Collision and Congestion Avoidance . . . 78

3.7 Team Ploughing . . . 79

3.8 Furrow Transitioning . . . 80

3.8.1 Ploughing with a Reversible Mouldboard: First-In, First-Out . 81 3.8.2 Ploughing with a Reversible Mouldboard: Last-In, First-Out . 88 3.8.3 Comparison and Discussion . . . 94

3.9 Ploughing Optimisation . . . 99

3.9.1 Issues with FIFO and LIFO . . . 100

3.9.2 Toward Self-Organising Ploughing . . . 101

3.10 Conclusion . . . 106

4 COOPERATIVE SPRAYING: DESIGN AND IMPLEMENTA-TION . . . 107

4.1 Motivation Behind Further Investigation . . . 107

4.2 Spraying Analysis . . . 111

4.2.1 Single Robotic Sprayer . . . 112

4.3 Cooperative Spraying: Design Description . . . 115

4.3.1 Task Partitioning Analysis . . . 117

4.3.2 Task Allocation Analysis . . . 118

4.3.3 Task Initiation Analysis . . . 121

4.3.4 Spraying Time Analysis . . . 121

4.3.5 Design Limitations . . . 122

4.4 Implementation and Testing . . . 126

4.4.1 Mathematical Results . . . 126

(10)

4.5 System Optimisation . . . 132

4.5.1 Dynamic vs Static Checkpoints . . . 132

4.5.2 Optimum Team . . . 132

4.5.3 Large Team and Fewer Checkpoints . . . 133

4.6 Conclusion . . . 138

4.7 Critiques and Future Work . . . 140

5 Discussions, Conclusions and Future Works . . . 141

5.1 Research Recap . . . 141

5.2 Region-based vs Self-organised, FIFO, LIFO . . . 145

5.2.1 Execution Time Comparison . . . 146

5.2.2 Scalability, Flexibility and the Required Coordination . . . 147

5.2.3 Resilience Toward Failure . . . 149

5.3 Application Scope . . . 152

5.3.1 Seeding . . . 152

5.3.2 Harvesting . . . 153

5.3.3 Multi-Robotic De-mining and Mine Field Mapping . . . 157

5.3.4 Cooperative Beacon Distribution . . . 158

5.4 Conclusion and Future Directions of Research . . . 160

5.4.1 Recovering from Failure During Task Execution . . . 163

5.4.2 Hybrid Approaches . . . 163

References . . . 165

Appendix A Spraying Optimum Team Size . . . 190

Appendix B C++ Code for Artificial Potential Field Using ROS . 195 Appendix C C++ Code for Cluster Class . . . 200

Appendix D C++ Code for Cluster Finding . . . 202

(11)

Appendix G C++ Code for FIFO Task Handler . . . 218

Appendix H C++ Code for LIFO Task Handler . . . 228

Appendix I C++ Code for Self-organised Task Handler . . . 236

Appendix J C++ Code for Region-based Task Handler Using ROS 242

(12)

List of Figures

3.1 Ploughing in action . . . 50

3.2 Ploughing Patterns . . . 50

3.3 Furrow Transitioning in Action . . . 51

3.4 Ploughing Mouldboards . . . 53

3.5 Ploughing Patterns Using Conventional Mouldboards . . . 54

3.6 Ploughing Patterns Using Reversible Mouldboards . . . 55

3.7 Furrow Detection Results . . . 61

3.8 Congestion Demonstration . . . 65

3.9 Congestion From Different Direction . . . 65

3.10 Division of Field of View . . . 66

3.11 Artificial Potential Field(APF) Demonstration . . . 68

3.12 Demonstration of Local Minima Issue in APF . . . 69

3.13 QR-code Tracking . . . 73

3.14 Flickering Pixel Effect . . . 75

3.15 RGB-LED Feature Localisation . . . 76

3.16 RGB-LED Feature Based Localisation Camera View . . . 77

3.17 RGB-LED Feature Based Localisation Noise Removal . . . 77

3.18 Field View for Combining Collision and Congestion Avoidance . . . . 79

3.19 Ideal Position of the Robot for Ploughing . . . 81

3.20 FIFO Furrow Transitioning Demonstration . . . 83

3.21 Ploughing with a Reversible Mouldboard FIFO - Flow Chart . . . 87

3.22 LIFO Furrow Transitioning Demonstration . . . 91

3.23 Ploughing with a Reversible Mouldboard LIFO - Flow Chart . . . 93

(13)

3.25 FIFO vs LIFO Processing Time Comparison . . . 96

3.26 FIFO vs LIFO Travelled Distance Comparison . . . 97

3.27 Software System Diagram for Ploughing . . . 98

3.28 FIFO and LIFO Difference between Simulation and Mathematical Results . . . 99

3.29 The Self-Organised Approach Demonstration . . . 102

3.30 Furrow Transitioning in the Self-Organised approach . . . 102

3.31 Self-organised ploughing flowchart . . . 104

3.32 Self-Organised Ploughing Required Travelling Distance . . . 105

3.33 Time Analysis of Ploughing Methods . . . 105

4.1 Shortcoming of Ploughing Interaction Method in Spraying . . . 108

4.2 Excessive Spraying Demonstration . . . 109

4.3 Shortcoming of Static Task Allocation in Spraying . . . 110

4.4 Spraying in Action . . . 112

4.5 Irrigation Robot . . . 113

4.6 Hortibot Robot . . . 114

4.7 Spraying Task Allocation Demonstration . . . 116

4.8 Spraying Task Initiation Demonstration . . . 117

4.9 Spraying Time Analysis . . . 119

4.10 Spraying Time Analysis Checkpoint Occupation . . . 120

4.11 Spraying Task Allocation Breaking Point Demonstration . . . 123

4.12 Spraying Successful Task Initiation Condition Demonstration . . . 124

4.13 Spraying Task Allocation Failure Demonstration . . . 124

4.14 Detection Range Issue with Spraying Approach . . . 125

4.15 Team Size for Different Field Size . . . 127

4.16 Spraying Time Comparison . . . 128

4.17 Spraying Software Diagram . . . 129

4.18 Region-based Task Handler Flowchart . . . 130

4.19 Region-based Simulation vs Mathematical Results Comparison . . . . 131

(14)

4.21 Spraying Task Initiation with Patrol Robot . . . 135

4.22 Patrol Robot Excessive Execution Prevention . . . 136

4.23 The Effect of Patrol Robot on the Rest of the Team . . . 136

4.24 Spraying Task Completion . . . 137

5.1 Execution Time Comparison for Different Team Sizes . . . 147

5.2 Seeding Patterns . . . 153

5.3 Harvesting Carrot . . . 154

5.4 Different Harvesting Machines . . . 154

5.5 Single Harvester in the Region-based Approach . . . 156

5.6 Single Harvester in Self-organising Approach . . . 156

(15)

List of Tables

3.1 Variation in tag position and observer position vs Distance to the tag 74

(16)

CHAPTER 1

AGRICULTURE AND ROBOTICS: TRENDS AND

CHALLENGES

This chapter presents the research motivation and background, and the research aim and objectives. The main aim of this chapter is to assure that the reader comprehends the urge for human inde-pendent approaches to perform agricultural tasks. A global and epidemic issue in agriculture which jeopardizes the future of food industry is discussed in 1.1. The current trends aiming to compen-sate the raised issue are presented in 1.2. The direction of research and aim and objectives of the research are listed 1.3. Finally, the thesis layout is explained in 1.5

1.1

Agriculture: Everlasting Tension

Agriculture is defined as domestication of animals and plants. There are various

tasks to consider in the field of agriculature. Chandrasekaran et al. (in 2010)

classi-fied agricultural branches into various categories including, Crop Production

(deal-ing with production of various food crops), Horticulture (deal(deal-ing with production

of flowers, fruits, and vegetables), Forestry (dealing with large scale cultivation of

perennial trees for supplying wood), Animal Husbandry (dealing with maintenance

of various types of livestock for direct energy), Fishery Science, and Home Science.

The archaeological excavations date back agriculture to 10,000 years ago. Since then,

human beings have used agriculture mainly to provide food. However, nowadays

agricultural products are demanded by various industries including pharmaceutical,

(17)

As population increases, the demand for food increases too. Between 1960 and

2000 the population of the earth was doubled. In return, agricultural productivity

improved by 2.4% annually between 1969 and 1989, but this fell to only 2% between

1989 and 2000 (Fao, 2002). By 2050, it is estimated that the population of the earth

will reach 9.15 billion by which time the overall demand for agricultural products is

expected to grow at 1.1% per year (Alexandratos and Bruinsma, 2012). To satisfy

this level of demand, the agricultural productivity has to be improved by 25% of

the current rate (Fao, 2009).

This everlasting tension has always forced farmers to invent more efficient cultivation

methods. However, recent researches are suggesting that the future improvements

may not be easily achievable. The main reason is the shortage of input labour force.

In Japan, the number of farmers is decreasing, and every year more rice paddies are

abandoned, while the average age of the farmers is increasing (Noguchi and Barawid,

2011). In addition, studies reveal that the younger generations are not interested in

agricultural activities. According to Bloss (2014), 60% of the farmers in Japan are

over 65 years of age.

The shortage in input labour force is a global issue, and it is not limited to a

particular region. For instance, in United States of America, less than 1% of people

are engaged in agricultural activities (Bloss, 2014), and in Europe (EU-27), 24.9%

of agricultural labour dropped(Eurostat, 2015) since 2000.

The main reason is that agriculture is a labour intensive activity with mediocre to

low level income. In addition, traditional and conventional farming methods, for

example relying on seasonal rain for watering the crop, endangers the end products

(Golait, 2007). In this era where demand for food is continuously increasing, the

(18)

methods much more difficult.

1.2

Agriculture: Current Trends and Methods

Over the years, more efficient tools and techniques have been developed to improve

productivity of agricultural processes. However, the proposed methods require one

common parameter: Human Labour. In recent decades, various approaches have

been developed to minimise dependency to human input labour force. As a result,

two main trends have been identified: (I) Mechanisation and (II) Precision Farming

(Zhang et al., 2002).

1.2.1 Mechanisation

Mechanisation in agriculture refers to “the application of tools, implements, and

powered machineries as inputs to achieve agricultural production” (Clarke, 1997).

The main advantage of agricultural mechanisation is that the technology satisfies

the real need of the farmers while the prices are affordable (Houmy et al., 2013).

Generally, agricultural machineries can be powered from three sources of energy:

manpower (or manual), animal, and motorised (using fossil fuel or electric power).

A manpower source produces 0.1 Hp (Horsepower) over a limited period. However

by harnessing power of animals, the productivity increases by 6 to 7 fold per animal.

By invention of combustion engine, the productivity was increased even more, up

to 10 fold. Today, agricultural tractors boost this efficiency up to 450 kW (612 Hp)

or more (Shearer and Pitla, 2013). But, even with the introduction of tractors still

a human is required for operation. A human has to drive the machineries through

a large field for various purposes during cultivation period.

(19)

larger portions of the field at a time. This requires the machines to become larger

and heavier, and this will lead to occurrence of soil compaction.

Soil compaction occurs whenever an external stress or pressure exceeds the internal

soil strength, also known as pre-compression stress value (Horna et al., 1995). Soils

level of stress depends on the soil type, the climate, and varies from one location

to another. Soil compaction results in reduction of soil pore volume which causes

reduction in space for air and water in the soil, and consequently reduction in soil

water infiltration (Graves et al., 2015). As a result, less rainwater can penetrate

into the compacted soil which either increases the potential of erosion and runoff,

or may cause the water to remain on the soil surface for longer period of time,

especially in wheel tracks (Wolkowski and Lowery, 2008). Other impacts of soil

compaction are limited root growth, reduction in nutrient uptake by roots, and

re-duction in micro-organism and earthworm activity (Graves et al., 2015). Recovering

from soil compaction is time consuming, and it increases the cost of cultivation by

90% (Blackmore, 2012).

1.2.2 Precision Farming

Even though by mechanisation the productivity is boosted significantly, the need

for a human as an operator constrains further progress. However in recent decades,

progress in search for human independent approaches has led to invention of

au-tonomous unmanned robotic vehicles.

The search for autonomous robots in agriculture started in 1920 when furrows

were used to guide tractors across the fields with reduced effort from the operator

(Mousazadeh, 2013), (Shearer et al., 2010). However the concept of fully autonomous

(20)

agricul-tural vehicles navigated throughout the field using leader cable guidance (Ming

et al., 2009). Today, autonomous agricultural robots are applied for various tasks.

Grift et al. (2008) classified advancement in agricultural robotics into four main

ar-eas: (1) Plant Oriented Robotics, (2) Animal Robotics, (3) Controlled Environment

Robotics, and (4) Field Robotics. Significant advances have been made in recent

decades in each of these application areas.

Even though robotic systems are slow in speed, they can operate consistently with

high precision for a long period of time in different weather conditions while reducing

the labour cost. In fact, autonomous dedicated farming units increase efficiency and

yield (Sukkarieh, 2012). This has convinced many countries to invest in autonomous

agricultural approaches (Tarannum et al., 2015). For instance in 2014, the Japanese

government announced plans to fund the development of unmanned farm tractors

(Bloss, 2014).

Although unmanned autonomous robotic approaches have succeeded at reducing

the labour force, they still require human observation for maintenance and failure

recovery (Noguchi and Barawid, 2011). Moreover, the current autonomous tractors

are costly, and only a narrow margin of farmers can afford them.

1.2.3 Multi Robot Approach

The idea of true human independent farming (not even as a supervisory role) led

to the invention of a new approach: multi robot system. Multi robot system is a

well-known topic in the robotics community in which a team of low-cost robots is

deployed into the field to cooperatively execute the given task.

Multi robotic approaches have several potential advantages over single robotic

(21)

cost of the system can be reduced (Jones and Mataric, 2005). In addition, a team

of robots can increase system flexibility and robustness by taking advantage of

in-herent parallelism and redundancy (Liu and Wu, 2001). Furthermore, multi robotic

approaches have better system reliability and scalability (Yan et al., 2013). Finally,

they have the potential to become completely human independent (Noguchi and

Barawid, 2011).

However, the main drawback of this approach is system complexity. Deploying

mul-tiple robotic units, which do not interact with each other, in a field to execute the

same task is insufficient, and often it results in complete failure (Jones and Mataric,

2005). The key parameter to an effective and successful team of robots is

coop-eration. Cooperation emerges from individual cooperative behaviour. Cooperative

behaviour of robots has to be planned and designed accurately so that unwanted

competition among robots is prevented (Jones and Mataric, 2005).

In order to have a cooperative team of robots, first characteristics of the team have

to be identified. These characteristics define robots’ limitations and capabilities,

and sometimes are referred to as group architecture (Uny Cao et al., 1997). These

characteristics are as follows:

• Communication or Interaction Structure: explicit vs implicit.

• Control Structure: centralised vs decentralised.

• Differentiation: homogeneous vs heterogeneous.

Next, three main questions have to be answered:

1. How to divide the complex global task into smaller manageable subtasks (i.e.

(22)

2. How to distribute and assign each subtask to each participating robot (i.e. task

allocation)?

3. How robots can attend their assigned task in a shared environment without any

collision and congestion (i.e. coordination)?

Consequently, by answering these three questions, cooperation could emerge from

a team of robots. The emerged cooperation can be scaled and quantified with

the following parameters: scalability, robustness, self-organisation, andcoordination

strength (Barca and Sekercioglu, 2013), (Farinelli et al., 2004). These terminologies

will be discussed in more details in Chapter 2.

The current trend in multi robotic approaches in the field of agriculture is to achieve

cooperation through a dedicated coordinator via explicit forms of interaction. In

ex-plicit forms of interaction, each robot deliberately broadcasts its intentions to other

members or an individual in the team. These messages could be transmitted via

Wi-Fi, Bluetooth, or via any other types of signalling including blinking LED,

ul-trasounds, vibration, and etc (Uny Cao et al., 1997). With explicit forms of

interac-tion, “robots’ behaviours can be planned according to a complete prior knowledge”

Barca and Sekercioglu (2013). However, these approaches are susceptible to the loss

of communicating signal while the computational cost increases with the increase

in the number of participating robots. In addition, they have limited scalability,

robustness, and self-organisation (Parker, 1993) (Lumelsky and Harinarayan, 1997).

However, in implicit forms of interaction, robots intentions are observed and

inter-preted either by changes in the environment created as a result of robots movement

or task execution or local interaction among robots (Uny Cao et al., 1997). This

form of interaction is unintentional, and hence it is referred to as indirect form of

(23)

system can become scalable, robust, and highly self-organised. Besides, the loss of

communicating signal can no longer affect the success of the team.

1.3

Research Question, Aim and Objectives

To this date, there have been no approaches in the field of agriculture in which

coop-eration is achieved through implicit forms of interaction. This research is conducted

to investigatethe feasibility of cooperation via implicit forms of interaction

in a large team of robots for various agricultural tasks which are executed

in an open field.

The main aim of this research isto develop cooperative behaviour mechanism

by which a team of robots can execute an agricultural task (e.g.

plough-ing, sprayplough-ing, and harvesting) in a large environment without the use of

explicit forms of communication or central organiser.

To obtain this aim, the following objectives have been foreseen:

• Description of the team architecture and the cooperative model.

• Review and analysis of related works.

• Analysis of the targeted tasks.

• Description and modelling of cooperative approaches.

• Simulation of the proposed approaches.

• Implementation and Validation of the designed approaches.

1.4

Thesis Contribution

(24)

To this point, there have been no attempt in open field farming in which a

coopera-tive behaviour emerges in a team of robots as a result of implicit interaction. All of

the related works in the application of open field farming have been accomplished

using explicit forms of communication. In this thesis, the proposed approaches are

based on implicit forms of communication. In other words, robots do not transmit

their intentions intentionally using explicit forms of interaction.

Spatial Congestion Clearance Using Implicit Form of Interaction In

gen-eral, when operating in a shared environment, robots may aim to navigate to a

shared coordinate in space. In this situation, congestion is inevitable. Normally, a

central unit coordinates the robots to prevent congestion. Alternatively, a

conges-tion is resolved between two robots using some form of signalling. Both approaches

require explicit form of interaction. In this thesis, an approach is suggested that

(25)

1.5

Thesis Layout

The layout of this thesis are as follows:

Chapter 1: This chapter presents the research motivation and background, and

the research aim and objectives. The main aim of this chapter is to assure

that the reader comprehends the urge for human independent approaches to

perform agricultural tasks. In the first section, a global and epidemic issue in

agriculture which jeopardizes the future of food industry is discussed. Next,

current trends aiming to compensate the raised issue are presented. Finally,

the direction of research and aim and objectives of the research are listed.

Chapter 2: In this chapter, the terminology introduced previously are discussed.

Next, with the defined terminology, the architecture of the team which is

considered in this thesis is introduced. Finally, similar works are described

and analysed.

Chapter 3: In this chapter, ploughing with a team of robots is discussed. First,

the task of ploughing is analysed to determine the design considerations and

requirements. Next, the recognised problems are addressed, and two

coopera-tion models are presented. Further, the results obtained from analysing these

models are presented, compared, and criticised. Finally, to improve the system

and compensate the identified drawbacks, an optimised method is presented,

analysed, and compared with the previous cooperation models.

Chapter 4: In this chapter, spraying with a team of robots is discussed. This

includes analysis and identification of design consideration and requirements

(26)

cooper-ative model, implementation and discussion regarding the obtained simulation

results.

Chapter 5: This chapter presents conclusions and discussions over the obtained

results. Moreover, it aimed to identify the future research axis to this research.

1.6

Research Location

The research is carried out in Sheffield Hallam University, Materials and Engineering

Research Institute (MERI), Centre for Automation and Robotics Research (CARR).

Numerous robotic researches have been conducted in this centre in variety of robotic

fields from human robotic interaction to multi robotic systems and swarm robotics.

The related projects in multi robotics and swarm robotics include GUARDIAN

(Guardian, 2010) and I-SWARM (ISwarm, 2006). In the GUARDIAN project, a

team of robots provide vital environmental information (including obstacles,

partic-ular toxic gas level, and etc) to a fire fighter who is surrounded by the team through

the modified oxygen mask. On the other hand, the aim of I-SWARM is the

real-isation of collective intelligence of swarm of microrobots, in terms of cooperation

and collective perception using knowledge and methods of pre-rational intelligence,

machine learning, swarm theory and classical multi-agent systems (ISwarm, 2006).

In addition to swarm related projects, the research centre hosts projects from other

areas in the field of robotics. In human robot interaction area, CARR hosts

En-gineering and Physical Sciences Research Council (EPSRC) funded project called

REINS (REINS, 2011). In REINS, the focus is to develop a semi-autonomous

mo-bile robot with sensory capabilities that transfer environmental information to the

attached fire fighter via haptic and tactile interaction methods in a smoked filled

(27)

The supervisory team, Prof Jacques Penders and Dr. Lyuba Alboul, were involved

in the mentioned projects along with other related research projects which are not

(28)

CHAPTER 2

LITERATURE REVIEW

The main aim of this chapter is to demonstrate that the current approaches in the agricultural robotics are not reliable and sufficient for future development and expansion. The relevant definitions in multi robot system are discussed in 2.1 and 2.2. The application domain in multi robot system is reviewed in 2.3. Multi-robotic team characteristics are reviewed in 2.4 and design questions in any multi-robotic team is mentioned in 2.5. Finally, the previous contributions in multi-robotic farming is reviewed in 2.6.

2.1

From Multi Agent System to Multi Robot System

The modern approach to artificial intelligence is centred around the concept of

au-tonomous agents (Vlassis, 2003). According to Wooldridge and Jennings (1995), an

entity can be counted as an agent if it has the following properties:autonomy: to

make decisions without the direct intervention of others, reactivity: to perceive

the surrounding environment (e.g. the physical world or a graphical user interface)

and to provide appropriate response. pro-activeness: to exhibit goal-directed

be-haviours by taking the initiative. social abilities: to interact with other entities

via some kind of agent-communication language. Inter-agent communication has

utmost importance in multi agent systems in which multiple autonomous agents

aim to solve a problem cooperatively.

The concept of an agent in computer science, generally is applied to software as it

(29)

act upon that environment through actuators in a goal-directed behaviour while

they can communicate with other robots in the environment (Russell and Norvig,

2003). Therefore, the existing concepts and solutions in agent-based systems can be

applied (if applicable) to robotic-based and multi robotic-based problems.

2.2

Multi Robot System

In the past decades, single robot systems have been applied to numerous application

domains. As tasks become more and more complex, the robotic units are designed

more complex to fit the given task. However, there are tasks which a single robot,

regardless of how sophisticated the robot design is, is either incapable to carry out

successfully or it requires a long time to complete the process. Consider a search and

rescue scenario in which a robot is given a map of the environment and it is required

to search for injured human beings and to act appropriately upon detection. Clearly,

time is an important asset in this example, and it is preferred to perform the task

as fast as possible. If a single robotic unit is deployed, despite how fast it performs

at every single point on the map, the maximum efficiency cannot be reached. In

addition, the success of the task is susceptible to the loss of the single robot. In

other words, if the robot fails in the middle of the operation, the task cannot be

completed and the robot has to be recovered.

These weaknesses of single robotic units have led to the deployment of multiple

robots. In this approach, a group of robots functions together to complete a shared

goal. The key to success of the given task is the presence of some form of cooperation

among the individuals in the group. In other words, it is not possible to achieve

(30)

2.3

Application Domain of Multi Robot System

The concept of multi robot systems is being applied to various new tasks every year.

In this section, we provide a brief overview of the current application domains for

multi robot systems.

2.3.1 Foraging

In foraging, the aim is to pick up and gather objects which are scattered in the

environment (Farinelli et al., 2004). This application domain is inspired by the

behaviour of ants that search for food sources distributed around their nest Sahin

et al. (2008). The main challenge in this domain is to implement an optimised

search strategy to maximise the ratio of the returned food. There are various tasks

which require foraging including search and rescue (Beck et al., 2016), toxic waste

cleaning, mine cleaning, and service robots (e.g. (Jung and Zelinsky, 2000);(Jeon

et al., 2016)).

2.3.2 Area Coverage and Exploration

Similarly to foraging, in area coverage, the aim is to visit or analyse all the free

points in space as efficiently as possible (Choset, 2001). Various tasks including

demining (Santana et al., 2005), snow ploughing (Saska et al., 2013), line searching

(Marjovi et al., 2010), open field processing (Noguchi et al., 2004); (Batalin and

Sukhatme, 2002), beacon distributing (Howard et al., 2002), lawn mowing (Zheng

et al., 2005), and car-body painting (Graca et al., 2016) are categorised in area

coverage application domain.

In a slightly different area of application, robots are aimed to explore and analyse

(31)

difference between exploration and area coverage application domains is that in area

coverage the map of the environment may or may not be given to the robots prior

to execution, whereas in area exploration the field is completely unknown to the

robots. Therefore, the main issue in area exploration is to generate a global map of

the environment cooperatively and use the map for further navigation or processing

(e.g. (Simmons et al., 2000); (Thrun and Liu, 2005); (Koch et al., 2015)).

2.3.3 Multi-Target Observation

In multi-target observation, also known as CMOMMT: Cooperative Multi-robot

Observation of Multiple Moving Targets (Farinelli et al., 2004), first introduced by

Parker (1999), a team of robots are required to detect and track a group of moving

targets cooperatively. Multi-Robot Target Observation has many connections with

security, surveillance and recognition problems (Werger and Mataric, 2000) where

targets moving around in a bounded area must be observed.

2.3.4 Object Transportation

In this application domain, robots are required to transport objects from point A

to point B. Depending on the size of the objects and capabilities of the robots, the

approaches could further be classified into (i) cooperative pulling/pushing and (ii)

individual object transportation. In cooperative pulling/pushing, individuals are

incapable to transport an object from A to B. Instead, they cooperatively push or

pull (sometimes the combination of both) the object (e.g. (Mataric et al., 1995);(Jose

and Pratihar, 2016);(Weber et al., 2015);(Vig and Adams, 2006);(Yamada and Saito,

1999)). In object transportation, however, the robots are capable to pick up and

carry an object from one location and deliver it to another location individually (e.g.

(32)

2.3.5 Flocking

In the flocking task, the goal is to navigate together while particular formation is

maintained in the team. This application domain is inspired by formation control

of a flock of flying birds. Cooperation among the individuals is also used to localise

each other, and to fuse information acquired from the environment. Similar to

exploration, map building of unknown environments is a common task tackled in

this application domain, though the difference is that in exploration, there may or

may not be a particular formation among the team. The problem of exploration

and flocking is related to several applications such as transshipment operations in

harbours, airports and marshalling yards (Arbanas et al., 2016), motion coordination

in industrial applications and exploration of dangerous environments (Solovey et al.,

2015).

2.3.6 Soccer

In recent decades, robotic soccer has become an interesting test bed for research

in cooperative multi agent and multi robot system (Kitano et al., 1997). This is

because the environment in which the robots operate is dynamic, and hostile by

which coordination becomes extremely challenging (Farinelli et al., 2004).

2.4

Team Characteristics

Before proposing any design or approach, the characteristics of the team have to be

identified. These characteristics determine the individual and the team level control

structure, strategies or steps to distribute the subtasks and to allocate the required

(33)

2.4.1 Control Structure

The most fundamental decision that has to be made in defining characteristics of a

multi robotic team is how individuals in the team perform decision making. Decision

making is referred to as a “cognitive process resulting in the selection of a course

of action among several alternative scenarios” (Yan et al., 2013). In a multi robot

system, decision making is carried out incentralised ordecentralised manner.

Centralised: In a centralised team of robots, there must be at least one robot

or computer which has a complete global information of the environment, other

robots, and the state of the task. This centralised unit is needed to perform task

allocation and coordination among the participating robots in the team (Barca and

Sekercioglu, 2013).

The centralised approach has been studied extensively in various fields of

applica-tion. Tang and Parker (2005) developed a centralised based system by which a

collection of heterogeneous robots reorganise into subteams as needed depending

upon the requirements of the application tasks and the sensory, perceptual, and

effector resources available to the robots. Tang and Parker then applied the system

to the task of box pushing and object transportation. The reason that robots have

to form particular formation at the beginning of the task is that not all robots in the

team have localisation system. The formation will assist the robots without

locali-sation to navigate. Khan et al. (2016) proposed a centralised system for formation

control of nonholonomic mobile robots for obstacle avoidance in a cluttered

envi-ronment. Khan et al. tackled the problem by using “proportional-integral average

consensus estimators”, whereby information from each robot diffuses through the

(34)

control for multi robot exploration application. In this approach, robots connect to

the base station only when making new observations so the communication is

per-formed more effectively. In exploration in known environment application, Yan et al.

(2010) developed an online sampling-based graph, by which the optimal path is

cal-culated for the robots. Wurm et al. (2008) proposes a coordination mechanism

for a team of exploring robots using segmentation of the environment to determine

exploration targets for the individual robots. The central unit assigns each robot to

a separate segment, thus a balanced distribution of the robots over the environment

is achieved. Yan et al. (2012) developed an empirical-based heuristic planning

strat-egy for the goods transportation by multiple robots. In here, the focus is to plan the

transportation task for each robot by estimating the production rate of goods based

on multi-robot coordination. The centralised approach is also used for multi robot

path planning. Luna and Bekris (2011) present an efficient and complete approach

for multi-robot path planning problems using graph-theory. In there, the central

unit performs the calculations and assigns the paths to each robot.

Decentralized A decentralized architecture is categorized as either distributed or

hierarchical (Uny Cao et al., 1997). In a distributed approach, there is no central

agent to perform decision making, and individuals are equal from the control the

point of view, and each participating individual performs decision making completely

autonomously. In a hierarchical architecture, robots are divided into smaller groups,

and decision making in each group is carried out by local decision makers (Uny Cao

et al., 1997). Yan et al. (2013) refers to this approach as hybrid since it has

properties of both the centralised and decentralised approaches.

Decentralised systems are applied in various multi robot applications. In search

(35)

of homogeneous robots by which a fire-fighter is guided through a smoked field

environment. In this example, robots always maintain their distance toward the

fire-fighter and each other. All the decision making is carried out individually and robots

utilise only the information collected by their sensors. In area coverage application

domain, Ranjbar-Sahraei et al. (2012) presents an intelligent approach by which

a team of robots covers an area cooperatively. In this example, robots mark their

territory by dispensing pheromone-like materials at the border of the claimed area.

Upon detection of another robots’ pheromone, they perform simple navigational

movement (e.g. turn left/right). In formation control application domain,

Lopez-Gonzalez et al. (2016) proposes a formation scheme, based on Lyapunov techniques,

if the orientation and distance information for each robot is available locally.

Discussion Although, with a centralised system, an optimal plan based on the

global knowledge can be planned, the efficiency drops significantly as the size of the

team increases. Besides, it is not robust in relation to dynamic environments or

failure in communications and other uncertainties (Yan et al., 2013). Moreover, a

centralised architecture is a leader dependent approach which means with failure of

the central unit the system will be incapable of operating (Parker, 1993).

On the other hand, using a decentralized system carries advantages including the

decrease in delay and impracticalities associated with centralized processing,

inde-pendence of computational complexity and size of the team, increase of robustness

toward the loss of the leader, and efficient use of parallelism. The only drawback

of a decentralized architecture is limited awareness of individuals about the global

(36)

2.4.2 Differentiation

It is important to decide whether the individuals in a team of robots have the same

capabilities or not since this will greatly affect how the underlying control schemes

will operate (Barca and Sekercioglu, 2013).

A team of robots could be either homogeneous or heterogeneous. In a homogeneous

team, individuals are identical meaning that they have the same hardware and

control software (Uny Cao et al., 1997). Various examples involving homogeneous

team of robots are in cooperative path planning (Habibi et al., 2016), cooperative

localisation (Tsai et al., 2015), search and rescue (Balta et al., 2015); (Couceiro,

2015), cooperative exploration in an unknown environment (Wang and Olson, 2016),

and target tracking (Zheng and Tan, 2015); (Senanayake et al., 2016).

In a heterogeneous team of robots, individuals have different designs and

functional-ities which compliment each other Barca and Sekercioglu (2013). Like homogeneous

teams of robots, heterogeneous teams of robots have been deployed in various

ar-eas of application including topological map-building (Ramaithitima et al., 2016),

search and rescue (Beck et al., 2016);(Gunn and Anderson, 2015), cooperative area

coverage (Pierson and Schwager, 2016), formation control (Sen et al., 2016),

cooper-ative exploration in an unknown environment (Dai et al., 2016), foraging (Castello

et al., 2016); (Prorok et al., 2016),and target tracking (Robin and Lacroix, 2016).

It is important to note that heterogeneity introduces more complexity to the system

due to (1) highly complex task allocation and (2) more dependency on modelling

other robots in the team (Uny Cao et al., 1997). Individuals in a heterogeneous team

of robots have different capabilities. To quantify this, a concept calledtask coverage

is introduced. Task coverage (in individual level) measures “the ability of an agent or

(37)

coverage determines the level of cooperation in the team. When the task coverage

is high, task can be accomplished without cooperation, but otherwise, cooperation

is necessary. In the homogeneous teams of robots, the task coverage is maximal

and decreases as the group becomes more heterogeneous. Unlike homogeneous, in

the heterogeneous team of robots task coverage is determined based on individual

capabilities hence more parameters should be considered in the calculation of task

coverage (Uny Cao et al., 1997).

One common trend for task allocation in a homogeneous team of robots is through

role assignment which will be allocated either at design-time or arises dynamically

in real-time (Uny Cao et al., 1997). Numerous researches have been conducted

in this field and different task allocation and role assignment algorithms and

tech-niques have been developed for homogeneous teams of robots including Contract Net

Protocol (Smith, 1980), Dynamic token generation (Cottefoglie et al., 2004), Game

theoretic approach (Arslan et al., 2007), etc. There are also approaches which

do not rely based on any well-known algorithm. Mendoza et al. (2016) applied

role assignment-based task allocation to a homogeneous team of robots deployed in

ROBOCUP 2015 soccer competition. In this particular example, robots task, which

is covering particular zone in the field, is carried out by a dynamic zone selection

algorithm in which robots select specific zones in the field according to the flow of

the game.

But is it possible for a team of homogeneous robots to turn into a heterogeneous

one? In theory, a homogeneous team of robots is a team in which individuals are

identical in terms of software and hardware. However, in various scenarios in which

robots have learning and self-designing algorithms (e.g. (Li et al., 2002), Luke et al.

(38)

suggested definition, a homogeneous team becomes heterogeneous. In this scenario,

the task allocation could be carried out in both ways depending on the application.

2.4.3 Communication Structure

Another important characteristic in any team of robots is how the team share their

knowledge about the task and the environment. This is referred to as communication

structure or interaction structure. Over the past decades, various classifications

are proposed. Uny Cao et al. (1997) classified multi robot communication into

three categories: (i)interaction via environment, (ii) interaction via sensing, and

(iii) interaction via communication.

Later, a more abstract classification was used to describe interaction models. In

this classification, interactions are either implicit, which encompasses interaction

through sensing other robots and through the shared environment, orexplicit, which

encompasses interaction through communication, (Yan et al., 2013).

Interaction via environment In this approach, robots utilise the available hints

in the shared environment created by other robots as a result of their execution to

extract necessary information. This form of interaction is inspired by the complex

nest building behaviours in ants and termites first described by Grass´e (1959).

More-over, since the information is perceived and not intentionally transmitted, this form

of interaction is categorised as an indirect form of interaction.

This form of interaction is extremely popular in the multi robotic and swarm

com-munity, and there are several examples in which cooperation among robots is merged

as a result of their indirect interaction. Parker et al. (2003) presents a robust

al-gorithm for collective robotic construction. In here, the robots, which are equipped

(39)

of any rubbles with an algorithm called blind bulldozing. In this three state finite

state machine algorithm, the robots wander around the field and plough the existing

rubbles into the field borders. When the material that the robot is pushing exerts

a force which is beyond certain threshold, the robot reorient its heading and

con-tinues as before. The similar reorientation occurs if the robot collides with another

robot. Willmann et al. (2012) presents another scalable and robust cooperative

team using only indirect form of communication. In this example, the autonomous

flying vehicles are given the blueprint of the structure and the location where they

can pick the building materials. In this sequential construction, robots place the

building materials right next to the last placed building block. In this way, robots

interaction is through the constructed building.

In (Ranjbar-Sahraei et al., 2012), a team of robots mark their territory by dispensing

particular pheromone. Upon detection marks of another robot, the robot deviates

its path. In this way, robots can cover the entire area cooperatively. Zedadra

et al. (2016) demonstrates a multi agent foraging algorithm named Cooperative

Switching Algorithm for Foraging (C-SAF) inspired from the classical ant system.

In this approach, robots, while searching for food, mark their trail by dispensing

detectable forms of pheromones. In the meantime, “robots create simultaneously

and synchronously a pheromone wave front expansion from the nest to the food and

can use the negative gradient to go back to nest”(Zedadra et al., 2016).

Interaction via sensing In an alternative approach, the necessary information is

perceived by sensing other robots in the team. This approach is inspired by

forma-tion control in flocking birds described by Reynolds (1987). This form of interacforma-tion

is also classified as an indirect form of interaction since there is no intention in

(40)

to differentiate and recognise other robots from other objects in the environment

which demands a modelling. The main application is those that require some form

of formation control for example cooperative guidance of a firefighter in smoke filled

environment (Saez-Pons et al., 2010). Saez-Pons et al. presents a cooperative team

of robots that surrounds the firefighter and provide environmental information back

to the firefighter. In this approach, robots aim to maintain their formation while

navigating using the attached range sensors. In (Saska et al., 2013), the robots,

which are performing snow ploughing the roads at the airport, monitor each others’

behaviour and trail with the attached range sensor to adjust their trajectory.

Interaction via communication In this approach, robots transmit their

inten-tions directly to another robot or broadcast via explicit forms of communication

including RF messages (e.g. Bluetooth, Wi-Fi), visual signals (e.g. blinking LED,

RGB LEDs), and other methods including ultrasound messages (Uny Cao et al.,

1997). This often requires a dedicated onboard communication module (Yan et al.,

2013). An interesting taxonomy based on communication presented by Dudek et al.

(1996) classifies multi robotic teams according to their communication range,

com-munication topology, and comcom-munication bandwidth. Since conveying information

is intentional, this form of interaction is referred to as a direct form of interaction.

Extensive works have been carried out in this form of interaction in various

ap-plication domains. Simmons et al. (2000) demonstrates how a team of robots can

cooperatively create a global map of the environment. In this example, the mapping

problem is decomposed in a modular, hierarchical fashion: Each robot maintains its

own local map. A central module receives the local maps and combines them into

a single, global map. Rao et al. (2016) presents an algorithm for cooperative

(41)

than a central module. In this approach, Utility Based Return (UBR) is used to

perform collaborative exploration. All vehicles start moving from a unique base

sta-tion and spread out by performing frontier-based explorasta-tion. Frontiers are selected

based on a utility value which is a trade-off between the expected information gain

at the frontier and the cost to get to it. The vehicles in the vicinity of each other

assign these frontiers among themselves based on the utility value so as to maximise

the total utility of the exploration. The vehicles sense obstacles and map the area

according to the obstacles found, while detecting new frontiers to decide where to

move. When in range with other vehicles, the exploration decision is collaborative

and each vehicle chooses a different frontier to explore in order to avoid more than

one vehicle exploring the same area.

Discussion Although with explicit forms of communication high level of

accu-racy can be achieved, the overall computational cost of the system increases as the

number of participating robots increases. With implicit forms of communication,

although perception and interpretation of information are more complex, the

sta-bility, flexista-bility, and fault tolerance of the system are better than with explicit

forms of communication. However, various researches suggest that systems in which

interaction is carried out by the combination of both implicit and explicit forms

of communication simultaneously can have both approaches’ advantages. Various

pieces of literature refer to this form of interaction as a hybrid form of interaction

including (Barca and Sekercioglu, 2013);(Yan et al., 2013);(Sahin et al., 2008) to

(42)

2.4.4 Representative Architecture

Any multi robot system inevitably needs to define the aforementioned parameters

prior to system level design or individual behaviour design. In fact, these axes

determine the type of behaviours required for individuals. For instance, if a team of

robots is homogeneous, individuals can model each with unified dimensions. Over

the past decade, several architectures have been developed for different applications.

Few of these architectures are so well-defined that they are adopted as sub-categories

and directions in multi robot system. In this section, few of these architectures are

reviewed.

CEBOT (Cellular roBOTics system): First introduced by Fukuda and Kawauchi

(1990). It is a decentralised hierarchical architecture. A CEBOT team is divided

into smaller groups with local leaders. The leader robots are responsible to

allo-cate subtasks and communiallo-cate with other leaders. A distinctive characteristic of

CEBOT is that robots dynamically reconfigure their formation by changes in the

environment as the architecture is inspired by the cellular organisation of biological

entities (Cao et al, 1997).

SWARM: It is a distributed, decentralised, autonomous large groups of robots

(n > 10) that normally interact with each other through the environment. Swarm

robotics inspired mostly by swarm intelligence. Swarm intelligence is defined as

col-lective intelligence that emerges from interactions among large groups of autonomous

individuals (Barca and Sekercioglu, 2013). Sahin (2004) defines “Swarm robotics as

the study of how a large number of relatively simple physically embodied agents can

be designed such that a desired collective behaviour emerges from the local

inter-actions among the agents and between the agents and the environment”. In swarm

(43)

et al., 2008). Robustness, flexibility, and scalability are built in characteristics of a

swarm.

GOFER: It is first developed by Caloud et al. (1990) to study distributed problem

solving in indoor environment in a team of mobile robots (Uny Cao et al., 1997).

In this approach, a central unit, which has a global view of the given task and the

rest of the robots, generate a plan structure which contains task distribution and

team scheduling. The GOFER architecture was successfully used with three physical

robots for tasks such as following, box-pushing, and wall tracking in a corridor.

ACTRESS (ACTor-based Robot and Equipment Synthetic System): First

intro-duced by Asama et al. (1989), and inspired by Universal Modular ACTOR

Formal-ism (Hewitt et al., 1973). This architecture consists of three heterogeneous robots

each responsible for different task along with three workstations. In the deployed

application domain, individuals are not capable to perform the given task (e.g.

push-ing a box) alone, and they have to cooperate with each other. The cooperation and

coordination are achieved through negotiation among robots, hence the focus of this

approach is to improve the efficiency of the communication among robots.

ALLIANCE: Introduced by Parker (1994b), ALLIANCE is developed originally

to study cooperation in a heterogeneous, small-to-medium-sized team of robots.

ALLIANCE is a hybrid in communication architecture since the information is

per-ceived from the environment as well as broadcast messages in the environment.Although

with explicit forms of communication high level of accuracy can be achieved, the

overall computational cost of the system increases as the number of participating

robots increases. With implicit forms of communication, although perception and

interpretation of information are more complex, the stability, flexibility, and fault

(44)

How-ever, various researches suggest that systems in which interaction is carried out by

combination of both implicit and explicit forms of communication simultaneously

can have both approaches’ advantages. Numerous pieces of literature refer to this

form of interaction as hybrid (Barca and Sekercioglu, 2013);(Yan et al., 2013);(Sahin

et al., 2008).

2.5

Main Questions in Multi Robot System

The multi robot system is a group of autonomous agents which have a shared goal

and work together to achieve the given task. From the psychological point of view,

robots are selfish, utility-driven agents (Uny Cao et al., 1997) which only aim to

succeed at the given task. In this situation, competition rather cooperation emerges

in a group of single robot systems to access the shared resources in the environment

(Jones and Mataric, 2005). It could be said that the key element that separates

multi robot teams from a group of single robot systems is cooperation (Jones and

Mataric, 2005).

Cooperation requires three main elements: task partitioning, task allocation, and

coordination. In any multi robot application, the global task has to be analysed,

and if necessary the global task has to be divided into manageable portions referred

to as sub-tasks. This process is referred to as task partitioning. Next, each subtask

is distributed to one or more individuals in the team. This process is referred to

astask allocation. Finally, robots attending sub-tasks require resources (including a

point in space) which have to be accessed while any probable congestion is avoided.

This process is referred to as coordination. In this section, these research elements

(45)

2.5.1 Task Partitioning and Allocation

The problem of task allocation is to respond to the question of“which robot is doing

which task?”. In order to answer this question, the global task has to be decomposed

into two or more sub-tasks. Task allocation and task partitioning are strongly

inter-twined together. According to Dias et al. (2006), there are two common approaches

for the aforementioned question. In one approach, the task is first decomposed and

then sub-tasks are allocated to the robots (also refer to as decompose-then-allocate)

(Caloud et al., 1990), or the global task is given to all individuals, and each robot

individually decomposes it to smaller manageable pieces (also known as

allocate-then-decompose) (Botelho and Alami, 1999);(Pini et al., 2011).

Task partitioning (or decomposition) also depends on the characteristics of the task

and the capabilities of the robots. According to the taxonomy provided in (Gerkey

and Mataric, 2004), a team of robots and a task can be classified based on few

characteristics:

(I) Single Task robots versus Multi Task robots: Multi Task refers to robots

which are capable of executing multiple tasks at a time, and Single Task refers

to robots which are capable of executing only one task at a time.

(II) Single Robot task versus Multi Robot task: A Single Robot task refers

to a task which require only one robot, whereas a Multi Robot task refers to

a task which require more than one robot to be completed.

(III) Instantaneous Assignment versus Time extended Assignment:

Instan-taneous Assignment means that the task can be allocated to individuals

in-stantaneously and without any extra information. Time Extended refers to

(46)

envi-ronment, the team, or the completion state of the task.

There are various methods that the global task can be divided and distributed among

a team of robots. In here, the reviewed task allocation methods are divided into two

main approaches: (I) Static Task Allocation, and (II) Dynamic Task Allocation.

In static task allocation, prior to task execution, the task is divided into smaller

man-ageable sub-tasks and distributed to each individual in the team at the design time.

For instance in applications related to processing an open field, the environment is

first divided and distributed among robots in a way so that robots’ navigation are

minimised using various theories and algorithms including graph theory (Sungjun

et al., 2015), (Fazeli et al., 2010), and (Ahmadi and Stone, 2006). Although static

allocation is fast and efficient, it does not tolerate any real-time changes that could

occur in the environment.

In dynamic task allocation, the task will be distributed among robots during the task

execution. According to Karla and Martinoli (2006) The dynamic task allocation

can further be classified into two sub-categories: threshold-based and market-based

task allocation. In threshold-based approaches, the robots utilise the changes in the

environment to identify the state of the global task and what is required to be done

next. A robot resumes its search for hints in the environment until it reaches the

conclusion that the global task is completed. Threshold-based task allocation has

been applied to various application domain including foraging (Krieger et al., 2000)

and aggregation (Agassounon and Martinoli, 2002).

In market-based approaches, robots act as self-interested agents in pursuit of

indi-vidual profit. Tasks often are distributed through auctions held by an auctioneer.

The auctioneer is either a supervisor agent or one of the robots. “Each robot

(47)

and encapsulate the cost in the bids” (Dias et al., 2006). Depending on the task,

the auctioneer selects the highest or the lowest bidder (Karla and Martinoli, 2006).

Sometimes, instead of allocating particular task, such as shoot the ball or cover

a specific area, roles are assigned to the robots. Roles define a collection of

re-lated actions or behaviour (Dias et al., 2006). Auction-based task-allocations have

been applied to cooperative exploration (Zlot et al., 2002) and object manipulation

(Gerkey and Mataric, 2002).

2.5.2 Coordination

Coordination is the core element of a multi robot system by which the overall

perfor-mance of the system is affected directly (Yan et al., 2013). Various works have been

carried out in this area. In here, we review the available two important categories

of coordination systems in multi robot systems: Dynamic and Static.

Dynamic vs Static In one classification, coordination can be carried out

stati-cally, or dynamically. In static coordination, which is also known as deliberative or

offline coordination (Todt et al., 2000);(Iocchi et al., 2000), robots adapt series of

conventions prior to engaging in the task (Yan et al., 2013). Kato et al. in (Kato

et al., 1992) coordinates a team of robots by simply applying few navigational rules

(e.g. “keep right” or “stop at an intersection”, etc). Although coordination can be

achieved efficiently and quickly, it requires detailed analysis of the given task, and

it can easily fail by radical changes in the given task or the environment.

Dynamic coordination, which is referred to as online or reactive coordination (Todt

et al., 2000);(Iocchi et al., 2000), is carried out during execution of a task and is

based on “analysis and synthesis” of information which can be obtained by means of

(48)

robots is conveyed explicitly or implicitly. Accordingly, dynamic coordination is

performed either by transferring intentional messages (i.e. explicit coordination

(Gerkey and Mataric, 2004)) or as a result of robots local interacting with the other

robots or the shared environment (i.e. implicit coordination). Dynamic coordination

can well adapt to changes in the environment in real-time, however, coordination is

becoming more complex by the increase in complexity of the task.

Taxonomy Based on Individual Knowledge and Awareness In another

clas-sification introduced by Farinelli et al. (2004), coordination in the team can be

cat-egorised according to individuals’ knowledge and awareness. In this classification, a

multi robot system is one of the following:

Unaware in which individuals have no information about other robots in the team

while they execute their share of the task. Since robots have no knowledge about

each other, the communication among the robots cannot be direct. Unaware teams

are easily scalable, thus they are adopted for swarm robotic applications.

Aware, not coordinate systems in which robots of the team have the knowledge

of the presence of other robots in the environment, and act together in order to

accomplish the same global goal. However, a robot may not take into account the

actions performed by other robots in order to accomplish its task.

Weakly coordinated systems in which individuals follow explicit predefined

co-ordination protocols. In here, coco-ordination protocols refer to the explicit predefined

rules that select particular

Strongly coordinated, strongly centralized systems in which a robot plays the

role of the leader and it coordinates other robots in the environment. This method

requires explicit messages to be transferred among robots. This method suffers from

(49)

Strongly coordinated, weakly centralized systems in which the leader is

se-lected in prior, and it will be sese-lected during execution time. In weakly centralised

approaches, the interaction architecture is hybrid. This means that the robots

ex-change information via explicit and implicit forms of communication. Noreils (1993)

and Simmons et al. (2001) are two examples in which the coordination is achieved

by means of hybrid interaction architecture.

Strongly coordinated, distributed systemsin which each individual in the team

executes a coordination protocol, and takes its decision completely autonomous.

These systems are generally more robust to communication failures and robot

mal-functioning, even though these problems may affect the overall performance of the

team in the accomplishment of the task. “The strongly coordinated distributed

approach entails that some kind of communication has to be used, and leaves

un-constrained the other System Dimensions” (Farinelli et al., 2004).

2.5.3 Congestion Avoidance and Clearance

The goal of coordination is to prevent or resolve probable congestions during task

execution. There are two sources of congestion in a multi robot system: collisions

and resource conflicts. Resource conflicts occurs when multiple requests targeting

the same resource arrive simultaneously (Yan et al., 2013). The problem of

re-source conflict is not specific to robotic applications. In distributed computing and

multi-access networking, where a single resource is accessed by different processes,

a resource conflict occur

Figure

Figure 3.1: A farmer is ploughing a field using tractor equipped with conventional
Figure 3.3: Ploughing units are performing furrow transitioning (Estate, 2015)
Figure 3.5: Pattern of ploughing with conventional mouldboard: (a) ploughing starts
Figure 3.6: Pattern of ploughing with a reversible mouldboard: ploughing starts
+7

References

Related documents

Existing research revealed the benefits of using SRSs, which are: increased student motivation and engagement; easier clarification of misunderstanding; promotion of active

¡  Generate relevant project reports ¡  Allow mobile PMIS access... Dux Raymond Sy,

In the development of slope area within class III (slopes 26 to 35 degrees) and IV (slopes more than 35 degrees) in Bukit Antarabangsa, Selangor, observes the major role of

Comparisons with the com- monly used cumulative root frequency method using four positively skewed real populations divided into three, four and five strata, showed substantial

Therefore, the aims of this thesis were to test the hypotheses (1) that Broca‘s area is involved in rapid phonological access during visual word recognition, (2)

 In situations with ongoing dabigatran related life-threatening bleeding, not controlled by the above measures, administration of prothrombin complex concentrate (PCC) 25 units

The first part (a) models soil stratification and bedrock levels, the second part (b) groundwater drawdown, the third (c) subsidence and the final part (d) risk in terms of

The three way dip closure at Lapacho is part of a much larger regional sub-crop trap, as described in the RPS Independent Audit Report of Prospective Resources, dated