Stochastic Programming with Cauchy Distribution
Manas Kumar Pal
Institute of Management & Information Science Bhubaneswar, Odisha, India
S. Bagh
Department of Statistics, Sambalpur University Orissa, India
Abstract
The aim of this paper is to derive a method for solving a stochastic linear programming problem with Cauchy distribution. Assuming that the coefficients are distributed as Cauchy random variables, the stochastic linear programming is converted to a deterministic non-linear programming problem by a suitable transformation. Then an algorithm can be used to solve the resulting deterministic problem .A numerical example can be considered to illustrate the above methodology.
Keywords and phrases: Stochastic programming, Cauchy random variables, Probability density functions, Levy inversion theorem.
Introduction
Charnes and Cooper [6] first introduced the stochastic programming by taking different objective functions and constraints. Various models have been suggested by several researchers and most of the probabilistic model assumes normal distribution for model coefficients.
Here we consider a stochastic programming problem with Cauchy distribution. A stochastic linear programming problem can be presented as follows:
Max
n
j j jx c Z
1
, (1)
Subject to the constraints,
m i
b x a
ob i
n j
i j
ij 1 , 1,2,..., Pr
1
(2)
, ., ,... 2 , 1 ,
0 j n
xj
First we obtain the probability density function of the linear combination of ‘n’ independent Cauchy random variables, then using the probability density function, the probabilistic constraints are converted to the deterministic constraints, and then the resulting non-linear deterministic problem can be solved.
Probability distribution of
n
i j ij
i a x
U 1
and the deterministic form of the probabilistic
constraint
Here we will find out the probability density function of random variable
n
j j ij
i a x
U
1
,
where aij, j=1, 2……… n are independent Cauchy random variables and xj, j=1, 2,……,n are variables .Then using it we find a deterministic form of the probabilistic constraints in a stochastic linear programming problem. The density function of Ui can be obtained by studying the special cases with n=2 and n=3. Let us consider a model involving only two random variables, the ith probabilistic constraints can be stated by
a x a x
b i mob i i i 1 i, 1,2,...,
Pr 1 1 2 2
Where ai1 and ai2 are two independent Cauchy random variables Let Ui = ai1x1 + ai2x2
Then the density function of Ui can be obtained as,
U e t dtf u
itu ) ( 2
1
(Using Levy inversion theorem)
e itue x x tdt
1 2
2 1
dt e
e dt e
e itu x x t itu x x t 0
0
2 1 2
1
2 1
dt e
e dt e
eitu x x t itu x x t 0
0
2 1 2
1
2 1
dt
e
e
dt
e
e
itu x x t itu x x t 00
2 1 2
1
2
1
dt e
dt
e tx x iu t x x iu 0
0
2 1 2
1
2 1
0 2
1 2
1
2 1 2
1
2 1
iu x x e iu
x x
e t x x iu t x x iu
iu x x iu x x
1 1
2 1
Stochastic Programming with Cauchy Distribution
2 2 2
2 1
2 1 2 2
1
u i x x
x x
2 2 2 1
2 1
u x x
x x
(4)
Hence ith probabilistic constraints can be made deterministic constraints by integrating the probability density function of ui as stated below,
u du i mf i i
b i i
..., ,... 2 , 1 1
0
This can be simplified as follows,
ib
i i
b
i du
u x x
x x du
u f
i i
0
2 2 2 1
2 1
0
1
(5)
If ui ai1x1ai2x2 Then
1 2 2 1
i i i
a x a u
x and
2 1 1 2
i i i
a x a u
x
Now
2 1 1 1
2 2 2
1
i i i i
i i
a x a u a
x a u x
x
2 1
2 2 2 1 2 1 2 1
i i
i i
i i i
a a
x a x a a a
u
Let
2 1
2 2 2 1 2 1 2
1 2 1
i i
i i
i i
i i
a a
x a x a B and a
a a a
A
Then, x1x2 Aui B p(Say) Now putting the above values in (5)
i bi i
i i
b
i du
u B Au
B Au du
u f
i i
0
2 2 0
1
dp
A B p p A
p
B Abi
B
2 2
1
B Abi
A B A p p A
pdp B
2 2
1
B Abi
A B A p A
B A
p p A
pdp B
2 1
2 2
2
B Abi
A B p A
B p
A A
pdp B
2 2 2
2 2
2 1
1 1
B Abi
A B p A
B p
A A A
pdp B
2 2 2
2 2 2
2 1
1
B Abi
A B p A
B p
A A
pdp B
2 2
2
2 1
1
Let R=a+bt+ct2, where
A B a and A
B b A A c
2 2
2 ,
1
then,
R dt c b R c R tdt and B
b ac
2 ln 2
1 0
4
4 2 2 (c.f [42] , Page 68)
B Abi
A B p A
B p
A A
dp
A A
A B
A B p A
B p
A A
A
A B
2 2
2 2
2 2
2
2
2 1
1 2
2 2
1 ln
1 2
1 1
B Ab
B
i
B
p A A A
B
arctg B
A B A
B p A
B p
A A
A A
2 2
2 2
2 2
2
2
4 1 2
2
4 2 1 2
1 ln
1 2
1 1
Because 2 2 , 0
arctg b ct ifR dt
(c.f [42], Page 68)
B Ab
B
i
p AB A A arctg A
A B p A
B p
A A
A A
1 1
1 1 2
1 ln
1 2
1
1 2
2 2
2 2
2
Ab B
AB A A arctg A
A B B Ab A
B B
Ab A A
A
A i i i
1 1
1 1 2
1 ln
1 2
1
1 2
2 2 2
2
2
Stochastic Programming with Cauchy Distribution
AB B
A A arctg A A B B A B B A A A A 1 1 1 1 2 1 ln 1 2 1 1 2 2 2 2 2 2
AB B AB B A A arctg A A B A B A B A B A A A AB B Ab B A b A A arctg A A B A B A B Ab A B Ab B b A A A A i i i i i 2 2 2 2 2 2 2 2 2 3 2 2 2 2 2 2 2 2 1 1 1 2 ln 1 2 1 1 1 1 2 2 2 1 ln 1 2 1
A A B b B b A A arctg A A B B b A B Ab B b A B b A B A b A A A i i i i i i i 1 1 1 1 2 2 2 ln 1 2 1 2 2 2 2 2 2 3 2 2 2 4 2
arctg A
A AB A A 1 1 ln 1 2 1 2 2 2
A arctg A
B b B b A arctg A AB A B B b B b A B Ab B b A AB b A A A i i i i i i i 2 2 2 2 2 2 2 2 2 3 2 1 1 ln 2 2 2 ln 1 2 1
A arctg A
B b B b A arctg A AB AB B b A Ab A A A i i i i 2 2 2 2 2 2 2 2 1 1 2 1 ln 1 2 1
B A arctg A
b B b A arctg A AB Ab A AB Bb A AB Ab A A
A i i i i i
B A A arctg A
b arctg A
B Ab b
B A A
A i i
i 1
1 1 1
2 1
ln 1 2
1 2 2 2 2
2 2
On substituting the values of A and B,
ib
i du u f i
0
=
2 1 2
1 1
2 2 2 1 1
2
2 1 2
2 1
1 2 2 2 1 1
2 1 2
2
1 2 2 2 1 1
2
2 1 2
2 1
2 1
1 1 1
1 1 1 1
1 1 1
1
1 1
1 2 1
1 1 ln 1 1 1 2
1 1
1
i i i
i i
i i
i i i i
i i
i i i
i
i i i i
i i i
i i i
i i
i i
a a arctg a
a
a a x a a x
a a b
arctg
a a
a a x a a x
b a a b
a a x a a x
a a
a a
a a
(6)
Proceeding as in above for the cases of three variables, the ith probabilistic constraints can be presented as,
a x a x a x
b i mob i i i i 1 i, 1,2,...,
Pr 1 1 2 2 3 3
Where ai1, ai2 and ai3 are three independent Cauchy random variables
3 3 2 2 1
1x a x a x
a U
Let i i i i
Then the density function of Ui can be obtained as,
U e t dtf itu u( )
2 1
(Using Levy inversion theorem )
e
itue
x x x tdt
1 2 32
1
dt e
e dt e
e itu x x x t itu x x x t 0
0
3 2 1 3
2 1
2 1
dt e
e dt e
eitu x x x t itu x x x t 0
0
3 2 1 3
2 1
2 1
dt e
e dt e
eitu x x x t itu x x x t 0
0
3 2 1 3
2 1
2 1
dt e
dt
e t x1 x2 x3 iu t x1 x2 x3 iu
2 1
Stochastic Programming with Cauchy Distribution
0 3
2 1 3
2 1
3 2 1 3
2 1
2 1
iu x x x
e iu
x x x
e t x x x iu t x x x iu
iu x x x iu x x
x1 2 3 1 2 3
1 1
2 1
2 2 2
3 2 1
3 2 1 2 2
1
u i x x x
x x x
2 2 3 2 1
3 2 1
u x x x
x x x
(7)
Hence ith probabilistic constraints can be made deterministic constraints by integrating the probability density function of ui as stated below,
u du i mf i i
b i i
..., ,... 2 , 1 1
0
This can be simplified as follows,
ib
i i
b
i du
u x x x
x x x du
u f
i i
0
2 2 3 2 1
3 2 1
0
1
(8)
If ui ai1x1ai2x2ai3x3 Then
1 3 3 2 2 1
i i i
i
a
x a x a u
x ,
2 3 3 1 1 2
i i i i
a
x a x a u
x
and
3 2 2 1 1 3
i i i i
a
x a x a u
x
Now
3
2 2 1 1 2
3 3 1 1 1
3 3 2 2 3
2 1
i i i
i i
i i
i i
i i
i
a
x a x a u a
x a x a u a
x a x a u x x
x
2 3 1 3 1 1 2 3 2 2 3 1 2 1 1 3
2 1
1 1 1
i i i i i
i i i i
i i i i
i i i
a a a a x a a a a x a a a a x a
a a
u
Let
2 3
1 3 1 1 2
3 2 2 3 1
2 1 1
3 2 1
3 2 1
i i i i i
i i i i
i i
i i i i
i i i
a a a a x a
a a a x a
a a a x B and
a a a
a a a A
Then, x1 x2 x3 Aui B p(Say)
Now putting the above values in (8)
b
i
i ib
i du
u B Au
B Au du
u f
i i
1 2 2 3 2 1 3 2 1 2 3 1 3 1 1 2 3 2 2 3 1 2 1 1 2 3 2 1 2 3 2 1 2 3 1 3 1 1 2 3 2 2 3 1 2 1 1 3 2 1 2 2 2 3 1 3 1 1 2 3 2 2 3 1 2 1 1 2 3 2 1 2 3 2 1 3 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 ln 1 1 1 1 2 1 1 1 1 i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i a a a arctg a a a a a a a x a a a a x a a a a x a a a b arctg a a a a a a a x a a a a x a a a a x b a a a b a a a a x a a a a x a a a a x a a a a a a a a a (9)
Finally we generalize the results to ‘n’ independent random variables and the result may be stated as follows
a x a x a x
b i mob i i ... in n i 1 i, 1,2,...,
Pr 1 1 2 2
Where ai1 ,ai2 ,………,ain are ‘n’ independent Cauchy random variables Let Ui = ai1x1 + ai2x2 +………+ ainxn
ib i i i i b i du u B Au B Au du u f Then i i
0 2 2 0 1 ,
n j ij n j ij n j k k n j ik ij j n j ij i n j ij n j k k n j ik ij j i n j ij i n j k k n j ik ij j n j ij n j ij n j ij a arctg a a a x a b arctg a a a x b a b a a x a a a 1 1 1 1 2 1 2 1 1 1 1 2 2 1 1 2 1 2 1 1 1 1 1 1 1 1 1 1 1 2 1 1 ln 1 1 2 1 1Stochastic Programming with Cauchy Distribution
Deterministic model of stochastic linear programming
Assuming aij to be independent Cauchy random variables, the stochastic linear programming model as stated in (1), (2) and (3) can be converted to a deterministic linear programming problem as
Maximize
n
j
j j x c E Z
E
1
(11)
Subject to the constraints,
i
n
j ij n
j ij n
j k k
n
j ik ij j n
j ij i
n
j ij
n
j k k
n
j ik ij j
i n
j ij i
n
j k k
n
j ik ij j n
j ij
n
j ij n
j ij
a arctg
a
a a x a b
arctg
a
a a x
b a b
a a x a
a a
1
1 1
1 1
1 1
1
1 1
2 1
1 ln
1 1 2
1
1
1 1
1 1 2
1 2
1
1 1 1 2
2
1 1 2
1 2
1 1
(12)
xj 0 ,j1,2,...,n (13)
Then we present a numerical example to illustrate the methodology.
Let, a11=5, a12=4, a13=8, a21=10, a22=2, a23=20 b1=10, b2=20, 1 0.05and 2 0.1
Maximize, Z=5x1+6x2+3x3
Subject to the constraints,
05 . 0 575 . 0 575
. 0 6
. 3 3 . 1 875 . 1
0625 . 133 330625
. 1
1
1 6 . 3 3 . 1 875 . 1
5 . 11 6
. 3 3 . 1 875 . 1
0625 . 133 ln
66125 . 2
575 . 0 1
3 2
1
3 2
1 2
3 2
1
arctg x
x x arctg
x x
x x
x x
01 . 0 65
. 0 65
. 0 12
3 . 0 5 . 5
45 . 28 4225
. 1
1
1 12 3
. 0 5 . 5
26 12
3 . 0 5 . 5
9 . 56 ln
845 . 2
65 . 0 1
3 2
1
3 2
1 2
3 2
1
arctg x
x x
arctg
x x
x x
x x
By using the Genetic Programming we found the optimum solution for the above program is
23.886 727. 1 ,
748 . 1 ,
741 .
1 2 3
1 x x and EZ
x
References
1. Biswal, M.P, Biswal, N. P. and Duan, Li (1998). Probabilistic Linear Programming Problems with exponential random variables: A technical note. European Journal of Operational Research, Vol. 11, Page 589-597.
2. Chankong, V. and Haimes, Y.Y (1983). Multi objective Decision making theory and Methodology, North-Holland, Amsterdam.
3. Charnes, A. and Cooper, W.W (1963). Deterministic equivalents for optimizing and satisfying under chance constraints, Operations Research., Vol. 11, Page 18-39.
4. Charnes, A. and Cooper, W.W (1959). Chance Constrained Programming, Management Science. Vol. 6, Page 227-243.
5. Goicoechea, A and Duckstein, L (1987). Non-normal deterministic equivalents and a transformation in stochastic programming. Applied Mathematics and Computation, Vol.21, Page 51-72.
6. Goicoechea, A., Hansen, D. R. and Duckstein, L (1982). Multi objective Decision Analysis with Engineering and Business Applications., Wiley, New York.
7. Infagen, G (1993). Planning under uncertainty: Solving Large-Scale Stochastic Linear Program. Boyd and Fraser Publishing Company, Massachusetts.
8. Kall, P and Wallace, S. W (1994). Stochastic Programming, Wiley, New York.
9. Kambo, N. S (1984). Mathematical Programming Techniques, Affiliated East-West Press Private Limited.
10. Stancu-Minasian, I. M. and Wets, M. J (1976).A research bibliography in Stochastic Programming, 1955-1975.Operation Research, Vol.24, Page 1078-1119.
11. Vajda, S (1972). Probabilistic Programming, Academic Press, New York and London.
12. Verma, R., Biswal, M. P and Biswas, A (1996). Fuzzy programming approach to probabilistic multi-objective transportation problems with pareto optimum solutions. The Journal of Fuzzy Mathematics, Vol.4, Page 301-314.