Optimization Algorithm For Decision Theory With
Uncertainty
N. Ezhilarasan , C. Vijayalakshmi
Abstract: A review on Uncertainty is an ever-growing concern in optimization for decision theory. Uncertainty has received a lot of focus in the recent years from science and engineering. This paper aims to review main methods that have been applied to the problems relating to uncertain in decision theory as well as list applications in the various area. The uncertainty for optimization is first analysed and classified followed by implementation of mathematical programming in the field of uncertainty. Various prevailing optimization approaches that are applied to decision theory with uncertainty models like stochastic programming and robust optimization have been identified. For same methods, review of the techniques, principles, and how they are utilized to improve the robustness of the model results to provide surplus policy insights. In the conclusion, a critical assessment on the use of these methods is provided.
Keywords: Optimization; Uncertainty; Decision Theory; Stochastic Programming; Robust Optimization; Uncertainty Parameters;
—————————— ——————————
1.INTRODUCTION
Optimization methods are classified on the basis of idea of existences of constraint, character of the matter, character of the equation concerned, the allowed values of the look variables, the settled nature of the variable concerned, the reparability of the function, the quantity of objective functions concerned, etc. These techniques are Linear Programming, Non-linear Programming, Dynamic Programming, Geometric Programming, this has made the growth of models for decision theory with uncertain a in height precedence for researchers in both of robust / stochastic optimization groups. a big number of the methods that have been planned for optimization under uncertain have been applied to decision theory problems. etc. Optimization application abound in most area of engineering and science [1-3]. In actual training, some parameters involved in optimization problems are topic to uncertain most of a variety of causes, include estimation errors [4], Such uncertainty parameter can be product demand in processing planning [5], such uncertainty in process synthesis in reaction-separation-recycling systems designs [6], planning of energy systems using optimization methods [7], amid others.
Decision Theory is a multidisciplinary theory which uses of the Decision Theory is normative prescriptive. This theory deals with well identifications of the decision that would be taken and assumes that the ideal decider which is fully informed can estimate correctly and act fully. One domain in the decision theory is decision making in uncertain. Another field of study in the decision theory is the compromise effect. One the common problems in decision-making occur whenever deciders must
choose among options some.
Uncertainty using in operation and process design [9], mathematical programming methods for process variability and model parameter uncertainty for process design [27], planning and production scheduling with uncertainty [28], processing control [29-31], probabilistic constraints or such chance constraint are flexible sufficient to quantify the trade-off theory between objective performance and systems dependability [39].
1.2 assortment of optimization techniques
Inexact Optimization Models
Optimization Techniques were typically based on variety of mathematical equation to represents a series of fundamental interaction of the systems elements, processes and factors. In most of the traditional strategies, the modelling parameter / coefficient were sometimes fixed as the settled. In naturalistic energy management system, several coefficients or
————————————————
N. Ezhilarasan, Vellore Insitute of Technology, India, PH-9500274674. E-mail: [email protected]
4707
parameters furthermore because the irrigations might have unsure nature with multiple dimension and layers. Over past decades, the foremost general approaches for addressing uncertainty in optimization model enclosed interval, Stochastic, and Fuzzy set based on ways similarly as this mixture. [18-19, 20–22].
2. STOCHASTIC PROGRAMMING
The goal of both stistic and strong optimization is to find any possible solution for uneven scaling. The framework for the performance analysis of system during the given time period is stochastic analysis [4]. Potent modelling prototype for decision making under uncertainty is a stochastic programming that aim to optimize the Expected objective values fully all the uncertain realization [8]. The main proposal of the stochastic programming method is to model the randomness in uncertainty parameter with probability distribution [9,10]. In general, decision making procedures with various time stages, the stochastic programming approach well accommodate. In single-stage stochastic programs, any are no alternative variables and most the decisions must be made previous to know uncertainty understanding. In contrast, stochastic programming mothed with recourse can take corrective actions behind uncertainty. Among the stochastic programming approach with recourse, the most generally used one is the two-stage stochastic program, in which decisions are partitioned into ―here-and-now‖ decisions and ―wait-and-see‖ decisions.
Two-stage stochastic programming problem of the general mathematical formulation [8]
min
T[ ( , )]
x X
c x
E Q x
such that
Ax
k
The function Q(x, ) is defined as,
( , )
min ( )
T( )
Q x
k
y
Such that
( ) ( )
( )
( )
v
y
m
p
x
Where x represents first-stage decisions made ―here-and-now‖formerly the uncertainty y represents second-stage made ―wait-and-see‖ after observe uncertain realization the two parts of the two-stage stochastic programming model are there: PO
The ensuing two-stage stochastic programming downside is procedurally expensive to solve because to the growth of computational time with the quantity of eventualities. Decomposition primarily based algorithms are developed within the existing literature, together with Benders decomposition or the L-shaped method [11, 12], and Lagrangian decomposition approach [13].
3.
ROBUST
OPTIMIZATIONS
For an efficient alternate paradigm, robust optimization does not require precise information about the probability distributions of sharing the uncertainty parameters [40-42], it models of uncertainty parameter using an uncertain set, which contains possible uncertainty realizations. It is value noting that uncertainty set is a paramount ingredient in robust optimization background [44], Given an explicit uncertain set, the concept of robust optimization is to hedge against the worst case inside the uncertainty set. The worst-case uncertainty recognition is define primarily based on specific contexts: it can be the belief giving upward push to the most important constraint violation, the realization main to the lowest asset return [45], the one result inside the high regret [46]. The standard container uncertainty set is not a good choice for instability, the reason that it includes the unlikely-to-happen scenario where uncertainty parameters simultaneously boom to their highest values. The traditional container uncertainty set is described as follows [46]
L U,
box i i i i
U
n n
n
n
Where Ubox is a box uncertainty set, n is a vector of
uncertainty parameter, ni is the i-th component of uncertainty vector n. and represent the upper bound and lower bound of uncertainty parameters ni, Box uncertainty set is a parameter uncertainty in vector n. Finlay researchers propose the follows
,
,
1
1,
,
i
budget i i i i i i
i
U
n n
n
n k
k
k
Where Uboxdet denoted an allocated uncertainty set, n and ni is also same in lower bound and upper bound of uncertainty parameter in vector n. Γ is an uncertainty budget.
Robust optimization of traditional and approaches [48], make all the decisions of the multistage optimization of commitment problem at once. Two-stage robust design and network flows This modelling background not well represent sequent decision-making problems [49-51]. Adaptive robust optimization (ARO) was proposed a new pattern for optimization under uncertainty by include recourse decisions [49]. Due to the flexibility of adjusting recourse decisions after note the uncertain Reconstruction, ARO typically generates fewer conservative solutions than standard robust optimization [51].
———————————————— N. Ezhilarasan, Vellore Insitute of Technology, India,
PH-9500274674. E-mail: [email protected]
s.t
Ax
k x
,
R
mi
Z
m2
3
( , )
x x
y
R
m,
V
yh T
xM
n
4. OPTIMIZATION WITH UNCERTAINTY
The Optimization drawback varieties describe as within the Continuous Optimization section and the Discrete Optimization part implicitly assumed that the information for the given drawback measure know accurately. For each actual issue, however, the problems data can't be known accurately for a spread of reason. The primary reason is due to simple measuring error. The second and additional elementary reason is that some knowledge represents info concerning the long run (e. g., product demand or worth for upcoming years) and merely cannot be noted with certainty. Uncertainty has forms: 1. appraisal errors for parameters of permanent but obscure worth, and 2. Stochastic of random variables.
Robust Optimization and Stochastic Programming is each well-liked framework for expressly incorporating uncertainties. Stochastic programming uses random variables with such as likelihood distribution to characterize the uncertainty and optimizes the arithmetic mean of the target operate. Robust optimization uses set member to characterize the uncertainty and optimizes a worst potential case of the problem.
4.1 uncertainty methods
Epistemological Uncertainty is the uncertainty of understandings, arising because of inadequate data, extrapolation and additionally the restrictions of measures devices and also the variability in time or area. Epistemological uncertainty includes parameter, subjective and model uncertainty. Ambiguity additionally as being classified among linguistic uncertainty is also enclosed among epistemical uncertainty as information becomes uncertain if words used area unit ambiguous. Parameter uncertainty is a Measurement Error in measure technique and random variation in measurement. Systemic Error (non-random error thanks to bias in measuring procedure thanks to the judgment of the applier). optimization performance in applications, such as load flow the uncertainty of measurements can greatly affect. The uncertainty of measurements can greatly affect the optimization performance in application, such as load flow. Model uncertainty is inherent untruth and misunderstanding to the simplification of complicated systems. Ambiguity uncertainty when words have over one that means and so are often misinterpreted Subjective uncertainty the uncertainty that arises because of the interpretation of knowledge, because of the empirical lack of knowledge knowledgeable judgment is employed in its place. Linguistic Uncertainty derived from contact and resolution, wherever scientific terminologies are imprecise, context dependent or has theoretical basis indeterminacies that embrace uncertainties like numerical and non-numerical unclearness, context dependency, underneath specificity and ambiguity. Ontological Uncertainty related to processes together with natural variation, inherent randomness and Dynamical uncertainty.
The area of unsure knowledge management poses variety of distinctive challenges on many fronts. The two wide problems are those of modelling the unsure knowledge, so investment it to figure with a spread of applications. Types of problems and dealing models for unsure knowledge are mentioned in [15] and [17]. Uncertainty data modelling A main topic is that the method of model the uncertainty information. For that reasons, the elemental difficulty will be capture whereas keep the data helpful for administration applications. Uncertainty data management Ones desire to embrace ancient direction cinques for data knowledge. Samples of such techniques may be a part of process, question process, indexing, or database integrations. Mining of data uncertainty he results information of knowledge of information mining application square measure are the underlying uncertainty within the info. Therefore, it's essential to style processing techniques which will take such uncertainty under consideration throughout the computations.
5.
CONCLUSION
In this paper, robust optimization can be a stochastic framework for addressing decision-making problems under uncertainty. Several modelling frameworks are projected within the literatures for optimization beneath uncertainties. Together within, a spread of algorithms is developed and applied successfully in several application. The current decision theory with uncertainty in this field provides approximate answer of massive issues with sampling-based ways and different approximations of the value functions. There are many opportunities for the event and application of worldwide improvement algorithms to unravel optimization issues below uncertainty.
REFERENCES
[1] L. T. Biegler and I. E. Grossmann, "Retrospective on optimization," Computers & Chemical Engineering, vol. 28, pp. 1169-1192, 2004.
[2] E. Grossmann and L. T. Biegler, "Part II. Future perspective on optimization," Computers & Chemical Engineering, vol. 28, pp. 1193-1218, 2004.
[3] V. Sakizlis, J. D. Perkins, and E. N. Pistikopoulos, "Recent advances in optimization-based simultaneous process and control design," Computers & Chemical Engineering, vol. 28, pp. 2069-2086, 2004.
4709
[5] M. L. Liu and N. V. Sahinidis, "Optimization in Process Planning under Uncertainty," Industrial & Engi-neering Chemistry Research, vol. 35, pp. 4154-4165, 1996. [6] J. Acevedo and E. N. Pistikopoulos, "Stochastic
optimization-based algorithms for process synthesis un-der uncertainty," Computers & Chemical Engineering, vol. 22, pp. 647-671, 1998.
[7] Z. Li and M. G. Ierapetritou, "Process scheduling under uncertainty: Review and challenges," Computers & Chemical Engineering, vol. 32, pp. 715-727, 2008.
[8] J. R. Birge and F. Louveaux, Introduction to stochastic programming: Springer Science & Business Me-dia, 2011.
[9] J. R. Birge, "State-of-the-Art-Survey—Stochastic Programming: Computation and Applications," IN-FORMS Journal on Computing, vol. 9, pp. 111-133, 1997.
[10]P. Kall and S. W. Wallace, Stochastic programming: John Wiley and Sons Ltd, 1994.
[11]R. M. Vanslyke and R. Wets, "L-shaped linear programs with applications to optimal control and sto-chastic programming," SIAM Journal on Applied Mathematics, vol. 17, pp. 638-&, 1969.
[12]G. Laporte and F. V. Louveaux, "THE INTEGER L-SHAPED METHOD FOR STOCHASTIC INTEGER PROGRAMS WITH COMPLETE RECOURSE," Operations Research Letters, vol. 13, pp. 133-142, 1993.
[13]F. Oliveira, V. Gupta, S. Hamacher, and I. E. Grossmann, "A Lagrangean decomposition approach for oil supply chain investment planning under uncertainty with risk considerations," Computers & Chemical Engineering, vol. 50, pp. 184-195, 2013.
[14]Liu, M. L., & Sahinidis, N. V. (1997) Process planning in a fuzzy environment. European Journal of Op-erational Research, 100, 142– 169.
[15]Ahmed, S. (2002). Strategic planning under uncertainty: Stochastic integer programming approaches. Ph.D. thesis, University of Illinois, Urbana, IL.
[16]Implementation of optimal scheduling model for power flow system, Int. J. Computer Aided Engineering and Technology, Vol. 11, No. 2, 2019, Scopus Indexed, R. Subramani and C. Vijayalakshmi.
[17]G. Dantzig. Linear programming under uncertainty. Management Science, 1(3-4):197–206, 1955.
[18]Cai, Y.P.; Huang, G.H.; Yang, Z.F.; Lin, Q.G.; Tan, Q. Community-scale renewable energy systems planning under uncertainty—An interval chance-constrained programming approach. Renew. Sustain. Energy Rev. 2009, 13, 721–735.
[19]Cai, Y.P.; Huang, G.H.; Lin, Q.G.; Nie, X.H.; Tan, Q. An
optimization-model-based interactive decision support system for regional energy management systems planning under uncertainty. Expert Syst. Appl. 2009, 36, 3470–3482.
[20]Andricevic, R.; Jacobson, R.L.; Daniels, J.I. Accounting for predictive uncertainty in a risk analysis focusing on radiological contamination of groundwater. In Groundwater Quality Mangement, GQM 93, Proceedings of an International Conference Held at Tallinn, Estonia, 6–9 September 1993.
[21]Kovar, K., Soveri, J., Eds.; International Association of Hydrological Sciences (IAHS) Press: Wallingford, UK, 1994; pp. 215–224.
[22]Burr, D.T.; Sudicky, E.A.; Naff, R.L. Nonreactive and reactive solute transport in three-dimensional heterogeneous porous media: mean displacement, plume spreading, and uncertainty. Water Resour. Res. 1994, 30, 791–815.
[23]Cushman, J.H.; Hu, B.X.; Deng, F.W. Nonlocal reactive transport with physical and chemical heterogeneity: localization errors. Water Resour. Res. 1995, 31, 2219–2237.
[24]Weber, W.J., Jr.; Huang, W.; Yu, H. Hysteresis in the sorption and desorption of hydrophobic organic contaminants by soils and sediments, effects of soil organic matter heterogeneity. J. Contam. Hydrol. 1998, 31, 149–165.
[25]Chen, M.J.; Huang, G.H. A derivative algorithm for inexact quadratic program—application to environmental decision-making under uncertainty. Eur. J. Oper. Res. 2001, 128, 570–586.
[26]Hoogeweg, C.G. Impact of Uncertainty in Model Input Data on Predicted Pesticide Leaching, University of Florida, Gainesville, FL, USA, 1999.
[27]W. C. Rooney and L. T. Biegler, "Optimal process design with model parameter uncertainty and process variability," AIChE Journal, vol. 49, pp. 438-449, 2003.
[28]P. M. Verderame, J. A. Elia, J. Li, and C. A. Floudas, "Planning and Scheduling under Uncertainty: A Review Across Multiple Sectors," Industrial & Engineering Chemistry Research, vol. 49, pp. 3993-4017, 2010.
[29]A. Mesbah, "Stochastic Model Predictive Control AN OVERVIEW AND PERSPECTIVES FOR FUTURE RESEARCH," IEEE Control Systems Magazine, vol. 36, pp. 30-44, 2016.
[30]A. Krieger and E. N. Pistikopoulos, "Model predictive control of anesthesia under uncertainty," Computers & Chemical Engineering, vol. 71, pp. 699-707, 2014.
[31]T. Y. Chiu and P. D. Christofides, "Robust control of particulate processes using uncertain population balances," AIChE Journal, vol. 46, pp. 266-280, 2000.
stochastic risk-based decision analysis with the mobile offshore base as a case study. Mar. Struct. 2001, 14, 69–88.
[33]K. Bharathi and C. Vijayalakshmi, Optimization of Multi-objective Transportation Problem Using Evolutionary Algorithms. Global Journal of Pure and Applied Mathematics. ISSN 0973-1768 Volume 12, Number 2 (2016), pp. 1387-1396.
[34]DESIGN AND ANALYSIS OF A NON-LINEAR OPTIMIZATION INVENTORY MODEL FOR UNCERTAIN QUANTITY, ARPN Journal of Engineering and Applied Sciences, Volume: 10, Issue: 11, Month, Year: 06, 2015, SCOPUS, ISSN 1819-6608, pp 4882-4887, VOL:10, ISSUE 11,2015, Authors: Thiripura Sundari P. R. and VijayaLakshmi C.
[35]FEED BACK CONTROL MECHANISM ON STOCHASTIC AGGREGATED ROUTING NETWORK, International Journal of Pure and Applied Mathematics, Volume: 101, Issue: 5, Month, Year: 06, 2015, Impact Factor: 0.635, pp.791-800 ISSN: 1311-8080 (printed version); ISSN: 1314-3395 (on-line version) url: http://www.ijpam.eu P A,Scopus Indexed, Authors: K.Sivaselvan, C.Vijayalakshmi.
[36]Implementation of an Optimization Model for the Establishment of New Substations, Middle-East Journal of Scientific Research, Scopus Indexed, Volume: 23, Issue: 3, Month, Year: 05, 2015, pp: 514-518, Authors: S. Maheswari, R. Santhoshkumar and C. Vijayalakshmi.
[37]A review on advanced optimization techniques, ARPN Journal of Engineering and Applied Sciences, Volume: 11, Issue: 19, SCOPUS, Page Nos:11675-11683, ISSN 1819-6608, Scopus Indexed VOL. 11, NO. 19, October 2016, Authors: Subramani R. and Vijayalakshmi C.
[38]Implementation of an optimization model for pump scheduling, International Journal of Pure and Applied Mathematics, Volume 109, No. 5 2016, Scopus Indexed, IF:3.83, pp:41-49 ISSN: 1311-8080 (printed version);
[39]P. Li, H. Arellano-Garcia, and G. Wozny, "Chance constrained programming approach to process optimization under uncertainty," Computers & Chemical Engineering, vol. 32, pp. 25-45, 2008.
[40]A. Ben-Tal and A. Nemirovski, "Robust solutions of Linear Programming problems contaminated with uncertain data," Math. Programming, vol. 88, p. 411, 2000.
[41]D. Bertsimas and M. Sim, "The price of robustness," Oper. Res., vol. 52, p. 35, 2004.
[42]A. Ben-Tal, L. E. Ghaoui, and A. Nemirovski, Robust Optimization: Princeton University Press, 2009.
[43]C. Gregory, K. Darby-Dowman, and G. Mitra, "Robust optimization and portfolio selection: The cost of robustness," European Journal of Operational
Research, vol. 212, pp. 417-428, 2011.
[44]T. Assavapokee, M. J. Realff, and J. C. Ammons, "Min-Max Regret Robust Optimization Approach on Interval Data Uncertainty," Journal of Optimization Theory and Applications, vol. 137, pp. 297-316, 2008.
[45]A. L. Soyster, "Technical Note—Convex Programming with Set-Inclusive Constraints and Applications to Inexact Linear Programming," Operations Research, vol. 21, pp. 1154- 1157, 1973.
[46]D. Bertsimas, D. B. Brown, and C. Caramanis, "Theory and applications of robust optimization," SIAM review, vol. 53, pp. 464-501, 2011.
[47]Á. Lorca, X. A. Sun, E. Litvinov, and T. Zheng, "Multistage adaptive robust optimization for the unit commitment problem," Operations Research, vol. 61, pp. 32-51, 2016.
[48]A. Atamtürk and M. Zhang, "Two-stage robust network flow and design under demand uncertainty," Operations Research, vol. 55, pp. 662-673, 2007.
[49]D. Bertsimas, E. Litvinov, X. A. Sun, J. Zhao, and T. Zheng, "Adaptive Robust Optimization for the Security Constrained Unit Commitment Problem," IEEE Transactions on Power Systems, vol. 28, pp. 52-63, 2013.
[50]A. Ben-Tal, A. Goryashko, E. Guslitzer, and A. Nemirovski, "Adjustable robust solutions of uncertain linear programs," Mathematical Programming, vol. 99, pp. 351-376, 2004.
![figure with a spread of applications. Types of problems and dealing models for unsure knowledge are mentioned in [15] and [17]](https://thumb-us.123doks.com/thumbv2/123dok_us/8640869.1430577/3.612.321.570.46.203/figure-spread-applications-types-problems-dealing-knowledge-mentioned.webp)
