gradient-based optimization algorithms
A THEORETICAL SURVEY OF GRADIENT BASED ALGORITHMS FOR MULTIVARIABLE OPTIMIZATION
... Hence, there is a need for objective analysis of the relative merits and shortcomings of the various algorithms for optimization problems. This need has certainly been recognized by others, as illustrated ...
14
Distributed and parallel methods for structural convex optimization
... is based on the publication ...fast gradient-projection method for solving the problem (SCO) when the inner subproblem is solved ...proposed algorithms. This part is based on the work ...
231
Line search fixed point algorithms based on nonlinear conjugate gradient directions: application to constrained smooth convex optimization
... conjugate gradient directions for unconstrained ...the algorithms for solving the fixed point problem under certain ...convex optimization; that is, whether or not we can devise nonlinear conjugate ...
32
Dynamic Systems Modeling with Stochastic Cellular Automata (Evolutionary versus Stochastic Correlation Approach)
... a traditional mathematical modeling, that uses differential equations in order to describe the time dependencies of such dynamic systems. However, space influences and stochastic na- ture of the phenomena make such ...
9
Forward and Reverse Gradient-Based Hyperparameter Optimization
... Our first contribution is the definition and the application of forward-mode computation to HO. Our analysis suggests that for large models the forward-mode computation may be a preferable alternative to reverse-mode if ...
9
Optimal design of monopile offshore wind turbine structures using CBO, ECBO, and VPS algorithms
... design optimization of such structures would be an indispensable mission by which the required capitals may be substantially cut ...optimizer algorithms mostly employ gradient information or iter- ...
17
A NOVEL APPROACH TO GENERATE TEST CASES FOR COMPOSITION & SELECTION OF WEB SERVICES BASED ON MUTATION TESTING
... Genetic algorithms are a population based mechanism, which is used to explore the search space better than other searching algorithms especially for problems that are ...Genetic algorithms ...
5
A Framework for Analyzing Stochastic Optimization Algorithms Under Dependence
... unbiased gradient simulation algorithms and the optimization algorithms that are based on these unbiased simula- ...our algorithms are well-suited to solve ...our gradient ...
145
Robust gradient-based discrete-time iterative learning control algorithms
... a gradient-based Iter- ative Learning Control (ILC) algorithm using both fixed learning gains and gains derived from parameter ...inverse-model based ILC algorithms and it is seen that the ...
31
SAR Images Co registration Based on Gradient Descent Optimization
... process based on the optimization method requests a pre-defined measurement for congruency (similarity) such that the primary values of the transformation matrix parameters can be ...one optimization ...
7
A Review on Optimization Techniques for Economic Load Dispatch Problem
... conventional optimization technique such as the gradient based algorithms to a large power distribution system with a very non linear objective functions and great number of constraints are ...
5
Step Size Optimization of LMS Algorithm Using Aunt Colony Optimization & Its comparison with Particle Swarm optimization Algorithm in System Identification
... behavior, gradient based algorithms, such as least-mean- square (LMS) and normalized least-mean square (NLMS), are very effective in the design of adaptive FIR ...the gradient based ...
7
Earthquake Prediction System by LSTM
... algorithm based on mathematical analysis, machine learningalgorithms like decision trees and support vector machines, and precursors ...with gradient descent optimization algorithms(LSTM- ...
6
Lazifying Conditional Gradient Algorithms
... Frank–Wolfe algorithms and conditional gradient algo- rithms, so we will restrict to review work most closely related to ...conditional gradient descent Levitin and Polyak (1966) and has been ...
42
Gradient-Based Multi-Component Topology Optimization for Manufacturability
... topology optimization works assume the optimized structure will be produced as a single-piece, which has already been naturally bounded by its initial design ...parts based on a specified maximum build ...
106
Extending the inferential capabilities of model-based gradient boosting algorithms
... In this paper, we propose a new method to determine the optimal number of iterations in model-based boosting for variable selection inspired by probing, a method frequently used in related areas of machine ...
43
Evolutionary Programming Techniques for Solving Non Convex Economic Load Dispatch Problem with Valve Point Loading Effect
... TLBO is based on the relationship between teacher and student in the class. It is a population-based method and it uses a population of solutions to get the global solution. In any optimization ...
11
Algorithms for Blind Equalization Based on Relative Gradient and Toeplitz Constraints
... ICA algorithms may be employed for use in our blind equalization problem, we will give simulation results for the short minimum phase channel and long non-minimum phase channel with ...IQ-T-Amari ...
247
An Adaptive Constraint Method for Paraunitary Filter Banks with Applications to Spatiotemporal Subspace Tracking
... existing gradient-based spatiotemporal subspace track- ing algorithms, the method is observed to stabilize the nu- merical performance of these algorithms using only a single iteration of the ...
11
A Comparative Study of Nonlinear Time Varying Process Modeling Techniques: Application to Chemical Reactor
... network based on back propagation learning is computationally ...the Gradient Descent (GD) method and Genetic Algorithms ...the Gradient Descent ...Genetic Algorithms gave the best ...
9