• International Journal of Computer Science & Network Security
• /
• v.23 no.10
• /
• pp.115-128
• /
• 2023

Deep learning has been incorporating various optimization techniques motivated by new pragmatic optimizing algorithm advancements and their usage has a central role in Machine learning. In recent past, new avatars of various optimizers are being put into practice and their suitability and applicability has been reported on various domains. The resurgence of novelty starts from Stochastic Gradient Descent to convex and non-convex and derivative-free approaches. In the contemporary of these horizons of optimizers, choosing a best-fit or appropriate optimizer is an important consideration in deep learning theme as these working-horse engines determines the final performance predicted by the model. Moreover with increasing number of deep layers tantamount higher complexity with hyper-parameter tuning and consequently need to delve for a befitting optimizer. We empirically examine most popular and widely used optimizers on various data sets and networks-like MNIST and GAN plus others. The pragmatic comparison focuses on their similarities, differences and possibilities of their suitability for a given application. Additionally, the recent optimizer variants are highlighted with their subtlety. The article emphasizes on their critical role and pinpoints buttress options while choosing among them.

• Journal of the Computational Structural Engineering Institute of Korea
• /
• v.27 no.5
• /
• pp.337-343
• /
• 2014

This paper presents a continuum-based shape design sensitivity analysis(DSA) method for crack propagation problems using a reproducing kernel method(RKM), which facilitates the remeshing problem required for finite element analysis(FEA) and provides the higher order shape functions by increasing the continuity of the kernel functions. A linear elasticity is considered to obtain the required stress field around the crack tip for the evaluation of J-integral. The sensitivity of displacement field and stress intensity factor(SIF) with respect to shape design variables are derived using a material derivative approach. For efficient computation of design sensitivity, an adjoint variable method is employed tather than the direct differentiation method. Through numerical examples, The mesh-free and the DSA methods show excellent agreement with finite difference results. The DSA results are further extended to a shape optimization of crack propagation problems to control the propagation path.