• Title/Summary/Keyword: and regularization

Search Result 459, Processing Time 0.029 seconds

A comparison of methods to reduce overfitting in neural networks

  • Kim, Ho-Chan;Kang, Min-Jae
    • International journal of advanced smart convergence
    • /
    • v.9 no.2
    • /
    • pp.173-178
    • /
    • 2020
  • A common problem with neural network learning is that it is too suitable for the specificity of learning. In this paper, various methods were compared to avoid overfitting: regularization, drop-out, different numbers of data and different types of neural networks. Comparative studies of the above-mentioned methods have been provided to evaluate the test accuracy. I found that the more data using method is better than the regularization and dropout methods. Moreover, we know that deep convolutional neural networks outperform multi-layer neural networks and simple convolution neural networks.

Optimizing structural topology patterns using regularization of Heaviside function

  • Lee, Dongkyu;Shin, Soomi
    • Structural Engineering and Mechanics
    • /
    • v.55 no.6
    • /
    • pp.1157-1176
    • /
    • 2015
  • This study presents optimizing structural topology patterns using regularization of Heaviside function. The present method needs not filtering process to typical SIMP method. Using the penalty formulation of the SIMP approach, a topology optimization problem is formulated in co-operation, i.e., couple-signals, with design variable values of discrete elements and a regularized Heaviside step function. The regularization of discontinuous material distributions is a key scheme in order to improve the numerical problems of material topology optimization with 0 (void)-1 (solid) solutions. The weak forms of an equilibrium equation are expressed using a coupled regularized Heaviside function to evaluate sensitivity analysis. Numerical results show that the incorporation of the regularized Heaviside function and the SIMP leads to convergent solutions. This method is tested using several examples of a linear elastostatic structure. It demonstrates that improved optimal solutions can be obtained without the additional use of sensitivity filtering to improve the discontinuous 0-1 solutions, which have generally been used in material topology optimization problems.

Modified Phillips-Tikhonov regularization for plasma image reconstruction with modified Laplacian matrix

  • Jang, Si-Won;Lee, Seung-Heon;Choe, Won-Ho
    • Proceedings of the Korean Vacuum Society Conference
    • /
    • 2010.02a
    • /
    • pp.472-472
    • /
    • 2010
  • The tomography has played a key role in tokamak plasma diagnostics for image reconstruction. The Phillips-Tikhonov (P-T) regularization method was attempted in this work to reconstruct cross-sectional phantom images of the plasma by minimizing the gradient between adjacent pixel data. Recent studies about the comparison of the several tomographic reconstruction methods showed that the P-T method produced more accurate results. We have studied existing Laplacian matrix used in Phillips-Tikhonov regularization method and developed modified Laplacian matrix (Modified L). The comparison of the reconstruction result by the modified L and existing L showed that modified L produced more accurate result. The difference was significantly pronounced when a portion of plasma was reconstructed. These results can be utilized in the Edge Plasma diagnostics; especially in divertor diagnostics on tokamak a large impact is expected. In addition, accurate reconstruction results from received data in only one direction were confirmed through phantom test by using P-T method with modified L. These results can be applied to the tangentially viewing pin-hole camera diagnostics on tokamak.

  • PDF

Estimation of Hysteretic Behaviors of a Seismic Isolator Using a Regularized Output Error Estimator (정규화된 OEE를 이용한 지진격리장치의 이력거동 추정)

  • 박현우;전영선;서정문
    • Proceedings of the Earthquake Engineering Society of Korea Conference
    • /
    • 2003.03a
    • /
    • pp.85-92
    • /
    • 2003
  • Hysteretic behaviors of a seismic isolator are identified by using the regularized output error estimator (OEE) based on the secant stiffness model. A proper regularity condition of tangent stiffness for the current OEE is proposed considering the regularity condition of Duhem hysteretic operator. The proposed regularity condition is defined by 12-norm of the tangent stiffness with respect to time. The secant stiffness model for the OEE is obtained by approximating the tangent stiffness under the proposed regularity condition by the secant stiffness at each time step. A least square method is employed to minimize the difference between the calculated response and measured response for the OEE. The regularity condition of the secant stiffness is utilized to alleviate ill-posedness of the OEE and to yield numerically stable solutions through the regularization technique. An optimal regularization factor determined by geometric mean scheme (GMS) is used to yield appropriate regularization effects on the OEE.

  • PDF

A WEIGHTED GLOBAL GENERALIZED CROSS VALIDATION FOR GL-CGLS REGULARIZATION

  • Chung, Seiyoung;Kwon, SunJoo;Oh, SeYoung
    • Journal of the Chungcheong Mathematical Society
    • /
    • v.29 no.1
    • /
    • pp.59-71
    • /
    • 2016
  • To obtain more accurate approximation of the true images in the deblurring problems, the weighted global generalized cross validation(GCV) function to the inverse problem with multiple right-hand sides is suggested as an efficient way to determine the regularization parameter. We analyze the experimental results for many test problems and was able to obtain the globally useful range of the weight when the preconditioned global conjugate gradient linear least squares(Gl-CGLS) method with the weighted global GCV function is applied.

Influence of Regularization Parameter on Algebraic Reconstruction Technique (대수적 재구성 기법에서 정규화 인자의 영향)

  • Son, Jung Min;Chon, Kwon Su
    • Journal of the Korean Society of Radiology
    • /
    • v.11 no.7
    • /
    • pp.679-685
    • /
    • 2017
  • Computed tomography has widely been used to diagnose patient disease, and patient dose also increase rapidly. To reduce the patient dose by CT, various techniques have been applied. The iterative reconstruction is used in view of image reconstruction. Image quality of the reconstructed section image through algebraic reconstruction technique, one of iterative reconstruction methods, was examined by the normalized root mean square error. The computer program was written with the Visual C++ under the parallel beam geometry, Shepp-Logan head phantom of $512{\times}512$ size, projections of 360, and detector-pixels of 1,024. The forward and backward projection was realized by Joseph method. The minimum NRMS of 0.108 was obtained after 10 iterations in the regularization parameter of 0.09-0.12, and the optimum image was obtained after 8 and 6 iterations for 0.1% and 0.2% noise. Variation of optimum value of the regularization parameter was observed according to the phantom used. If the ART was used in the reconstruction, the optimal value of the regularization parameter should be found in the case-by-case. By finding the optimal regularization parameter in the algebraic reconstruction technique, the reconstruction time can be reduced.

A Study on the Dyadic Sorting method for the Regularization in DT-MRI (Dyadic Sorting 방법을 이용한 DT-MRI Regularization에 관한 연구)

  • Kim, Tae-Hwan;Woo, Jong-Hyung;Lee, Hoon;Kim, Dong-Youn
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.47 no.4
    • /
    • pp.30-39
    • /
    • 2010
  • Since Diffusion tensor from Diffusion Tensor Magnetic Resonance Imaging(DT-MRI) is so sensitive to noise, the principle eigenvector(PEV) calculated from Diffusion tensor could be erroneous. Tractography obtained from PEV could be deviated from the real fiber tract. Therefore regularization process is needed to eliminate noise. In this paper, to reduce noise in DT-MRI measurements, the Dyadic Sorting(DS) method as regularization of the eigenvalue and the eigenvector is applied in the tractography. To resort the eigenvalues and the eignevectors, the DS method uses the intervoxel overlap function which can measure the overlap between eigenvalue-eigenvector pairs in the $3\times3$ pixel. In this paper, we applied the DS method to the three-dimensional volume. We discuss the error analysis and numerical study to the synthetic and the experimental data. As a result, we have shown that the DS method is more efficient than the median filtering methods as much as 79.97%~83.64%, 85.62%~87.76% in AAE, AFA respectively for the corticospinal tract of the experimental data.

Semi-supervised learning using similarity and dissimilarity

  • Seok, Kyung-Ha
    • Journal of the Korean Data and Information Science Society
    • /
    • v.22 no.1
    • /
    • pp.99-105
    • /
    • 2011
  • We propose a semi-supervised learning algorithm based on a form of regularization that incorporates similarity and dissimilarity penalty terms. Our approach uses a graph-based encoding of similarity and dissimilarity. We also present a model-selection method which employs cross-validation techniques to choose hyperparameters which affect the performance of the proposed method. Simulations using two types of dat sets demonstrate that the proposed method is promising.

Edge-Preserving Image Restoration Using Block-Based Edge Classification (블록기반의 윤곽선 분류를 이용한 윤곽선 보존 영상복원 기법)

  • 이상광;호요성
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 1998.06a
    • /
    • pp.33-36
    • /
    • 1998
  • Most image restoration problems are ill-posed and need to e regularized. A difficult task in image regularization is to avoid smoothing of image edges. In this paper, were proposed an edge-preserving image restoration algorithm using block-based edge classification. In order to exploit the local image characteristics, we classify image blocks into edge and no-edge blocks. We then apply an adaptive constrained least squares (CLS) algorithm to eliminate noise around the edges. Experimental results demonstrate that the proposed algorithm can preserve image edges during the regularization process.

  • PDF

A QUASI-NEWTON BUNDLE METHOD BASED ON APPROXIMATE SUBGRADIENTS

  • Jie, Shen;Pang, Li-Ping
    • Journal of applied mathematics & informatics
    • /
    • v.23 no.1_2
    • /
    • pp.361-367
    • /
    • 2007
  • In this paper we propose an implementable method for solving a nonsmooth convex optimization problem by combining Moreau-Yosida regularization, bundle and quasi-Newton ideas. The method we propose makes use of approximate subgradients of the objective function, which makes the method easier to implement. We also prove the convergence of the proposed method under some additional assumptions.