• Title/Summary/Keyword: Regularization method

Search Result 299, Processing Time 0.031 seconds

MULTIGRID METHOD FOR TOTAL VARIATION IMAGE DENOISING

  • HAN, MUN S.;LEE, JUN S.
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • v.6 no.2
    • /
    • pp.9-24
    • /
    • 2002
  • Total Variation(TV) regularization method is effective for reconstructing "blocky", discontinuous images from contaminated image with noise. But TV is represented by highly nonlinear integro-differential equation that is hard to solve. There have been much effort to obtain stable and fast methods. C. Vogel introduced "the Fixed Point Lagged Diffusivity Iteration", which solves the nonlinear equation by linearizing. In this paper, we apply multigrid(MG) method for cell centered finite difference (CCFD) to solve system arise at each step of this fixed point iteration. In numerical simulation, we test various images varying noises and regularization parameter $\alpha$ and smoothness $\beta$ which appear in TV method. Numerical tests show that the parameter ${\beta}$ does not affect the solution if it is sufficiently small. We compute optimal $\alpha$ that minimizes the error with respect to $L^2$ norm and $H^1$ norm and compare reconstructed images.

  • PDF

Estimation of Viscoelastic Properties of Trabecular Bone Using An Inverse Method (역추기법을 이용한 해면골의 점탄성 특성 해석)

  • Kang, Shin-Ill;Lee, Won-Hee;Hong, Jung-Hwa
    • Journal of Biomedical Engineering Research
    • /
    • v.18 no.3
    • /
    • pp.211-216
    • /
    • 1997
  • An inverse method with regularization has been developed to determine the viscoelastic properties of trabecular bone. A series of stress relaxation experiments were performed under the condition of uniaxial compression stress state. Optimization has been formulated within the framework of nonlinear least-squares and a modified Gauss-Newton method with a zeroth-order regularization technique. The stress relaxation behavior of trabecular bone was analyzed using a standard viscoelastic model. The present study clearly shows that trabecular bone exhibits typical viscoelastic stress relaxation behavior, and the obtained material parameters well represent the viscoelastic behavior of trabecular bone.

  • PDF

Modified Phillips-Tikhonov regularization for plasma image reconstruction with modified Laplacian matrix

  • Jang, Si-Won;Lee, Seung-Heon;Choe, Won-Ho
    • Proceedings of the Korean Vacuum Society Conference
    • /
    • 2010.02a
    • /
    • pp.472-472
    • /
    • 2010
  • The tomography has played a key role in tokamak plasma diagnostics for image reconstruction. The Phillips-Tikhonov (P-T) regularization method was attempted in this work to reconstruct cross-sectional phantom images of the plasma by minimizing the gradient between adjacent pixel data. Recent studies about the comparison of the several tomographic reconstruction methods showed that the P-T method produced more accurate results. We have studied existing Laplacian matrix used in Phillips-Tikhonov regularization method and developed modified Laplacian matrix (Modified L). The comparison of the reconstruction result by the modified L and existing L showed that modified L produced more accurate result. The difference was significantly pronounced when a portion of plasma was reconstructed. These results can be utilized in the Edge Plasma diagnostics; especially in divertor diagnostics on tokamak a large impact is expected. In addition, accurate reconstruction results from received data in only one direction were confirmed through phantom test by using P-T method with modified L. These results can be applied to the tangentially viewing pin-hole camera diagnostics on tokamak.

  • PDF

An Extension of Unified Bayesian Tikhonov Regularization Method and Application to Image Restoration (통합 베이즈 티코노프 정규화 방법의 확장과 영상복원에 대한 응용)

  • Yoo, Jae Hung
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.15 no.1
    • /
    • pp.161-166
    • /
    • 2020
  • This paper suggests an extension of the unified Bayesian Tikhonov regularization method. The unified method establishes the relationship between Tikhonov regularization parameter and Bayesian hyper-parameters, and presents a formula for obtaining the regularization parameter using the maximum posterior probability and the evidence framework. When the dimension of the data matrix is m by n (m >= n), we derive that the total misfit has the range of m ± n instead of m. Thus the search range is extended from one to 2n + 1 integer points. Golden section search rather than linear one is applied to reduce the time. A new benchmark for optimizing relative error and new model selection criteria to target it are suggested. The experimental results show the effectiveness of the proposed method in the image restoration problem.

The Effect of regularization and identity mapping on the performance of activation functions (정규화 및 항등사상이 활성함수 성능에 미치는 영향)

  • Ryu, Seo-Hyeon;Yoon, Jae-Bok
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.18 no.10
    • /
    • pp.75-80
    • /
    • 2017
  • In this paper, we describe the effect of the regularization method and the network with identity mapping on the performance of the activation functions in deep convolutional neural networks. The activation functions act as nonlinear transformation. In early convolutional neural networks, a sigmoid function was used. To overcome the problem of the existing activation functions such as gradient vanishing, various activation functions were developed such as ReLU, Leaky ReLU, parametric ReLU, and ELU. To solve the overfitting problem, regularization methods such as dropout and batch normalization were developed on the sidelines of the activation functions. Additionally, data augmentation is usually applied to deep learning to avoid overfitting. The activation functions mentioned above have different characteristics, but the new regularization method and the network with identity mapping were validated only using ReLU. Therefore, we have experimentally shown the effect of the regularization method and the network with identity mapping on the performance of the activation functions. Through this analysis, we have presented the tendency of the performance of activation functions according to regularization and identity mapping. These results will reduce the number of training trials to find the best activation function.

Optimizing structural topology patterns using regularization of Heaviside function

  • Lee, Dongkyu;Shin, Soomi
    • Structural Engineering and Mechanics
    • /
    • v.55 no.6
    • /
    • pp.1157-1176
    • /
    • 2015
  • This study presents optimizing structural topology patterns using regularization of Heaviside function. The present method needs not filtering process to typical SIMP method. Using the penalty formulation of the SIMP approach, a topology optimization problem is formulated in co-operation, i.e., couple-signals, with design variable values of discrete elements and a regularized Heaviside step function. The regularization of discontinuous material distributions is a key scheme in order to improve the numerical problems of material topology optimization with 0 (void)-1 (solid) solutions. The weak forms of an equilibrium equation are expressed using a coupled regularized Heaviside function to evaluate sensitivity analysis. Numerical results show that the incorporation of the regularized Heaviside function and the SIMP leads to convergent solutions. This method is tested using several examples of a linear elastostatic structure. It demonstrates that improved optimal solutions can be obtained without the additional use of sensitivity filtering to improve the discontinuous 0-1 solutions, which have generally been used in material topology optimization problems.

Tikhonov's Solution of Unstable Axisymmetric Initial Value Problem of Wave Propagation: Deteriorated Noisy Measurement Data

  • Jang, Taek-Soo;Han, So-Lyoung
    • Journal of Ocean Engineering and Technology
    • /
    • v.22 no.4
    • /
    • pp.1-7
    • /
    • 2008
  • The primary aim of the paper is to solve an unstable axisymmetric initial value problem of wave propagation when given initial data that is deteriorated by noise such as measurement error. To overcome the instability of the problem, Tikhonov's regularization, known as a non-iterative numerical regularization method, is introduced to solve the problem. The L-curvecriterion is introduced to find the optimal regularization parameter for the solution. It is confirmed that fairly stable solutions are realized and that they are accurate when compared to the exact solution.

The Regularization Algorithm of Configuration for Geodesic Borne (지오데식 돔의 형상 균일화 알고리즘)

  • 한상을;이효천;이지연
    • Proceedings of the Computational Structural Engineering Institute Conference
    • /
    • 2003.10a
    • /
    • pp.340-347
    • /
    • 2003
  • The aim of regularization of a structural configuration is to obtain a structure that consists of elements with identical or nearly identical length. And it is also possible to modify the configuration in a manner that the size of the elements vary in accordance with a specified pattern. For practical purpose, geodesic dome is cut off at a suitable place in order to make it fit on horizontal. Inevitably this pattern effects a change of element lengths. The purpose of this study is to verify a method for regularization of structural configuration by genetic algorithms and modify the element lengths of the dome. As a result of regularization of domes with various rise-span ratio, modified configurations have more regular element lengths and are more economical than initial configurations.

  • PDF

Semi-supervised learning using similarity and dissimilarity

  • Seok, Kyung-Ha
    • Journal of the Korean Data and Information Science Society
    • /
    • v.22 no.1
    • /
    • pp.99-105
    • /
    • 2011
  • We propose a semi-supervised learning algorithm based on a form of regularization that incorporates similarity and dissimilarity penalty terms. Our approach uses a graph-based encoding of similarity and dissimilarity. We also present a model-selection method which employs cross-validation techniques to choose hyperparameters which affect the performance of the proposed method. Simulations using two types of dat sets demonstrate that the proposed method is promising.

Improved Density-Independent Fuzzy Clustering Using Regularization (레귤러라이제이션 기반 개선된 밀도 무관 퍼지 클러스터링)

  • Han, Soowhan;Heo, Gyeongyong
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.24 no.1
    • /
    • pp.1-7
    • /
    • 2020
  • Fuzzy clustering, represented by FCM(Fuzzy C-Means), is a simple and efficient clustering method. However, the object function in FCM makes clusters affect clustering results proportional to the density of clusters, which can distort clustering results due to density difference between clusters. One method to alleviate this density problem is EDI-FCM(Extended Density-Independent FCM), which adds additional terms to the objective function of FCM to compensate for the density difference. In this paper, proposed is an enhanced EDI-FCM using regularization, Regularized EDI-FCM. Regularization is commonly used to make a solution space smooth and an algorithm noise insensitive. In clustering, regularization can reduce the effect of a high-density cluster on clustering results. The proposed method converges quickly and accurately to real centers when compared with FCM and EDI-FCM, which can be verified with experimental results.