• Journal of the Korean Mathematical Society
• /
• v.49 no.5
• /
• pp.927-945
• /
• 2012

An approximation of singular source terms in elliptic problems is developed and analyzed. Under certain assumptions on the curve where the singular source is defined, the second order convergence in the maximum norm can be proved. Numerical results present its better performance compared to previously developed regularization techniques.

• 제어로봇시스템학회:학술대회논문집
• /
• 2001.10a
• /
• pp.41.5-41
• /
• 2001

A novel method is introduced for determining the weights of a regularization network which approximates one-to-many mapping. A conventional neural network will converges to the average value when outputs are multiple for one input. The capability of proposed network is demonstrated by an example of learning inverse mapping.

• Journal of Biomedical Engineering Research
• /
• v.36 no.5
• /
• pp.211-220
• /
• 2015

Recently, model-based iterative reconstruction (MBIR) has played an important role in transmission tomography by significantly improving the quality of reconstructed images for low-dose scans. MBIR is based on the penalized-likelihood (PL) approach, where the penalty term (also known as the regularizer) stabilizes the unstable likelihood term, thereby suppressing the noise. In this work we further improve MBIR by using a more expressive regularizer which can restore the underlying image more accurately. Here we used a spline regularizer derived from a linear combination of the two-dimensional splines with first- and second-order spatial derivatives and applied it to a non-quadratic convex penalty function. To derive a PL algorithm with the spline regularizer, we used a separable paraboloidal surrogates algorithm for convex optimization. The experimental results demonstrate that our regularization method improves reconstruction accuracy in terms of both regional percentage error and contrast recovery coefficient by restoring smooth edges as well as sharp edges more accurately.

• Proceedings of the KSEEG Conference
• /
• 2002.04a
• /
• pp.167-169
• /
• 2002

The extended Born, or localized nonlinear approximation of integral equation (IE) solution has been applied to inverting single-hole electromagnetic (EM) data using a cylindrically symmetric model. The extended Born approximation is less accurate than a full solution but much superior to the simple Born approximation. When applied to the cylindrically symmetric model with a vertical magnetic dipole source, however, the accuracy of the extended Born approximation is greatly improved because the electric field is scalar and continuous everywhere. One of the most important steps in the inversion is the selection of a proper regularization parameter for stability. Occam's inversion (Constable et al., 1987) is an excellent method for obtaining a stable inverse solution. It is extremely slow when combined with a differential equation method because many forward simulations are needed but suitable for the extended Born solution because the Green's functions, the most time consuming part in IE methods, are repeatedly re-usable throughout the inversion. In addition, the If formulation also readily contains a sensitivity matrix, which can be revised at each iteration at little expense. The inversion algorithm developed in this study is quite stable and fast even if the optimum regularization parameter Is sought at each iteration step. Tn this paper we show inversion results using synthetic data obtained from a finite-element method and field data as well.

• Journal of Biomedical Engineering Research
• /
• v.22 no.4
• /
• pp.311-319
• /
• 2001

Statistical reconstruction methods in the context of a Bayesian framework have played an important role in emission tomography since they allow to incorporate a priori information into the reconstruction algorithm. Given the ill-posed nature of tomographic inversion and the poor quality of projection data, the Bayesian approach uses regularizers to stabilize solutions by incorporating suitable prior models. In this work we show that, while the quantitative performance of the standard filtered backprojection (FBP) algorithm is not as good as that of Bayesian methods, the application of spline-regularized smoothing to the sinogram space can make the FBP algorithm improve its performance by inheriting the advantages of using the spline priors in Bayesian methods. We first show how to implement the spline-regularized smoothing filter by deriving mathematical relationship between the regularization and the lowpass filtering. We then compare quantitative performance of our new FBP algorithms using the quantitation of bias/variance and the total squared error (TSE) measured over noise trials. Our numerical results show that the second-order spline filter applied to FBP yields the best results in terms of TSE among the three different spline orders considered in our experiments.

• Journal of Broadcast Engineering
• /
• v.26 no.1
• /
• pp.79-87
• /
• 2021

In this paper, we analysis the semi-supervised learning (SSL), which is adopted in order to train a deep learning-based classification model using the small number of labeled data. The conventional SSL techniques can be categorized into consistency regularization, entropy-based, and pseudo labeling. First, we describe the algorithm of each SSL technique. In the experimental results, we evaluate the classification accuracy of each SSL technique varying the number of labeled data. Finally, based on the experimental results, we describe the limitations of SSL technique, and suggest the research direction to improve the classification performance of SSL.

• Geophysics and Geophysical Exploration
• /
• v.20 no.2
• /
• pp.78-87
• /
• 2017

For efficient data processing, trace interpolation and regularization techniques should be antecedently applied to the seismic data which were irregularly sampled with missing traces. Among many interpolation techniques, MWNI (Minimum Weighted Norm Interpolation) technique is one of the most versatile techniques and widely used to regularize seismic data because of easy extension to the high-order module and low computational cost. However, since it is difficult to interpolate spatially aliased data using this technique, model-constrained MWNI was suggested to compensate for this problem. In this paper, conventional MWNI and model-constrained MWNI modules have been developed in order to analyze their performance using synthetic data and validate the applicability to the field data. The result by using model-constrained MWNI was better in spatially aliased data. In order to verify the applicability to the field data, interpolation and regularization were performed for two field data sets, respectively. Firstly, the seismic data acquired in Ulleung Basin gas hydrate field was interpolated. Even though the data has very chaotic feature and complex structure due to the chimney, the developed module showed fairly good interpolation result. Secondly, very irregularly sampled and widely missing seismic data was regularized and the connectivity of events was quite improved. According to these experiments, we can confirm that the developed module can successfully interpolate and regularize the irregularly sampled field data.

• Journal of the Korean Data and Information Science Society
• /
• v.28 no.6
• /
• pp.1229-1244
• /
• 2017

In recent years, as demand for data-based analytical methodologies increases in various fields, optimization methods have been developed to handle them. In particular, various constraints required for problems in statistics and machine learning can be solved by convex optimization. Alternating direction method of multipliers (ADMM) can effectively deal with linear constraints, and it can be effectively used as a parallel optimization algorithm. ADMM is an approximation algorithm that solves complex original problems by dividing and combining the partial problems that are easier to optimize than original problems. It is useful for optimizing non-smooth or composite objective functions. It is widely used in statistical and machine learning because it can systematically construct algorithms based on dual theory and proximal operator. In this paper, we will examine applications of ADMM algorithm in various fields related to statistics, and focus on two major points: (1) splitting strategy of objective function, and (2) role of the proximal operator in explaining the Lagrangian method and its dual problem. In this case, we introduce methodologies that utilize regularization. Simulation results are presented to demonstrate effectiveness of the lasso.

• Knowledge Management Research
• /
• v.22 no.4
• /
• pp.27-40
• /
• 2021

Click-Through Rate (CTR) prediction is a key function that determines the ranking of candidate items in the recommendation system and recommends high-ranking items to reduce customer information overload and achieve profit maximization through sales promotion. The fields of natural language processing and image classification are achieving remarkable growth through the use of deep neural networks. Recently, a transformer model based on an attention mechanism, differentiated from the mainstream models in the fields of natural language processing and image classification, has been proposed to achieve state-of-the-art in this field. In this study, we present a method for improving the performance of a transformer model for CTR prediction. In order to analyze the effect of discrete and categorical CTR data characteristics different from natural language and image data on performance, experiments on embedding regularization and transformer normalization are performed. According to the experimental results, it was confirmed that the prediction performance of the transformer was significantly improved when the L2 generalization was applied in the embedding process for CTR data input processing and when batch normalization was applied instead of layer normalization, which is the default regularization method, to the transformer model.

• Journal of the Korean Mathematical Society
• /
• v.54 no.3
• /
• pp.945-966
• /
• 2017

The paper develops a rigorous mathematical framework for the behavior of arch and membrane like structures. Our main goal is to incorporate moving point loads. Both the weak and the strong damping cases are considered. First, we prove the existence and the uniqueness of the solutions. Then it is shown that the solution in the weak damping case is the limit of the strong damping solutions, as the strong damping vanishes. The theory is applied to a car moving on a bridge.