• 제목/요약/키워드: elastic net

검색결과 139건 처리시간 0.024초

희소 투영행렬 획득을 위한 RSR 개선 방법론 (An Improved RSR Method to Obtain the Sparse Projection Matrix)

  • 안정호
    • 디지털콘텐츠학회 논문지
    • /
    • 제16권4호
    • /
    • pp.605-613
    • /
    • 2015
  • 본 논문은 패턴인식에서 자주 사용되는 투영행렬을 희소화하는 문제를 다룬다. 최근 임베디드 시스템이 널리 사용됨에 따라 탑재되는 프로그램의 용량이 제한받는 경우가 빈번히 발생한다. 개발된 프로그램은 상수 데이터를 포함하는 경우가 많다. 예를 들어, 얼굴인식과 같은 패턴인식 프로그램의 경우 고차원 벡터를 저차원 벡터로 차원을 축소하는 투영행렬을 사용하는 경우가 많다. 인식성능 향상을 위해 영상으로부터 매우 높은 차원의 고차원 특징벡터를 추출하는 경우 투영행렬의 사이즈는 매우 크다. 최근 라소 회귀분석 방법을 이용한 RSR(rotated sparse regression) 방법론[1]이 제안되었다. 이 방법론은 여러 실험을 통해 희소행렬을 구하는 가장 우수한 알고리즘 중 하나로 평가받고 있다. 우리는 본 논문에서 RSR을 개선할 수 있는 세 가지 방법론을 제안한다. 즉, 학습데이터에서 이상치를 제거하여 일반화 성능을 높이는 방법, 학습데이터를 랜덤 샘플링하여 희소율을 높이는 방법, RSR의 목적함수에 엘라스틱 넷 회귀분석의 패널티 항을 사용한 E-RSR(elastic net-RSR) 방법을 제안한다. 우리는 실험을 통해 제안한 방법론이 인식률을 희생하지 않으며 희소율을 크게 증가시킴으로써 기존 RSR 방법론을 개선할 수 있음을 보였다.

계층적 벌점함수를 이용한 주성분분석 (Hierarchically penalized sparse principal component analysis)

  • 강종경;박재신;방성완
    • 응용통계연구
    • /
    • 제30권1호
    • /
    • pp.135-145
    • /
    • 2017
  • 주성분 분석(principal component analysis; PCA)은 서로 상관되어 있는 다변량 자료의 차원을 축소하는 대표적인 기법으로 많은 다변량 분석에서 활용되고 있다. 하지만 주성분은 모든 변수들의 선형결합으로 이루어지므로, 그 결과의 해석이 어렵다는 한계가 있다. sparse PCA(SPCA) 방법은 elastic net 형태의 벌점함수를 이용하여 보다 성긴(sparse) 적재를 가진 수정된 주성분을 만들어주지만, 변수들의 그룹구조를 이용하지 못한다는 한계가 있다. 이에 본 연구에서는 기존 SPCA를 개선하여, 자료가 그룹화되어 있는 경우에 유의한 그룹을 선택함과 동시에 그룹 내 불필요한 변수를 제거할 수 있는 새로운 주성분 분석 방법을 제시하고자 한다. 그룹과 그룹 내 변수 구조를 모형 적합에 이용하기 위하여, sparse 주성분 분석에서의 elastic net 벌점함수 대신에 계층적 벌점함수 형태를 고려하였다. 또한 실제 자료의 분석을 통해 제안 방법의 성능 및 유용성을 입증하였다.

Selection probability of multivariate regularization to identify pleiotropic variants in genetic association studies

  • Kim, Kipoong;Sun, Hokeun
    • Communications for Statistical Applications and Methods
    • /
    • 제27권5호
    • /
    • pp.535-546
    • /
    • 2020
  • In genetic association studies, pleiotropy is a phenomenon where a variant or a genetic region affects multiple traits or diseases. There have been many studies identifying cross-phenotype genetic associations. But, most of statistical approaches for detection of pleiotropy are based on individual tests where a single variant association with multiple traits is tested one at a time. These approaches fail to account for relations among correlated variants. Recently, multivariate regularization methods have been proposed to detect pleiotropy in analysis of high-dimensional genomic data. However, they suffer a problem of tuning parameter selection, which often results in either too many false positives or too small true positives. In this article, we applied selection probability to multivariate regularization methods in order to identify pleiotropic variants associated with multiple phenotypes. Selection probability was applied to individual elastic-net, unified elastic-net and multi-response elastic-net regularization methods. In simulation studies, selection performance of three multivariate regularization methods was evaluated when the total number of phenotypes, the number of phenotypes associated with a variant, and correlations among phenotypes are different. We also applied the regularization methods to a wild bean dataset consisting of 169,028 variants and 17 phenotypes.

Mechanical and elastic properties of vitrified radioactive wastes using ultrasonic technique

  • Sema Akyil Erenturk;Filiz Gur;Mahmoud A.A. Aslani
    • Nuclear Engineering and Technology
    • /
    • 제56권2호
    • /
    • pp.472-476
    • /
    • 2024
  • It is important that radioactive and nuclear wastes are immobilized in a glass composition with lower melting temperatures due to their economy. In this study, the elastic and mechanical properties of sodium borate-based vitrified radioactive waste were measured using ultrasonic techniques. Many ultrasonic parameters, such as elastic moduli, Poisson's ratio, and microhardness, were calculated by measuring the ultrasonic velocities of the glasses. The ultrasonic velocity data, the density, the calculated elastic moduli, micro-hardness, softening temperature, and Debye temperature depending on the glass composition were evaluated, and the relation with the structure was clarified. It was observed that the elastic modulus and Poisson ratio increased as the Cs2O content increased in glasses containing Cs waste. This result shows that the rigidity of the network structure of these glasses increases in contrast to the glass containing Sr.

Simplified elastic-plastic analysis procedure for strain-based fatigue assessment of nuclear safety class 1 components under severe seismic loads

  • Kim, Jong-Sung;Kim, Jun-Young
    • Nuclear Engineering and Technology
    • /
    • 제52권12호
    • /
    • pp.2918-2927
    • /
    • 2020
  • This paper proposes a simplified elastic-plastic analysis procedure using the penalty factors presented in the Code Case N-779 for strain-based fatigue assessment of nuclear safety class 1 components under severe seismic loads such as safety shutdown earthquake and beyond design-basis earthquake. First, a simplified elastic-plastic analysis procedure for strain-based fatigue assessment of nuclear safety class 1 components under the severe seismic loads was proposed based on the analysis result for the simplified elastic-plastic analysis procedure in the Code Case N-779 and the stress categories corresponding to normal operation and seismic loads. Second, total strain amplitude was calculated directly by performing finite element cyclic elastic-plastic seismic analysis for a hot leg nozzle in pressurizer surge line subject to combined loading including deadweight, pressure, seismic inertia load, and seismic anchor motion, as well as was derived indirectly by applying the proposed analysis procedure to the finite element elastic stress analysis result for each load. Third, strain-based fatigue assessment was implemented by applying the strain-based fatigue acceptance criteria in the ASME B&PV Code, Sec. III, Subsec. NB, Article NB-3200 and by using the total strain amplitude values calculated. Last, the total strain amplitude and the fatigue assessment result corresponding to the simplified elastic-plastic analysis were compared with those using the finite element elastic-plastic seismic analysis results. As a result of the comparison, it was identified that the proposed analysis procedure can derive reasonable and conservative results.

A modified U-net for crack segmentation by Self-Attention-Self-Adaption neuron and random elastic deformation

  • Zhao, Jin;Hu, Fangqiao;Qiao, Weidong;Zhai, Weida;Xu, Yang;Bao, Yuequan;Li, Hui
    • Smart Structures and Systems
    • /
    • 제29권1호
    • /
    • pp.1-16
    • /
    • 2022
  • Despite recent breakthroughs in deep learning and computer vision fields, the pixel-wise identification of tiny objects in high-resolution images with complex disturbances remains challenging. This study proposes a modified U-net for tiny crack segmentation in real-world steel-box-girder bridges. The modified U-net adopts the common U-net framework and a novel Self-Attention-Self-Adaption (SASA) neuron as the fundamental computing element. The Self-Attention module applies softmax and gate operations to obtain the attention vector. It enables the neuron to focus on the most significant receptive fields when processing large-scale feature maps. The Self-Adaption module consists of a multiplayer perceptron subnet and achieves deeper feature extraction inside a single neuron. For data augmentation, a grid-based crack random elastic deformation (CRED) algorithm is designed to enrich the diversities and irregular shapes of distributed cracks. Grid-based uniform control nodes are first set on both input images and binary labels, random offsets are then employed on these control nodes, and bilinear interpolation is performed for the rest pixels. The proposed SASA neuron and CRED algorithm are simultaneously deployed to train the modified U-net. 200 raw images with a high resolution of 4928 × 3264 are collected, 160 for training and the rest 40 for the test. 512 × 512 patches are generated from the original images by a sliding window with an overlap of 256 as inputs. Results show that the average IoU between the recognized and ground-truth cracks reaches 0.409, which is 29.8% higher than the regular U-net. A five-fold cross-validation study is performed to verify that the proposed method is robust to different training and test images. Ablation experiments further demonstrate the effectiveness of the proposed SASA neuron and CRED algorithm. Promotions of the average IoU individually utilizing the SASA and CRED module add up to the final promotion of the full model, indicating that the SASA and CRED modules contribute to the different stages of model and data in the training process.

다중선형회귀모형에서의 변수선택기법 평가 (Evaluating Variable Selection Techniques for Multivariate Linear Regression)

  • 류나현;김형석;강필성
    • 대한산업공학회지
    • /
    • 제42권5호
    • /
    • pp.314-326
    • /
    • 2016
  • The purpose of variable selection techniques is to select a subset of relevant variables for a particular learning algorithm in order to improve the accuracy of prediction model and improve the efficiency of the model. We conduct an empirical analysis to evaluate and compare seven well-known variable selection techniques for multiple linear regression model, which is one of the most commonly used regression model in practice. The variable selection techniques we apply are forward selection, backward elimination, stepwise selection, genetic algorithm (GA), ridge regression, lasso (Least Absolute Shrinkage and Selection Operator) and elastic net. Based on the experiment with 49 regression data sets, it is found that GA resulted in the lowest error rates while lasso most significantly reduces the number of variables. In terms of computational efficiency, forward/backward elimination and lasso requires less time than the other techniques.

Supervised Learning-Based Collaborative Filtering Using Market Basket Data for the Cold-Start Problem

  • Hwang, Wook-Yeon;Jun, Chi-Hyuck
    • Industrial Engineering and Management Systems
    • /
    • 제13권4호
    • /
    • pp.421-431
    • /
    • 2014
  • The market basket data in the form of a binary user-item matrix or a binary item-user matrix can be modelled as a binary classification problem. The binary logistic regression approach tackles the binary classification problem, where principal components are predictor variables. If users or items are sparse in the training data, the binary classification problem can be considered as a cold-start problem. The binary logistic regression approach may not function appropriately if the principal components are inefficient for the cold-start problem. Assuming that the market basket data can also be considered as a special regression problem whose response is either 0 or 1, we propose three supervised learning approaches: random forest regression, random forest classification, and elastic net to tackle the cold-start problem, comparing the performance in a variety of experimental settings. The experimental results show that the proposed supervised learning approaches outperform the conventional approaches.

THE INFLUENCE OF DRIVING FUNCTION ON FLOW DRIVEN BY PUMPING WITHOUT VALVES

  • Jung, Eun-Ok
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • 제15권2호
    • /
    • pp.97-122
    • /
    • 2011
  • Fluid dynamics driven by pumping without valves (valveless pumping) shows interesting physics. Especially, the driving function to generate valveless pump mechanism is one of important factors. We consider a closed system of valveless pump which consists of flexible tube part and stiffer part. Fluid and structure (elastic tube) interaction motions are generated by the periodic compress-and-release actions on an asymmetric location of the elastic loop of tubing. In this work, we demonstrate how important the driving forcing function affects a net flow in the valveless circulatory system and investigate which parameter set of the system gives a more efficient net flow around the loop.

불포화토에서 공극비의 추정 (The Prediction of Void Ratio in Unsaturated Soils)

  • 이달원
    • 한국농공학회논문집
    • /
    • 제48권4호
    • /
    • pp.51-57
    • /
    • 2006
  • This study was carried out to investigate the soil water characteristic curve and prediction of void ratio with net stress and matric suction using the linear elastic and volumetric deformation analysis method on unsaturated silty. The unsaturated soil tests were conducted using a modified oedometer cell and specimens were prepared at water content 2 times of liquid limit and required void ratio. The axis translation technique was used to create the desired matric suctions in the samples. It is shown that soil water characteristic curve and volumetric water content were affected significantly by preconsolidation pressure. As a matric suction increases, the reduction ratio of void ratio was shown to considerably small. Also, the predicted and measured void ratio for unsaturated soils using the linear elastic and volumetric deformation analysis showed good agreement as net stress and matric suction increases.