• Title/Summary/Keyword: optimal iterative methods

Search Result 91, Processing Time 0.02 seconds

An importance sampling for a function of a multivariate random variable

  • Jae-Yeol Park;Hee-Geon Kang;Sunggon Kim
    • Communications for Statistical Applications and Methods
    • /
    • v.31 no.1
    • /
    • pp.65-85
    • /
    • 2024
  • The tail probability of a function of a multivariate random variable is not easy to estimate by the crude Monte Carlo simulation. When the occurrence of the function value over a threshold is rare, the accurate estimation of the corresponding probability requires a huge number of samples. When the explicit form of the cumulative distribution function of each component of the variable is known, the inverse transform likelihood ratio method is directly applicable scheme to estimate the tail probability efficiently. The method is a type of the importance sampling and its efficiency depends on the selection of the importance sampling distribution. When the cumulative distribution of the multivariate random variable is represented by a copula and its marginal distributions, we develop an iterative algorithm to find the optimal importance sampling distribution, and show the convergence of the algorithm. The performance of the proposed scheme is compared with the crude Monte Carlo simulation numerically.

Deep Learning-Based Inverse Design for Engineering Systems: A Study on Supervised and Unsupervised Learning Models

  • Seong-Sin Kim
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.16 no.2
    • /
    • pp.127-135
    • /
    • 2024
  • Recent studies have shown that inverse design using deep learning has the potential to rapidly generate the optimal design that satisfies the target performance without the need for iterative optimization processes. Unlike traditional methods, deep learning allows the network to rapidly generate a large number of solution candidates for the same objective after a single training, and enables the generation of diverse designs tailored to the objectives of inverse design. These inverse design techniques are expected to significantly enhance the efficiency and innovation of design processes in various fields such as aerospace, biology, medical, and engineering. We analyzes inverse design models that are mainly utilized in the nano and chemical fields, and proposes inverse design models based on supervised and unsupervised learning that can be applied to the engineering system. It is expected to present the possibility of effectively applying inverse design methodologies to the design optimization problem in the field of engineering according to each specific objective.

A comparative study of low-complexity MMSE signal detection for massive MIMO systems

  • Zhao, Shufeng;Shen, Bin;Hua, Quan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.4
    • /
    • pp.1504-1526
    • /
    • 2018
  • For uplink multi-user massive MIMO systems, conventional minimum mean square error (MMSE) linear detection method achieves near-optimal performance when the number of antennas at base station is much larger than that of the single-antenna users. However, MMSE detection involves complicated matrix inversion, thus making it cumbersome to be implemented cost-effectively and rapidly. In this paper, we first summarize in detail the state-of-the-art simplified MMSE detection algorithms that circumvent the complicated matrix inversion and hence reduce the computation complexity from ${\mathcal{O}}(K^3)$ to ${\mathcal{O}}(K^2)$ or ${\mathcal{O}}(NK)$ with some certain performance sacrifice. Meanwhile, we divide the simplified algorithms into two categories, namely the matrix inversion approximation and the classical iterative linear equation solving methods, and make comparisons between them in terms of detection performance and computation complexity. In order to further optimize the detection performance of the existing detection algorithms, we propose more proper solutions to set the initial values and relaxation parameters, and present a new way of reconstructing the exact effective noise variance to accelerate the convergence speed. Analysis and simulation results verify that with the help of proper initial values and parameters, the simplified matrix inversion based detection algorithms can achieve detection performance quite close to that of the ideal matrix inversion based MMSE algorithm with only a small number of series expansions or iterations.

Image reconstruction in electrical capacitance tomography based on modified generalized Landweber method (수정된 generalized Landweber 방법을 이용한 ECT 영상 복원)

  • Lee Seong-Hun;Jang Jae-Duck;Kim Yong-Sung;Kim Kyung-Youn;Choi Bong-Yeol
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.43 no.5 s.311
    • /
    • pp.68-79
    • /
    • 2006
  • Electrical capacitance tomography (ECT) is a non-invasive imaging reconstruction technique that aims at visualization of cross sectional permittivity distribution of dielectric object based on the measured capacitance. There are lots of iterative image reconstruction methods to accelerate convergence rate and enhance quality of reconstructed image, Among them iterative Landweber method is one of the widely used reconstruction algorithm in En. In this paper, modified generalized Landweber method is proposed to accelerate convergence rate. In doing so, acceleration term is considered to the generalized Landweber method with shaping matrix and an optimal step length is determined analytically. Extensive computer simulations are provided to illustrate the reconstruction performance of the proposed algorithm.

Design of Optimal FIR Filters for Data Transmission (데이터 전송을 위한 최적 FIR 필터 설계)

  • 이상욱;이용환
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.18 no.8
    • /
    • pp.1226-1237
    • /
    • 1993
  • For data transmission over strictly band-limited non-ideal channels, different types of filters with arbitrary responses are needed. In this paper. we proposed two efficient techniques for the design of such FIR filters whose response is specified in either the time or the frequency domain. In particular when a fractionally-spaced structure is used for the transceiver, these filters can be efficiently designed by making use of characteristics of oversampling. By using a minimum mean-squared error criterion, we design a fractionally-spaced FIR filter whose frequency response can be controlled without affecting the output error. With proper specification of the shape of the additive noise signals, for example, the design results in a receiver filter that can perform compromise equalization as well as phase splitting filtering for QAM demodulation. The second method ad-dresses the design of an FIR filter whose desired response can be arbitrarily specified in the frequency domain. For optimum design, we use an iterative optimization technique based on a weighted least mean square algorithm. A new adaptation algorithm for updating the weighting function is proposed for fast and stable convergence. It is shown that these two independent methods can be efficiently combined together for more complex applications.

  • PDF

Optimal Design of Reinforced Concrete Frames using Sensitivity Analysis (설계민감도를 이용한 철근콘크리트 뼈대구조의 최적화)

  • Byun, Keun Joo;Choi, Hong Shik
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.9 no.1
    • /
    • pp.33-40
    • /
    • 1989
  • In the design of reinforced concrete framed structures, which consist of various design variables, the objective and the constraint functions are formulated in complicated forms. Usually iterative methods have been used to optimize the design variables. In this paper, multilevel formulation is adopted, and design variables are selected in reduced numbers at each level, to reduce the iterative cycle and to accelerate the convergence rate. At level 1, elastic analysis is performed to get the upper and lower bounds of the redistributed design moments due to inelastic behavior of the frame. Then the design moments are taken as design variables and optimized at level 2, and the sizing variables are optimized at level 3. The optimization of redistributed moments is performed using the design sensitivity obtained at the level 2, and force approximation technique is used to reflect the variation of design variables in the lower level to the upper level. The design variables are selected in reduced numbers at each level, and the optimization formulation is simplified effectively. A cost function is taken as the objective function, and the constraints of the stress of the structures are derived from BSI CP 110 following limit state theory. Numerical examples are included to prove the effectiveness of the developed algorithm.

  • PDF

Optimum Design Based on Sequential Design of Experiments and Artificial Neural Network for Enhancing Occupant Head Protection in B-Pillar Trim (센터 필라트림의 FMH 충격성능 향상을 위한 순차적 실험계획법과 인공신경망 기반의 최적설계)

  • Lee, Jung Hwan;Suh, Myung Won
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.37 no.11
    • /
    • pp.1397-1405
    • /
    • 2013
  • The optimal rib pattern design of B-pillar trim considering occupant head protection can be determined by two methods. One is the conventional approximate optimization method that uses the statistical design of experiments (DOE) and response surface method (RSM). Generally, approximated optimum results are obtained through the iterative process by trial-and-error. The quality of results strongly depends on the factors and levels assigned by a designer. The other is a methodology derived from previous work by the authors, called the sequential design of experiments (SDOE), to reduce the trial-and-error procedure and to find an appropriate condition for using artificial neural network (ANN) systematically. An appropriate condition is determined from the iterative process based on the analysis of means. With this new technique and ANN, it is possible to find an optimum design accurately and efficiently.

Geolocation Spectrum Database Assisted Optimal Power Allocation: Device-to-Device Communications in TV White Space

  • Xue, Zhen;Shen, Liang;Ding, Guoru;Wu, Qihui
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.9 no.12
    • /
    • pp.4835-4855
    • /
    • 2015
  • TV white space (TVWS) is showing promise to become the first widespread practical application of cognitive technology. In fact, regulators worldwide are beginning to allow access to the TV band for secondary users, on the provision that they access the geolocation database. Device-to-device (D2D) can improve the spectrum efficiency, but large-scale D2D communications that underlie TVWS may generate undesirable interference to TV receivers and cause severe mutual interference. In this paper, we use an established geolocation database to investigate the power allocation problem, in order to maximize the total sum throughput of D2D links in TVWS while guaranteeing the quality-of-service (QoS) requirement for both D2D links and TV receivers. Firstly, we formulate an optimization problem based on the system model, which is nonconvex and intractable. Secondly, we use an effective approach to convert the original problem into a series of convex problems and we solve these problems using interior point methods that have polynomial computational complexity. Additionally, we propose an iterative algorithm based on the barrier method to locate the optimal solution. Simulation results show that the proposed algorithm has strong performance with high approximation accuracy for both small and large dimensional problems, and it is superior to both the active set algorithm and genetic algorithm.

Impact of Model-Based Iterative Reconstruction on the Correlation between Computed Tomography Quantification of a Low Lung Attenuation Area and Airway Measurements and Pulmonary Function Test Results in Normal Subjects

  • Kim, Da Jung;Kim, Cherry;Shin, Chol;Lee, Seung Ku;Ko, Chang Sub;Lee, Ki Yeol
    • Korean Journal of Radiology
    • /
    • v.19 no.6
    • /
    • pp.1187-1195
    • /
    • 2018
  • Objective: To compare correlations between pulmonary function test (PFT) results and different reconstruction algorithms and to suggest the optimal reconstruction protocol for computed tomography (CT) quantification of low lung attenuation areas and airways in healthy individuals. Materials and Methods: A total of 259 subjects with normal PFT and chest CT results were included. CT scans were reconstructed using filtered back projection, hybrid-iterative reconstruction, and model-based IR (MIR). For quantitative analysis, the emphysema index (EI) and wall area percentage (WA%) were determined. Subgroup analysis according to smoking history was also performed. Results: The EIs of all the reconstruction algorithms correlated significantly with the forced expiratory volume in one second (FEV1)/forced vital capacity (FVC) (all p < 0.001). The EI of MIR showed the strongest correlation with FEV1/FVC (r = -0.437). WA% showed a significant correlation with FEV1 in all the reconstruction algorithms (all p < 0.05) correlated significantly with FEV1/FVC for MIR only (p < 0.001). The WA% of MIR showed the strongest correlations with FEV1 (r = -0.205) and FEV1/FVC (r = -0.250). In subgroup analysis, the EI of MIR had the strongest correlation with PFT in both eversmoker and never-smoker subgroups, although there was no significant difference in the EI between the reconstruction algorithms. WA% of MIR showed a significantly thinner airway thickness than the other algorithms ($49.7{\pm}7.6$ in ever-smokers and $49.5{\pm}7.5$ in never-smokers, all p < 0.001), and also showed the strongest correlation with PFT in both ever-smoker and never-smoker subgroups. Conclusion: CT quantification of low lung attenuation areas and airways by means of MIR showed the strongest correlation with PFT results among the algorithms used, in normal subjects.

Cycle-Consistent Generative Adversarial Network: Effect on Radiation Dose Reduction and Image Quality Improvement in Ultralow-Dose CT for Evaluation of Pulmonary Tuberculosis

  • Chenggong Yan;Jie Lin;Haixia Li;Jun Xu;Tianjing Zhang;Hao Chen;Henry C. Woodruff;Guangyao Wu;Siqi Zhang;Yikai Xu;Philippe Lambin
    • Korean Journal of Radiology
    • /
    • v.22 no.6
    • /
    • pp.983-993
    • /
    • 2021
  • Objective: To investigate the image quality of ultralow-dose CT (ULDCT) of the chest reconstructed using a cycle-consistent generative adversarial network (CycleGAN)-based deep learning method in the evaluation of pulmonary tuberculosis. Materials and Methods: Between June 2019 and November 2019, 103 patients (mean age, 40.8 ± 13.6 years; 61 men and 42 women) with pulmonary tuberculosis were prospectively enrolled to undergo standard-dose CT (120 kVp with automated exposure control), followed immediately by ULDCT (80 kVp and 10 mAs). The images of the two successive scans were used to train the CycleGAN framework for image-to-image translation. The denoising efficacy of the CycleGAN algorithm was compared with that of hybrid and model-based iterative reconstruction. Repeated-measures analysis of variance and Wilcoxon signed-rank test were performed to compare the objective measurements and the subjective image quality scores, respectively. Results: With the optimized CycleGAN denoising model, using the ULDCT images as input, the peak signal-to-noise ratio and structural similarity index improved by 2.0 dB and 0.21, respectively. The CycleGAN-generated denoised ULDCT images typically provided satisfactory image quality for optimal visibility of anatomic structures and pathological findings, with a lower level of image noise (mean ± standard deviation [SD], 19.5 ± 3.0 Hounsfield unit [HU]) than that of the hybrid (66.3 ± 10.5 HU, p < 0.001) and a similar noise level to model-based iterative reconstruction (19.6 ± 2.6 HU, p > 0.908). The CycleGAN-generated images showed the highest contrast-to-noise ratios for the pulmonary lesions, followed by the model-based and hybrid iterative reconstruction. The mean effective radiation dose of ULDCT was 0.12 mSv with a mean 93.9% reduction compared to standard-dose CT. Conclusion: The optimized CycleGAN technique may allow the synthesis of diagnostically acceptable images from ULDCT of the chest for the evaluation of pulmonary tuberculosis.