• Title/Summary/Keyword: Variational Technology

Search Result 205, Processing Time 0.043 seconds

Non-Simultaneous Sampling Deactivation during the Parameter Approximation of a Topic Model

  • Jeong, Young-Seob;Jin, Sou-Young;Choi, Ho-Jin
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.7 no.1
    • /
    • pp.81-98
    • /
    • 2013
  • Since Probabilistic Latent Semantic Analysis (PLSA) and Latent Dirichlet Allocation (LDA) were introduced, many revised or extended topic models have appeared. Due to the intractable likelihood of these models, training any topic model requires to use some approximation algorithm such as variational approximation, Laplace approximation, or Markov chain Monte Carlo (MCMC). Although these approximation algorithms perform well, training a topic model is still computationally expensive given the large amount of data it requires. In this paper, we propose a new method, called non-simultaneous sampling deactivation, for efficient approximation of parameters in a topic model. While each random variable is normally sampled or obtained by a single predefined burn-in period in the traditional approximation algorithms, our new method is based on the observation that the random variable nodes in one topic model have all different periods of convergence. During the iterative approximation process, the proposed method allows each random variable node to be terminated or deactivated when it is converged. Therefore, compared to the traditional approximation ways in which usually every node is deactivated concurrently, the proposed method achieves the inference efficiency in terms of time and memory. We do not propose a new approximation algorithm, but a new process applicable to the existing approximation algorithms. Through experiments, we show the time and memory efficiency of the method, and discuss about the tradeoff between the efficiency of the approximation process and the parameter consistency.

Combined multi-predict-correct iterative method for interaction between pulsatile flow and large deformation structure

  • Wang, Wenquan;Zhang, Li-Xiang;Yan, Yan;Guo, Yakun
    • Coupled systems mechanics
    • /
    • v.1 no.4
    • /
    • pp.361-379
    • /
    • 2012
  • This paper presents a fully coupled three-dimensional solver for the analysis of interaction between pulsatile flow and large deformation structure. A partitioned time marching algorithm is employed for the solution of the time dependent coupled discretised problem, enabling the use of highly developed, robust and well-tested solvers for each field. Conservative transfer of information at the fluid-structure interface is combined with an effective multi-predict-correct iterative scheme to enable implicit coupling of the interacting fields at each time increment. The three-dimensional unsteady incompressible fluid is solved using a powerful implicit time stepping technique and an ALE formulation for moving boundaries with second-order time accurate is used. A full spectrum of total variational diminishing (TVD) schemes in unstructured grids is allowed implementation for the advection terms and finite element shape functions are used to evaluate the solution and its variation within mesh elements. A finite element dynamic analysis of the highly deformable structure is carried out with a numerical strategy combining the implicit Newmark time integration algorithm with a Newton-Raphson second-order optimisation method. The proposed model is used to predict the wave flow fields of a particular flow-induced vibrational phenomenon, and comparison of the numerical results with available experimental data validates the methodology and assesses its accuracy. Another test case about three-dimensional biomedical model with pulsatile inflow is presented to benchmark the algorithm and to demonstrate the potential applications of this method.

High-revenue Online Provisioning for Virtual Clusters in Multi-tenant Cloud Data Center Network

  • Lu, Shuaibing;Fang, Zhiyi;Wu, Jie
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.3
    • /
    • pp.1164-1183
    • /
    • 2019
  • The rapid development of cloud computing and high requirements of operators requires strong support from the underlying Data Center Networks. Therefore, the effectiveness of using resources in the data center networks becomes a point of concern for operators and material for research. In this paper, we discuss the online virtual-cluster provision problem for multiple tenants with an aim to decide when and where the virtual cluster should be placed in a data center network. Our objective is maximizing the total revenue for the data center networks under the constraints. In order to solve this problem, this paper divides it into two parts: online multi-tenancy scheduling and virtual cluster placement. The first part aims to determine the scheduling orders for the multiple tenants, and the second part aims to determine the locations of virtual machines. We first approach the problem by using the variational inequality model and discuss the existence of the optimal solution. After that, we prove that provisioning virtual clusters for a multi-tenant data center network that maximizes revenue is NP-hard. Due to the complexity of this problem, an efficient heuristic algorithm OMS (Online Multi-tenancy Scheduling) is proposed to solve the online multi-tenancy scheduling problem. We further explore the virtual cluster placement problem based on the OMS and propose a novel algorithm during the virtual machine placement. We evaluate our algorithms through a series of simulations, and the simulations results demonstrate that OMS can significantly increase the efficiency and total revenue for the data centers.

Effect of Bifurcation Angle on Blood Flow in Flexible Carotid Artery (유연한 경동맥 분지관에서 분지각이 혈액의 유동에 미치는 영향에 관한 연구)

  • Lee, Sang Hoon;Choi, Hyoung Gwon;Yoo, Jung Yul
    • Transactions of the Korean Society of Mechanical Engineers B
    • /
    • v.37 no.3
    • /
    • pp.229-235
    • /
    • 2013
  • To investigate the effect of the flexible artery wall on the blood flow, three-dimensional numerical simulations were carried out for analyzing the time-dependent incompressible flows of Newtonian fluids constrained by a flexible wall. The Navier-Stokes equations for fluid flow were solved using the P2P1 Galerkin finite element method, and mesh movement was achieved using an arbitrary Lagrangian-Eulerian formulation. The Newmark method was employed for solving the dynamic equilibrium equations for the deformation of a linear elastic solid. To avoid complexity due to the necessity of additional mechanical constraints, we used a combined formulation that includes both the fluid and structure equations of motion to produce a single coupled variational equation. The results showed that the flexibility of the carotid wall significantly affects flow phenomena during the pulse cycle. The flow field was also found to be strongly influenced by the bifurcation angle.

Comparison of Data Assimilation Methods in a Regional Ocean Circulation Model for the Yellow and East China Seas (자료동화 기법에 따른 황·동중국해 지역 해양순환모델 결과 비교)

  • Lee, Joon-Ho;Moon, Jae-Hong;Choi, Youngjin
    • Ocean and Polar Research
    • /
    • v.42 no.3
    • /
    • pp.179-194
    • /
    • 2020
  • The present study aims to evaluate the effects of satellite-based SST (OSTIA) assimilation on a regional ocean circulation model for the Yellow and East China Seas (YECS), using three different assimilation methods: the Ensemble Optimal Interpolation (EnOI), Ensemble Kalman Filter (EnKF), and 4-Dimensional Variational (4DVAR) techniques, which are widely used in the ocean modeling communities. The model experiments show that an improved initial condition by assimilating the SST affects the seasonal water temperature and water mass distributions of the YECS. In particular, the SST data assimilation influences the temperature structures horizontally and vertically in winter, thereby improving the behavior of the YS warm current water. This is due to the fact that during wintertime the water column is well mixed, which is directly updated by the SST assimilation. The model comparisons indicate that the SST assimilation can improve the model performance in resolving the subsurface structures in wintertime, but has a relatively small impact in summertime due to the strong stratification. The differences among the different assimilation experiments are obvious when the SST was sharply changed due to a typhoon passage. Overall, the EnKF and 4DVAR show better agreement with the observations than the EnOI. The relatively low performance of EnOI under storm conditions may be related with a limitation of EnOI method whereby an analysis is obtained from a number of climatological fields, and thus the typhoon-induced SST changes in short-time scales may not be adequately reflected in the data assimilation.

Seasonal and Interannual Variability of the North Korean Cold Current in the East Sea Reanalysis Data (동해 재분석 자료에 나타난 북한한류의 계절 및 경년변동성)

  • Kim, Young-Ho;Min, Hong-Sik
    • Ocean and Polar Research
    • /
    • v.30 no.1
    • /
    • pp.21-31
    • /
    • 2008
  • Analyzing the results of East Sea Regional Ocean Model using a 3-dimensional variational data assimilation scheme, we investigated spatial and temporal variability of the North Korean Cold Current (NKCC) in the East Sea. The climatological monthly mean transport of the NKCC clearly shows seasonal variation of the NKCC within the range of about 0.35 Sv ($=0^6m^3/s$), which increases from its minimum (about 0.45 Sv) through December-January to March, decreases during March and May, and then increases again to the maximum (about 0.8 Sv) in August-September. The volume transport of the NKCC shows interannual variation of the NKCC with the range of about 1.0 Sv that is larger than seasonal variation. The southward current of the NKCC appears often not only in summer but in winter as well. The width of the NKCC is about 35 km near the Korean coast and its core is located under the East Korea Warm Current. The North Korean Cold Water (NKCW), characterized by low salinity and low temperature, is located both under the Tsushima Warm Water and in the western side of the maximum southward current of the NKCC that means the NKCC advects the NKCW southward along the Korean coast. It is revealed that the intermediate low salinity water, formed off the Vladivostok in winter, flows southward to the south of $37^{\circ}N$ through $2{\sim}3$ paths; one path along the Korean coast, another one along $132^{\circ}E$, and the middle path along $130^{\circ}E$. The path of the intermediate low salinity varies with years. The reanalysis fields suggest that the NKCW is advected through the paths along the Korean coast and along $130^{\circ}E$.

Development of An Integrated Optimal Design Program for Design of A High-Efficiency Low-Noise Regenerative Fan (재생형 송풍기의 고효율 저소음 설계를 위한 통합형 최적설계 프로그램 개발)

  • Heo, Man-Woong;Kim, Jin-Hyuk;Seo, Tae-Wan;Koo, Gyoung-Wan;Lee, Chung-Suk;Kim, Kwang-Young
    • The KSFM Journal of Fluid Machinery
    • /
    • v.17 no.1
    • /
    • pp.35-40
    • /
    • 2014
  • A multi-objective optimization of a regenerative fan for enhancing the aerodynamic and aeroacoustic performance was carried out using an integrated fan design system, namely, Total FAN-Regen$^{(R)}$. The Total FAN-Regen$^{(R)}$ was developed for non-specialists to carry out a series of design process, viz., computational preliminary design, three-dimensional aerodynamic and aeroacoustic analyses, and design optimization, for a regenerative fan. An aerodynamic analysis of the regenerative fan was conducted by solving three-dimensional Reynolds-averaged Navier-Stokes equations using the shear stress transport turbulence model. And, an aeroacoustic analysis of the regenerative fan was implemented in a finite/infinite element method by solving the variational formulation of Lighthill's analogy based on the results of the unsteady flow analysis. An optimum shape obtained by Total FAN-Regen$^{(R)}$ shows the enhanced efficiency and decreased sound pressure level as much as 1.5 % and 20.0 dB, respectively, compared to those of the reference design. The performance test was carried out for an optimized regenerative fan to validate the performance of the numerically predicted optimal design.

Hydrodynamic scene separation from video imagery of ocean wave using autoencoder (오토인코더를 이용한 파랑 비디오 영상에서의 수리동역학적 장면 분리 연구)

  • Kim, Taekyung;Kim, Jaeil;Kim, Jinah
    • Journal of the Korea Computer Graphics Society
    • /
    • v.25 no.4
    • /
    • pp.9-16
    • /
    • 2019
  • In this paper, we propose a hydrodynamic scene separation method for wave propagation from video imagery using autoencoder. In the coastal area, image analysis methods such as particle tracking and optical flow with video imagery are usually applied to measure ocean waves owing to some difficulties of direct wave observation using sensors. However, external factors such as ambient light and weather conditions considerably hamper accurate wave analysis in coastal video imagery. The proposed method extracts hydrodynamic scenes by separating only the wave motions through minimizing the effect of ambient light during wave propagation. We have visually confirmed that the separation of hydrodynamic scenes is reasonably well extracted from the ambient light and backgrounds in the two videos datasets acquired from real beach and wave flume experiments. In addition, the latent representation of the original video imagery obtained through the latent representation learning by the variational autoencoder was dominantly determined by ambient light and backgrounds, while the hydrodynamic scenes of wave propagation independently expressed well regardless of the external factors.

Stochastic fracture behavior analysis of infinite plates with a separate crack and a hole under tensile loading

  • Khubi Lal Khatri;Kanif Markad
    • Computers and Concrete
    • /
    • v.32 no.1
    • /
    • pp.99-117
    • /
    • 2023
  • The crack under the influence of the higher intensities of the stresses grows and the structure gets collapsed with the time when the crack length reaches to critical value. Therefore, the fracture behavior of a structure in terms of stress intensity factors (SIF) becomes important to determine the remaining fracture strength and capacity of material and structure for avoiding catastrophic failure, increasing safety and further improvement in the design. The robustness of the method has been demonstrated by comparing the numerical results with analytical and experimental results of some problems. XFEM is used to model cracks and holes in structures and predict their strength and reliability under service conditions. Further, XFEM is extended with a stochastic method for predicting the sensitivity in terms of output COVs and fracture strength in terms of mean values of stress intensity factors (SIFs) of a structure with discontinuities (cracks and holes) under tensile loading condition with input individual and combined randomness in different system parameters. In stochastic technique, the second order perturbation technique (SOPT) has been used for the predicting the fracture behavior of the structures. The stochastic/perturbation technique is also known as Taylor series expansion method and it provides the reliable results if the input randomness is less than twenty percentage. From the present numerical analysis it is observed that, the crack tip near to the hole is under the influence of the stress concentration and the variational effect of the input random parameters on the crack tip in terms of the SIFs are lesser so the COVs are the less sensitive. The COVs of mixed mode SIFs are the most sensitive for the crack angles (α=45° to 90°) for all the values of c1 and d1. The plate with the shorter distance between hole and crack is the most sensitive with all the crack angles but the crack tip which is much nearer to the hole has the highest sensitivity.

Development of Quantification Methods for the Myocardial Blood Flow Using Ensemble Independent Component Analysis for Dynamic $H_2^{15}O$ PET (동적 $H_2^{15}O$ PET에서 앙상블 독립성분분석법을 이용한 심근 혈류 정량화 방법 개발)

  • Lee, Byeong-Il;Lee, Jae-Sung;Lee, Dong-Soo;Kang, Won-Jun;Lee, Jong-Jin;Kim, Soo-Jin;Choi, Seung-Jin;Chung, June-Key;Lee, Myung-Chul
    • The Korean Journal of Nuclear Medicine
    • /
    • v.38 no.6
    • /
    • pp.486-491
    • /
    • 2004
  • Purpose: factor analysis and independent component analysis (ICA) has been used for handling dynamic image sequences. Theoretical advantages of a newly suggested ICA method, ensemble ICA, leaded us to consider applying this method to the analysis of dynamic myocardial $H_2^{15}O$ PET data. In this study, we quantified patients' blood flow using the ensemble ICA method. Materials and Methods: Twenty subjects underwent $H_2^{15}O$ PET scans using ECAT EXACT 47 scanner and myocardial perfusion SPECT using Vertex scanner. After transmission scanning, dynamic emission scans were initiated simultaneously with the injection of $555{\sim}740$ MBq $H_2^{15}O$. Hidden independent components can be extracted from the observed mixed data (PET image) by means of ICA algorithms. Ensemble learning is a variational Bayesian method that provides an analytical approximation to the parameter posterior using a tractable distribution. Variational approximation forms a lower bound on the ensemble likelihood and the maximization of the lower bound is achieved through minimizing the Kullback-Leibler divergence between the true posterior and the variational posterior. In this study, posterior pdf was approximated by a rectified Gaussian distribution to incorporate non-negativity constraint, which is suitable to dynamic images in nuclear medicine. Blood flow was measured in 9 regions - apex, four areas in mid wall, and four areas in base wall. Myocardial perfusion SPECT score and angiography results were compared with the regional blood flow. Results: Major cardiac components were separated successfully by the ensemble ICA method and blood flow could be estimated in 15 among 20 patients. Mean myocardial blood flow was $1.2{\pm}0.40$ ml/min/g in rest, $1.85{\pm}1.12$ ml/min/g in stress state. Blood flow values obtained by an operator in two different occasion were highly correlated (r=0.99). In myocardium component image, the image contrast between left ventricle and myocardium was 1:2.7 in average. Perfusion reserve was significantly different between the regions with and without stenosis detected by the coronary angiography (P<0.01). In 66 segment with stenosis confirmed by angiography, the segments with reversible perfusion decrease in perfusion SPECT showed lower perfusion reserve values in $H_2^{15}O$ PET. Conclusions: Myocardial blood flow could be estimated using an ICA method with ensemble learning. We suggest that the ensemble ICA incorporating non-negative constraint is a feasible method to handle dynamic image sequence obtained by the nuclear medicine techniques.