• 제목/요약/키워드: variational approximation

검색결과 88건 처리시간 0.025초

Non-Simultaneous Sampling Deactivation during the Parameter Approximation of a Topic Model

  • Jeong, Young-Seob;Jin, Sou-Young;Choi, Ho-Jin
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제7권1호
    • /
    • pp.81-98
    • /
    • 2013
  • Since Probabilistic Latent Semantic Analysis (PLSA) and Latent Dirichlet Allocation (LDA) were introduced, many revised or extended topic models have appeared. Due to the intractable likelihood of these models, training any topic model requires to use some approximation algorithm such as variational approximation, Laplace approximation, or Markov chain Monte Carlo (MCMC). Although these approximation algorithms perform well, training a topic model is still computationally expensive given the large amount of data it requires. In this paper, we propose a new method, called non-simultaneous sampling deactivation, for efficient approximation of parameters in a topic model. While each random variable is normally sampled or obtained by a single predefined burn-in period in the traditional approximation algorithms, our new method is based on the observation that the random variable nodes in one topic model have all different periods of convergence. During the iterative approximation process, the proposed method allows each random variable node to be terminated or deactivated when it is converged. Therefore, compared to the traditional approximation ways in which usually every node is deactivated concurrently, the proposed method achieves the inference efficiency in terms of time and memory. We do not propose a new approximation algorithm, but a new process applicable to the existing approximation algorithms. Through experiments, we show the time and memory efficiency of the method, and discuss about the tradeoff between the efficiency of the approximation process and the parameter consistency.

A NOTE ON A FINITE ELEMENT METHOD DEALING WITH CORNER SINGULARITIES

  • Kim, Seok-Chan;Woo, Gyung-Soo;Park, Tae-Hoon
    • Journal of applied mathematics & informatics
    • /
    • 제7권2호
    • /
    • pp.493-506
    • /
    • 2000
  • Recently the first author and his coworker report a new finite element method for the Poisson equations with homogeneous Dirichlet boundary conditions on a polygonal domain with one re-entrant angle [7], They use the well-known fact that the solution of such problem has a singular representation, deduced a well-posed new variational problem for a regular part of solution and an extraction formula for the so-called stress intensity factor using tow cut-off functions. They use Fredholm alternative an Garding's inequality to establish the well-posedness of the variational problem and finite element approximation, so there is a maximum bound for mesh h theoretically. although the numerical experiments shows the convergence for every reasonable h with reasonable size y imposing a restriction to the support of the extra cut-off function without using Garding's inequality. We also give error analysis with similar results.

SUPERCONVERGENCE AND A POSTERIORI ERROR ESTIMATES OF VARIATIONAL DISCRETIZATION FOR ELLIPTIC CONTROL PROBLEMS

  • Hua, Yuchun;Tang, Yuelong
    • Journal of applied mathematics & informatics
    • /
    • 제32권5_6호
    • /
    • pp.707-719
    • /
    • 2014
  • In this paper, we investigate a variational discretization approximation of elliptic optimal control problems with control constraints. The state and the co-state are approximated by piecewise linear functions, while the control is not directly discretized. By using some proper intermediate variables, we derive a second-order convergence in $L^2$-norm and superconvergence between the numerical solution and elliptic projection of the exact solution in $H^1$-norm or the gradient of the exact solution and recovery gradient in $L^2$-norm. Then we construct a posteriori error estimates by using the superconvergence results and do some numerical experiments to confirm our theoretical results.

CONVERGENCE OF VISCOSITY APPROXIMATIONS TO FIXED POINTS OF NONEXPANSIVE NONSELF-MAPPINGS IN BANACH SPACES

  • Jung, Jong-Soo
    • East Asian mathematical journal
    • /
    • 제24권1호
    • /
    • pp.81-95
    • /
    • 2008
  • Let E be a uniformly convex Banach space with a uniformly $G{\hat{a}}teaux$ differentiable norm, C a nonempty closed convex subset of E, and $T\;:\;C\;{\rightarrow}\;E$ a nonexpansive mapping satisfying the weak inwardness condition. Assume that every weakly compact convex subset of E has the fixed point property. For $f\;:\;C\;{\rightarrow}\;C$ a contraction and $t\;{\in}\;(0,\;1)$, let $x_t$ be a unique fixed point of a contraction $T_t\;:\;C\;{\rightarrow}\;E$, defined by $T_tx\;=\;tf(x)\;+\;(1\;-\;t)Tx$, $x\;{\in}\;C$. It is proved that if {$x_t$} is bounded, then $x_t$ converges to a fixed point of T, which is the unique solution of certain variational inequality. Moreover, the strong convergence of other implicit and explicit iterative schemes involving the sunny nonexpansive retraction is also given in a reflexive and strictly convex Banach space with a uniformly $G{\hat{a}}teaux$ differentiable norm.

  • PDF

다공매체를 통과하는 유동문제의 유한요소해석과 부분해석후 오차계산 (Finite Element Analysis and Local a Posteriori Error Estimates for Problems of Flow through Porous Media)

  • 이춘열
    • 대한기계학회논문집A
    • /
    • 제21권5호
    • /
    • pp.850-858
    • /
    • 1997
  • A new a posteriori error estimator is introduced and applied to variational inequalities occurring in problems of flow through porous media. In order to construct element-wise a posteriori error estimates the global error is localized by a special mixed formulation in which continuity conditions at interfaces are treated as constraints. This approach leads to error indicators which provide rigorous upper bounds of the element errors. A discussion of a compatibility condition for the well-posedness of the local error analysis problem is given. Two numerical examples are solved to check the compatibility of the local problems and convergence of the effectivity index both in a local and a global sense with respect to local refinements.

Zeroth-Order Shear Deformation Micro-Mechanical Model for Periodic Heterogeneous Beam-like Structures

  • Lee, Chang-Yong
    • 동력기계공학회지
    • /
    • 제19권3호
    • /
    • pp.55-62
    • /
    • 2015
  • This paper discusses a new model for investigating the micro-mechanical behavior of beam-like structures composed of various elastic moduli and complex geometries varying through the cross-sectional directions and also periodically-repeated along the axial directions. The original three-dimensional problem is first formulated in an unified and compact intrinsic form using the concept of decomposition of the rotation tensor. Taking advantage of two smallness of the cross-sectional dimension-to-length parameter and the micro-to-macro heterogeneity and performing homogenization along dimensional reduction simultaneously, the variational asymptotic method is used to rigorously construct an effective zeroth-order beam model, which is similar a generalized Timoshenko one (the first-order shear deformation model) capable of capturing the transverse shear deformations, but still carries out the zeroth-order approximation which can maximize simplicity and promote efficiency. Two examples available in literature are used to demonstrate the consistence and efficiency of this new model, especially for the structures, in which the effects of transverse shear deformations are significant.

등방성 샌드위치 빔의 평면 변형을 위한 통합 이론 (Universal Theory for Planar Deformations of an Isotropic Sandwich Beam)

  • 이창용
    • 한국기계가공학회지
    • /
    • 제19권7호
    • /
    • pp.35-40
    • /
    • 2020
  • This work is concerned with various planar deformations of an isotropic sandwich beam, which generally consists of three layers: two stiff skin layers and one soft core layer. When one layer of the sandwich beam is modeled as a beam, the variational-asymptotic method is rigorously used to construct a zeroth-order beam model, which is similar to a generalized Timoshenko beam model capable of capturing the transverse shear deformations but still carries out the zeroth-order approximation. To analyze the planar sandwich beam, the sum of the energies of the two skin layers and one core layer is then formulated with different material and geometric properties and represented by a universal beam model in terms of the core-layer kinematics through interface displacement and stress continuity conditions. As a preliminary validation, two extreme examples are presented to demonstrate the capability and accuracy of this present approach.

하이브리드 트레프츠 평판 요소의 변분 수식화와 성능 평가 (Variational Formulation of Hybrid-Trefftz Plate Elements and Evaluation of Their Static Performance)

  • 추연석;이병채
    • 대한기계학회논문집A
    • /
    • 제27권2호
    • /
    • pp.302-309
    • /
    • 2003
  • Hybrid-Trefftz plate bending elements are known to be robust and free of shear locking in the thin limit because of Internal displacements fields and linked boundary displacements. Also, their finite element approximation is very simple regardless to boundary shape since all element matrices can be calculated using only boundary integrals. In this study, new hybrid-Trefftz variational formulation based on the total potential energy principle of internal displacements and displacement consistency conditions at the boundary is derived. And flat shell elements are derived by combining hybrid-Trefftz bending stiffness and plane stress stiffness with drilling dofs.

The construction of second generation wavelet-based multivariable finite elements for multiscale analysis of beam problems

  • Wang, Youming;Wu, Qing;Wang, Wenqing
    • Structural Engineering and Mechanics
    • /
    • 제50권5호
    • /
    • pp.679-695
    • /
    • 2014
  • A design method of second generation wavelet (SGW)-based multivariable finite elements is proposed for static and vibration beam analysis. An important property of SGWs is that they can be custom designed by selecting appropriate lifting coefficients depending on the application. The SGW-based multivariable finite element equations of static and vibration analysis of beam problems with two and three kinds of variables are derived based on the generalized variational principles. Compared to classical finite element method (FEM), the second generation wavelet-based multivariable finite element method (SGW-MFEM) combines the advantages of high approximation performance of the SGW method and independent solution of field functions of the MFEM. A multiscale algorithm for SGW-MFEM is presented to solve structural engineering problems. Numerical examples demonstrate the proposed method is a flexible and accurate method in static and vibration beam analysis.

APPROXIMATION OF ZEROS OF SUM OF MONOTONE MAPPINGS WITH APPLICATIONS TO VARIATIONAL INEQUALITY AND IMAGE RESTORATION PROBLEMS

  • Adamu, Abubakar;Deepho, Jitsupa;Ibrahim, Abdulkarim Hassan;Abubakar, Auwal Bala
    • Nonlinear Functional Analysis and Applications
    • /
    • 제26권2호
    • /
    • pp.411-432
    • /
    • 2021
  • In this paper, an inertial Halpern-type forward backward iterative algorithm for approximating solution of a monotone inclusion problem whose solution is also a fixed point of some nonlinear mapping is introduced and studied. Strong convergence theorem is established in a real Hilbert space. Furthermore, our theorem is applied to variational inequality problems, convex minimization problems and image restoration problems. Finally, numerical illustrations are presented to support the main theorem and its applications.