• 반도체공학회 논문지
• /
• 제1권1호
• /
• pp.23-30
• /
• 2023

최근 거대 IT 기업들의 Generative AI 기술 개발로 Transformer 모델의 규모가 조 단위를 넘어가며 기하급수적으로 증가하고 있다. 이러한 AI 서비스를 지속적으로 가능케 하기 위해선 모델 경량화가 필수적이다. 본 논문에서는 하드웨어 친화적으로 구조화된(structured) 프루닝 패턴을 찾아 Transformer 모델의 경량화 방법을 제안한다. 이는 모델 알고리즘의 특성을 살려 압축을 진행하기 때문에 모델의 크기는 줄어들면서 성능은 최대한 유지할 수 있다. 실험에 따르면 GPT2 와 BERT 언어 모델을 프루닝할 때 제안하는 구조화된 프루닝 기법은 희소성이 높은 영역에서도 미세 조정된(fine-grained) 프루닝과 거의 흡사한 성능을 보여준다. 이 접근 방식은 미세 조정된 프루닝 대비 0.003%의 정확도 손실로 모델매개 변수를 80% 줄이고 구조화된 형태로 하드웨어 가속화를 진행할 수 있다.

• International Journal of Control, Automation, and Systems
• /
• 제1권3호
• /
• pp.271-281
• /
• 2003

In this paper, a new nonlinear programming approach is suggested to solve biaffine matrix inequality (BMI) problems in multiobjective and structured controls. It is shown that these BMI problems are reduced to nonlinear minimization problems. An algorithm that is easily implemented with existing convex optimization codes is presented for the nonlinear minimization problem. The efficiency of the proposed algorithm is illustrated by numerical examples.

• 로봇학회논문지
• /
• 제4권2호
• /
• pp.147-154
• /
• 2009

Visions of ubiquitous robotics and ambient intelligence involve distributing information, knowledge, computation over a wide range of servers and data storage devices located all over the world, and integrating tiny microprocessors, actuators, and sensors into everyday objects as well in order to make them smart. In this paper, we introduce our ongoing research effort aimed at realizing ubiquitous robots in an information structured space. For this, a ubiquitous space and ambient intelligent systems for a librarian robot are introduced and the RFID technology based approach for these systems is described.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2000년도 추계종합학술대회 논문집(4)
• /
• pp.235-238
• /
• 2000

This paper describes the implementation of document image restoration system for the geometric distortion using structured light. To get accurate document images, the bounded book must be flattened by pushing down the book with a class plate. However, most of ancient documents are too fragile to be pushed. The proposed system restores the distorted character image due to geometric distortion.

• 한국신재생에너지학회:학술대회논문집
• /
• 한국신재생에너지학회 2007년도 춘계학술대회
• /
• pp.33-36
• /
• 2007

Currently, many structured catalysts using microchannel are researched to apply to fuel reforming. In this paper, ceramic monolith and metal mesh as structured catalysts are investigated for catalytic autothermal reforming. When GHSV increases, each structured catalyst has better performances(hydrogen production, fuel conversion) than packed bed catalyst for autothermal reforming. The major causes seem to be the elevated heat and mass transfer, gas phase reaction and redistribution of packed bed due to high pressure drop.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 1995년도 Proceedings of the Korea Automation Control Conference, 10th (KACC); Seoul, Korea; 23-25 Oct. 1995
• /
• pp.420-423
• /
• 1995

The stability of system is one of the important aspects and to judge system's stability is another complicated problem. Previously, new technique derived from relaxing Lyapunov conditions has been already introduced and in this paper, this proposed technique applies to the practical dynamic systems. This utility of numerical procedures prove the comparable improvements of the estimation of robustness for dynamic systems having structured (bounded) perturbations.

• 제어로봇시스템학회논문지
• /
• 제21권3호
• /
• pp.233-236
• /
• 2015

In this paper, a nonlinear optimization problem is proposed to obtain a structured static output feedback controller for discrete time linear systems. The proposed optimization problem has LMI (Linear Matrix Inequality) constraints and a non-convex objective function. Using the conditional gradient method, we can obtain suboptimal solutions of the proposed optimization problem. Numerical examples show the effectives of the proposed approach.

• Journal of applied mathematics & informatics
• /
• 제18권1_2호
• /
• pp.621-637
• /
• 2005

A hybrid method solving regularized structured linear total least norm (RSTLN) problems, which have highly ill-conditioned coefficient matrix with special structures, is suggested and analyzed. This scheme combining RSTLN algorithm and separation by parts guarantees the convergence of parameters and has an advantages in reducing the residual norm and relative error of solutions. Computational tests for problems arisen in signal processing and image formation process confirm that the presenting method is effective for more accurate solutions to (R)STLN problem than the (R)STLN algorithm.

• 한국정보과학회:학술대회논문집
• /
• 한국정보과학회 2001년도 봄 학술발표논문집 Vol.28 No.1 (B)
• /
• pp.487-489
• /
• 2001

제본된 책이나 고문서를 디자타이즈할 때 책을 바르게 펴지 못하거나 지정된 위치나 방위로 위치시키지 못해서 문제가 발생한다. 특히 힘을 가할 수 없는 고문서의 경우에는 바르게 펼수가 없기 때문에 깊이 차이에 의한 문서의 왜곡이 발생한다. 본 연구에서는 Structured Light을 이용하여 깊이 차에 의한 문자의 왜곡을 복원하는 방안을 제안한다. 또한 입력시 책의 위치와 방위에 대한 제한을 완화시킬 수 있도록 책의 위치와 방위 변화에 적을 알 수 있는 방안을 제안한다,

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2000년도 제15차 학술회의논문집
• /
• pp.270-270
• /
• 2000

Input delay is frequently encountered in the practical systems since measurement delay and computational delay can be represented by input delay. In this viewpoint, this paper deals with the robust control problem of input delayed systems with structured uncertainty. Robust stability conditions are provided in terms of linear matrix inequalities(LMIs) and it is shown that the proposed conditions can give less conservative maximum bound of input delay guaranteeing robust stability.