• Transactions on Semiconductor Engineering
• /
• v.1 no.1
• /
• pp.23-30
• /
• 2023

With the recent development of Generative AI technology by IT giants, the size of the transformer model is increasing exponentially over trillion won. In order to continuously enable these AI services, it is essential to reduce the weight of the model. In this paper, we find a hardware-friendly structured pruning pattern and propose a lightweight method of the transformer model. Since compression proceeds by utilizing the characteristics of the model algorithm, the size of the model can be reduced and performance can be maintained as much as possible. Experiments show that the structured pruning proposed when pruning GPT-2 and BERT language models shows almost similar performance to fine-grained pruning even in highly sparse regions. This approach reduces model parameters by 80% and allows hardware acceleration in structured form with 0.003% accuracy loss compared to fine-tuned pruning.

• Proceedings of the IEEK Conference
• /
• 2000.06c
• /
• pp.93-96
• /
• 2000

Currently, the most important technology is the compression methods in the multimedia society. Audio files are rapidly propagated through internet. MP-3 is offered to CD tone quality in 128Kbps, but 64Kbps below tone quality is abruptly down and high bitrate. on the other hand, MPEG-II AAC (Advanced Audio Coding) is not compatible with MPEG-I, but AAC has a high compression ratio 1.4 better than MP-3. Especially, AAC has max. 7.1 channel and 96KHz sampling rate. In this paper, the perceptual model is dealt with 44.1KHz sampling rate for SMR(Signal to Masking Ratio)

• Magazine of the Korean Society of Agricultural Engineers
• /
• v.41 no.2
• /
• pp.80-91
• /
• 1999

This paper presents the stress-strain , volumetric strain characteristics of the Pocheon weathered residual granite soil with variation of the initial water content under drained conditions. A series of consolidated drained triaxial compressiion tests and isotrpc compression tests with various initial water content on specimens were performed. All material parameters of Lade's double work hardening model were determined by using the results of tests. Most aspects of the soil behavior measured in the triaxial compression tests were reproduced with good accuracy by the constitutive model . Therefore double work hardening model has been shown to be applicable to weathered residual granite soil.

• Transactions of Materials Processing
• /
• v.10 no.7
• /
• pp.573-578
• /
• 2001

The flow stress of 304 stainless steel during hot forming process were determined by conducting hot compression tests at the range of 1273 K∼1423 K and 0.05 /s∼2.0 /s as these are typical temperature and strain rate in hot forging operation. In this material, Dynamic recrystallization was found to be the major softening mechanism with this conditions as Previous studies. Based on the observed phenomena, a constitutive model of flow stress was assumed as a function of strain, strain rate, temperature. In the constitutive model, the effects of strain hardening and dynamic recrystallization were taken into consideration. A finite element method connected to constitutive model was performed to predict the dynamic recrystallization behaviors and also stress-strain curves in hot compression of 304 stainless steel.

• Proceedings of the Computational Structural Engineering Institute Conference
• /
• 2006.04a
• /
• pp.104-107
• /
• 2006

Numerical analysis on laminated plates containing an open hole subjected to compression is conducted to predict the damage constitutive behaviour of the plates. A micromechanical constitutive model for unidirectional laminated composites proposed by Liang et a1. (2006), in conjunction with damage models (Karihaloo and Fu, 1989, 1999; Zhao and Weng, 1996, 1997), is implemented into the finite element code ABAQUS to conduct the numerical analysis. The predictions are compared with experiments (Lessard and Chang, 1991) to verify the accuracy of the present analysis.

• 제어로봇시스템학회:학술대회논문집
• /
• 2000.10a
• /
• pp.323-323
• /
• 2000

In the tandem cold wiling mill, the quality is very in portant, and requirements for thickness accuracy become more strict. However, the mathematical model for prediction of rolling force was not considered an elastic deformation at the entry and delivery side of the contacted area between the worked roll and rolling strip so that there was so difficult to control of the thickness. To overcome this problem, the mathematical model included an elastic deformation of strip has been developed and applied to the field in order to predict the rolling force. The simulated results showed that the end of elastic recovery should be included the model, even if the effect of elastic compression was not important.

• Magazine of the Korean Society of Agricultural Engineers
• /
• v.45 no.2
• /
• pp.86-95
• /
• 2003

During this study, constant stress ratio tests with previous compression anisotropic stress history are performed on compacted decomposed granite soil sampled at Iksan, Jeonbuk. Yielding points are determined from stress-strain curves. The shape and characteristics of compression anisotropic yield curves is examined. In addition, the measured value of yielding curve and stress-strain behavior is predicted by Yasufuku's anisotropic constitutive model based on non-associated flow rule. The main results are summarized as follows : 1) Shape of yielding curves shows almost ellipse but asymmetry with respect to stress path during previous consolidation stress. 2) Yasufuku's anisotropic constitutive model is suitable in evaluation of yielding curves on anisotropic consolidated decomposed granite soil. 3) The predicted stress-strain curve shows reasonable agreement to measured behaviours.

• Journal of the Korean Society for Railway
• /
• v.3 no.1
• /
• pp.34-41
• /
• 2000

The analysis of static and dynamic characteristics of reinforced roadbed materials was performed through model and laboratory tests. The strength characteristic of reinforced roadbed materials such as HMS-25 and soil were investigated through the unconfined axial compression test, the model soil box test and the combined resonant column and torsional shear test. The unconfined axial compression strength of HMS-25 shows a steady increasement in strength due to the chemical hardening reaction between HMS-25 and water. The result of model soil box test reveals that railroad roadbed of HMS-25 is better than that of soil in several aspects, such as, bearing capacity and settlement. The combined resonant column and torsional shear test result indicates that shear modulus of HMS-25 and soil increase with the power of 0.5 to the confining pressure and linear relationship to normalized shear modulus and damping ratio.

• Transactions of the Korean Society of Machine Tool Engineers
• /
• v.10 no.5
• /
• pp.96-103
• /
• 2001

The quality requirements for thickness accuracy in cold rolling continue to become more stringent, particularly in response to exacting design specification from automotive customers. One of the major impacts from the tighter tolerance level is more unusable product on the head end and tail end of tandem mill coils when the mill is in transition to or from steady state rolling condition. A strip thickness control system for a tandem cold steel rolling mills is composed with blocked non-interacting controller and controllers for strip thickness and tension control of each rolling stands. An intelligent mathematical model included an elastic deformation of strip has been developed and applied to the field in order to predict the rolling force. The simulated results showed that the effect of elastic recovery should be included the model, even if the effect of elastic compression was not important.

• Transactions of the Korean Society of Mechanical Engineers B
• /
• v.32 no.5
• /
• pp.382-391
• /
• 2008

A simple analytical model of rarefied channel flow is developed to predict the compression ratio in a helical drag pump. If the surface velocity is zero, the model reduces to a capillary leaks. Predictions of our model agree well with the Knudsen's data for capillary leaks in transition flow, in addition to giving a good account of the Knudsen minimum. Also, the present results are compared with experimental data, and good agreement is obtained over the entire pressure range from molecular to slip flow.