Label Embedding for Improving Classification Accuracy UsingAutoEncoderwithSkip-Connections (다중 레이블 분류의 정확도 향상을 위한 스킵 연결 오토인코더 기반 레이블 임베딩 방법론)
-
- Journal of Intelligence and Information Systems
- /
- v.27 no.3
- /
- pp.175-197
- /
- 2021
Recently, with the development of deep learning technology, research on unstructured data analysis is being actively conducted, and it is showing remarkable results in various fields such as classification, summary, and generation. Among various text analysis fields, text classification is the most widely used technology in academia and industry. Text classification includes binary class classification with one label among two classes, multi-class classification with one label among several classes, and multi-label classification with multiple labels among several classes. In particular, multi-label classification requires a different training method from binary class classification and multi-class classification because of the characteristic of having multiple labels. In addition, since the number of labels to be predicted increases as the number of labels and classes increases, there is a limitation in that performance improvement is difficult due to an increase in prediction difficulty. To overcome these limitations, (i) compressing the initially given high-dimensional label space into a low-dimensional latent label space, (ii) after performing training to predict the compressed label, (iii) restoring the predicted label to the high-dimensional original label space, research on label embedding is being actively conducted. Typical label embedding techniques include Principal Label Space Transformation (PLST), Multi-Label Classification via Boolean Matrix Decomposition (MLC-BMaD), and Bayesian Multi-Label Compressed Sensing (BML-CS). However, since these techniques consider only the linear relationship between labels or compress the labels by random transformation, it is difficult to understand the non-linear relationship between labels, so there is a limitation in that it is not possible to create a latent label space sufficiently containing the information of the original label. Recently, there have been increasing attempts to improve performance by applying deep learning technology to label embedding. Label embedding using an autoencoder, a deep learning model that is effective for data compression and restoration, is representative. However, the traditional autoencoder-based label embedding has a limitation in that a large amount of information loss occurs when compressing a high-dimensional label space having a myriad of classes into a low-dimensional latent label space. This can be found in the gradient loss problem that occurs in the backpropagation process of learning. To solve this problem, skip connection was devised, and by adding the input of the layer to the output to prevent gradient loss during backpropagation, efficient learning is possible even when the layer is deep. Skip connection is mainly used for image feature extraction in convolutional neural networks, but studies using skip connection in autoencoder or label embedding process are still lacking. Therefore, in this study, we propose an autoencoder-based label embedding methodology in which skip connections are added to each of the encoder and decoder to form a low-dimensional latent label space that reflects the information of the high-dimensional label space well. In addition, the proposed methodology was applied to actual paper keywords to derive the high-dimensional keyword label space and the low-dimensional latent label space. Using this, we conducted an experiment to predict the compressed keyword vector existing in the latent label space from the paper abstract and to evaluate the multi-label classification by restoring the predicted keyword vector back to the original label space. As a result, the accuracy, precision, recall, and F1 score used as performance indicators showed far superior performance in multi-label classification based on the proposed methodology compared to traditional multi-label classification methods. This can be seen that the low-dimensional latent label space derived through the proposed methodology well reflected the information of the high-dimensional label space, which ultimately led to the improvement of the performance of the multi-label classification itself. In addition, the utility of the proposed methodology was identified by comparing the performance of the proposed methodology according to the domain characteristics and the number of dimensions of the latent label space.
Existing Gamma Knife Radiosurgery(GKRS) for large lesions is often conducted in stages with volume or dose partitions. Often in case of volume division the target used to be divided into sub-volumes which are irradiated under the determined prescription dose in multi-sessions separated by a day or two, 3~6 months. For the entire course of treatment, treatment informations of the previous stages needs to be reflected to subsequent sessions on the newly mounted stereotactic frame through coordinate transformation between sessions. However, it is practically difficult to implement the previous dose distributions with existing Gamma Knife system except in the same stereotactic space. The treatment area is expanding because it is possible to perform the multistage treatment using the latest Gamma Knife Platform(GKP). The purpose of this study is to introduce the image-coregistration based on the stereotactic spaces and the strategy of multistage GKRS such as the determination of prescription dose at each stage using new GKP. Usually in image-coregistration either surgically-embedded fiducials or internal anatomical landmarks are used to determine the transformation relationship. Author compared the accuracy of coordinate transformation between multi-sessions using four or six anatomical landmarks as an example using internal anatomical landmarks. Transformation matrix between two stereotactic spaces was determined using PseudoInverse or Singular Value Decomposition to minimize the discrepancy between measured and calculated coordinates. To evaluate the transformation accuracy, the difference between measured and transformed coordinates, i.e.,
This study analyzed methodologies for estimating carbon stocks of perennial woody crops and the research cases in overseas countries. As a result, we found that Australia, Bulgaria, Canada, and Japan are using the stock-difference method, while Austria, Denmark, and Germany are estimating the change in the carbon stock based on the gain-loss method. In some overseas countries, the researches were conducted on estimating the carbon stock change using image data as tier 3 phase beyond the research developing country-specific factors as tier 2 phase. In South Korea, convergence studies as the third stage were conducted in forestry field, but advanced research in the agricultural field is at the beginning stage. Based on these results, we suggest directions for the following four future researches: 1) securing national-specific factors related to emissions and removals in the agricultural field through the development of allometric equation and carbon conversion factors for perennial woody crops to improve the completeness of emission and removals statistics, 2) implementing policy studies on the cultivation area calculation refinement with fruit tree-biomass-based maturity, 3) developing a more advanced estimation technique for perennial woody crops in the agricultural sector using allometric equation and remote sensing techniques based on the agricultural and forestry satellite scheduled to be launched in 2025, and to establish a matrix and monitoring system for perennial woody crop cultivation areas in the agricultural sector, Lastly, 4) estimating soil carbon stocks change, which is currently estimated by treating all agricultural areas as one, by sub-land classification to implement a dynamic carbon cycle model. This study suggests a detailed guideline and advanced methods of carbon stock change calculation for perennial woody crops, which supports 2050 Carbon Neutral Strategy of Ministry of Agriculture, Food, and Rural Affairs and activate related research in agricultural sector.
Purpose : Early degeneration of articular cartilage is accompanied by a loss of glycosaminoglycan (GAG) and the consequent change of the integrity. The purpose of this study was to biochemically quantify the loss of GAG, and to evaluate the
Background : Non-small cell lung cancer (NSCLC) is a common cause of cancer-related death in North America and Korea, with an overall 5-year survival rate of between 4 and 14%. The TNM staging system is the best prognostic index for operable NSCLC . However, epidermal growth factor receptor (EGFR), matrix metalloproteinase-9(MMP-9), and C-erbB-2 have all been implicated in the pathogenesis of NSCLC and might provide prognostic information. Methods : Immunohistochemical staining of 81 specimens from a resected primary non-small cell lung cancer was evaluated in order to determine the role of the biological markers on NSCLC . Immunohistochemical staining for EGFR, MMP-9, and C-erbB-2 was performed on paraffin-embedded tissue sections to observe the expression pattern according to the pathologic type and surgical staging. The correlations between the expression of each biological marker and the survival time was determined. Results : When positive immunohistochemical staining was defined as the extent area>20%(more than Grade 2), the positive rates for EGFR, MMP-9, and C-erbB-2 staining were 71.6%, 44.3%, and 24.1% of the 81 patients, respectively. The positive rates of EGFR and MMP-9 stain for NSCLC according to the surgical stages I, II, and IIIa were 75.0% and 41.7%, 66.7% and 47.6%, and 76.9% and 46.2%, respectively. The median survival time of the EGFR(-) group, 71.8 months, was significantly longer than that of the EGFR(+) group, 33.5 months.(p=0.018, Kaplan-Meier Method, log-rank test).. The MMP-9(+) group had a shorter median survival time than the MMP-9(-) group, 35.0 and 65.3 months, respectively (p=0.2). The co-expression of EGFR and MMP-9 was associated with a worse prognosis with a median survival time of 26.9 months, when compared with the 77 months for both negative-expression groups (p=0.0023). There were no significant differences between the C-erbB-2(+) and C-erbB-2 (-) groups. Conclusion : In NSCLC, the expression of EGFR might be a prognostic factor, and the co-expression of EGFR and MMP-9 was found to be associated with a poor prognosis. However, C-erbB-2 expression had no prognostic significance.
Purpose: The Wide Beam Reconstruction (WBR) algorithms that UltraSPECT, Ltd. (U.S) has provides solutions which improved image resolution by eliminating the effect of the line spread function by collimator and suppression of the noise. It controls the resolution and noise level automatically and yields unsurpassed image quality. The aim of this study is WBR of whole body bone scan in usefulness of clinical application. Materials and Methods: The standard line source and single photon emission computed tomography (SPECT) reconstructed spatial resolution measurements were performed on an INFINA (GE, Milwaukee, WI) gamma camera, equipped with low energy high resolution (LEHR) collimators. The total counts of line source measurements with 200 kcps and 300 kcps. The SPECT phantoms analyzed spatial resolution by the changing matrix size. Also a clinical evaluation study was performed with forty three patients, referred for bone scans. First group altered scan speed with 20 and 30 cm/min and dosage of 740 MBq (20 mCi) of
To improve osseointegration at the boneto-implant interface, several studies have been carried out to modify titanium surface. Variations in surface texture or microtopography may affect the cellular response to an implant. Osteoblast-like cells attach more readily to a rougher titanium surface, and synthesis of extracellular matrix and subsequent mineralization were found to be enhanced on rough or porous coated titanium. However, regarding the effect of roughened surface by physical and mechanical methods, most studies carried out on the reactions of cells to micrometric topography, little work has been performed on the reaction of cells to nanotopography. The purpose of this study was to examme the response of osteoblast-like cell cultured on blasted surfaces and alkali treated surfaces, and to evaluate the influence of surface texture or submicro-scaled surface topography on the cell attachment, cell proliferation and the gene expression of osteoblastic phenotype using ROS 17/2.8 cell lines. In scanning electron micrographs, the blasted, alkali treated and machined surfaces demonstrated microscopic differences in the surface topography. The specimens of alkali treatment had a submicro-scaled porous sur-face with pore size about 200 nm. The blasted surfaces showed irregularities in morphology with small(<10
The structures of fully dehydrated
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70