• 제목/요약/키워드: data pre-processing

검색결과 805건 처리시간 0.027초

Semantic Correspondence of Database Schema from Heterogeneous Databases using Self-Organizing Map

  • Dumlao, Menchita F.;Oh, Byung-Joo
    • 전기전자학회논문지
    • /
    • 제12권4호
    • /
    • pp.217-224
    • /
    • 2008
  • This paper provides a framework for semantic correspondence of heterogeneous databases using self- organizing map. It solves the problem of overlapping between different databases due to their different schemas. Clustering technique using self-organizing maps (SOM) is tested and evaluated to assess its performance when using different kinds of data. Preprocessing of database is performed prior to clustering using edit distance algorithm, principal component analysis (PCA), and normalization function to identify the features necessary for clustering.

  • PDF

인피니밴드 기반 고성능 클러스터를 위한 효율적인 데이터 선반입 기법 (Efficient Data Pre-fetching Scheme for InfiniBand based High Performance Clusters)

  • 김봉재;정진만;민홍;허준영;정혜동
    • 정보과학회 컴퓨팅의 실제 논문지
    • /
    • 제23권5호
    • /
    • pp.293-298
    • /
    • 2017
  • 최근 고성능 네트워크 기술을 기반으로 다수의 컴퓨터를 활용하여 클러스터를 구축하고 고성능 컴퓨팅 환경을 제공하기 위한 연구가 활발하게 이루어지고 있다. 이와 같은 고성능 클러스터 환경에서 각 컴퓨팅 노드의 데이터 처리 성능을 향상시키기 위하여 Redis, Memcached와 같은 인-메모리 기반 키-값 데이터 저장소를 활용하고 있다. 이를 통해 인-메모리 기반으로 데이터를 분산 저장하고 각 컴퓨팅 노드에서 필요한 데이터를 고속으로 접근할 수 있다. 인피니밴드는 이와 같은 고성능 클러스터에서 각 컴퓨팅 노드를 연결하기 위한 사실상의 표준 기술이다. 본 논문에서는 키-값 데이터 저장소 기반 고성능 클러스터 컴퓨팅 시스템의 데이터 처리 성능을 향상시키기 위해 인피니밴드 네트워크의 데이터 송수신 지연 특성을 활용한 데이터 선반입 기법을 제안한다. 시뮬레이션을 통해 제안 기법이 기존 기법보다 데이터 송수신 소요시간을 최대 약 28% 줄여 컴퓨팅 성능을 향상 시킬 수 있음을 보인다.

원전 ISI UT 자동 결함평가 및 판정 모듈 개발 (Development of ISI UT Auto Flaw Evaluation and Acceptance Module of Nuclear Power Plants)

  • 박익근;박은수;김현묵;김정석;엄병국;이종포
    • 대한기계학회:학술대회논문집
    • /
    • 대한기계학회 2000년도 추계학술대회논문집A
    • /
    • pp.212-218
    • /
    • 2000
  • The importance and role of pre-/in-service inspection(PSI/ISI) for nuclear power plant(NPP) components are intimately related to plant design, safety, reliability, operation, etc. In this paper, for an effective and efficient management of large amounts of PSI/ISI data in NPPs, an intelligent database program(WS-IDPIN) for PSI/ISI data management of NPP was developed. WS-IDPIN program enables the prompt extraction of previously conducted PSI/ISI conditions and results so that the time-consuming data management, painstaking data processing and analysis in the past are avoided. Furthermore, development of ISI UT auto flaw evaluation and acceptance module based on ASME Code Sec. XI were presented. This module can be used for any angle beam examination from flat plate to spherical shapes as selected by the proper azimuthal angle. This program can be further developed as a unique PSI/ISI data management expert system.

  • PDF

다단계 반도체 제조공정에서 함수적 입력 데이터를 위한 모니터링 시스템 (A Monitoring System for Functional Input Data in Multi-phase Semiconductor Manufacturing Process)

  • 장동윤;배석주
    • 대한산업공학회지
    • /
    • 제36권3호
    • /
    • pp.154-163
    • /
    • 2010
  • Process monitoring of output variables affecting final performance have been mainly executed in semiconductor manufacturing process. However, even earlier detection of causes of output variation cannot completely prevent yield loss because a number of wafers after detecting them must be re-processed or cast away. Semiconductor manufacturers have put more attention toward monitoring process inputs to prevent yield loss by early detecting change-point of the process. In the paper, we propose the method to efficiently monitor functional input variables in multi-phase semiconductor manufacturing process. Measured input variables in the multi-phase process tend to be of functional structured form. After data pre-processing for these functional input data, change-point analysis is practiced to the pre-processed data set. If process variation occurs, key variables affecting process variation are selected using contribution plot for monitoring efficiency. To evaluate the propriety of proposed monitoring method, we used real data set in semiconductor manufacturing process. The experiment shows that the proposed method has better performance than previous output monitoring method in terms of fault detection and process monitoring.

천리안위성 기하보정 시스템의 궤도상 시험 (COMS Geometric Calibration System and Its In-Orbit Functional and Performance Tests)

  • 진경욱;서석배;김한돌;주광혁;양군호
    • 대한원격탐사학회지
    • /
    • 제27권4호
    • /
    • pp.495-506
    • /
    • 2011
  • 천리안 위성의 궤도상 시험이 위성발사 직후인 2010년 7월부터 2011년 1월까지 약 7개월에 걸쳐 성공적으로 수행되었으며, 과학탑재체인 기상 및 해양탑재체 자료는 2011년 4월부터 공식적으로 배포되고 있다. 이 논문에서는 천리안위성의 궤도상 시험 중 핵심적인 요소인 탑재체 자료의 보정 과정 중 최종 단계인 기하보정의 궤도상 테스트 내용에 중점을 두고 있다. 천리안위성 기하보정 알고리즘의 구조와 내용을 간략하게 소개하였으며, 위성발사 후 행해진 기하보정시스템의 기능 및 검증 테스트의 단계별 과정들과 그 결과를 분석 정리하였다. 실시간 위성자료 전처리 시스템을 통해 확보한 자료들을 이용한 천리안 기하보정알고리즘의 최종 성능테스트는 요구 조건을 만족하는 우수한 정확도를 보여 주었다.

A comparative study between sterile freeze-dried and sterile pre-hydrated acellular dermal matrix in tissue expander/implant breast reconstruction

  • Cheon, Jeong Hyun;Yoon, Eul Sik;Kim, Jin Woo;Park, Seung Ha;Lee, Byung Il
    • Archives of Plastic Surgery
    • /
    • 제46권3호
    • /
    • pp.204-213
    • /
    • 2019
  • Background In implant-based breast reconstruction, acellular dermal matrix (ADM) is essential for supporting the inferolateral pole. Recent studies have compared non-sterilized freeze-dried ADM and sterilized pre-hydrated ADM, but have not assessed whether differences were attributable to factors related to sterile processing or packaging. This study was conducted to compare the clinical outcomes of breast reconstruction using two types of sterile-processed ADMs. Methods Through a retrospective chart review, we analyzed 77 consecutive patients (85 breasts) who underwent tissue expander/implant breast reconstruction with either freeze-dried ADM (35 breasts) or pre-hydrated ADM (50 breasts) from March 2016 to February 2018. Demographic variables, postoperative outcomes, and operative parameters were compared between freeze-dried and pre-hydrated ADM. Biopsy specimens were obtained for histologic analysis. Results We obtained results after adjusting for variables found to be significant in univariate analyses. The total complication rate for freeze-dried and pre-hydrated ADMs was 25.7% and 22.0%, respectively. Skin necrosis was significantly more frequent in the freeze-dried group than in the pre-hydrated group (8.6% vs. 4.0%, P=0.038). All other complications and operative parameters showed no significant differences. In the histologic analysis, collagen density, inflammation, and vascularity were higher in the pre-hydrated ADM group (P=0.042, P=0.006, P=0.005, respectively). Conclusions There are limited data comparing the outcomes of tissue expander/implant breast reconstruction using two types of sterile-processed ADMs. In this study, we found that using pre-hydrated ADM resulted in less skin necrosis and better integration into host tissue. Pre-hydrated ADM may therefore be preferable to freeze-dried ADM in terms of convenience and safety.

무선 메쉬망에서의 안전하고 효율적인 키관리 스킴 (Secure and Efficient Key Management Scheme for Wireless Mesh Network)

  • ;;이상곤;이훈재
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2011년도 춘계학술발표대회
    • /
    • pp.844-847
    • /
    • 2011
  • Wireless mesh network (WMN) is a type of mobile ad-hoc network consists of wireless router, mobile clients and gateway which connects the network with the Internet. To provide security in the network it is required to encrypt the message sent among the communicating nodes in such way so that only legitimate user can retrieve the original data. Several security mechanisms have been proposed so far to enhance the security of WMN. However, there still exists a need for a comprehensive mechanism to prevent attacks in data communication. Considering the characteristic of mesh network, in this paper we proposed a public key cryptography based security architecture to establish a secure key agreement among communicating nodes in mesh network. The proposed security architecture consists of two major sections: client data protection and network data protection. Client data protection deals with the mutual authentication between the client and the access router and provide client to access router encryption for data confidentiality using standard IEEE 802.11i protocol. On the other hand, network data protection ensures encrypted routing and data transfer in the multi hop backbone network. For the network data protection, we used the pre-distributed public key to form a secure backbone infrastructure.

공간자료구조를 활용한 단층인식 시스템 (Fault Detection System Using Spatial Index Structure)

  • 방갑산
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2005년도 추계종합학술대회
    • /
    • pp.1205-1208
    • /
    • 2005
  • By adding user interface to the usual router, an improved functional router is implemented in this paper. Due to the massive amount of spatial data processing, spatial information processing area has been rapidly grown up in recent years based on powerful computer hardware and software development. Spatial index structures are the core engine of geographic information system(GIS). Analyzing and processing of spatial information using GIS has a lot of applications and the number application will be increased in the future. However, study on the under ground is in its infancy due to invisible characteristic of this information. This paper proposes the sub-surface fault detection system using the sub-surface layer information gathered from elastic wave. Detection of sub-surface fault provides very important information to the safety of above and sub-surface man made structures. Development of sub-surface fault detection system will serve as a pre-processing system assisting the interpretation of the geologist.

  • PDF

대용량 웹 로그 마이닝 및 공격탐지를 위한 B-트리 인덱스 벡터 기반 고속 검색 기법 (High-Speed Search Mechanism based on B-Tree Index Vector for Huge Web Log Mining and Web Attack Detection)

  • 이형우;김태수
    • 한국멀티미디어학회논문지
    • /
    • 제11권11호
    • /
    • pp.1601-1614
    • /
    • 2008
  • 최근 대부분의 인터넷 환경이 쳅 기반 시스템으로 발전하면서 웹 서비스 사용자 수는 꾸준히 증가하고 있다. 따라서 일반 사용자가 대형 포털 사이트 웹 서버 접속시 생성되는 로그 정보를 분석하여 웹 서버에 대한 공격을 탐지하거나 웹 마이닝 기술과 접목하기 위해서는 대용량의 웹 로그 정보에 대한 효율적인 분석 기법이 필요하다. 기존 웹 로그 전처리 기법은 로그 문자열의 순차적인 탐색을 수행하므로 대용량의 웹 로그 고속화 처리에 적합하지 않다. 본 연구에서는 대용량 웹 로그 정보에 대해 B-트리 인덱싱 벡터 구조를 이용하여 필드별 분류 및 고속 검색 알고리즘을 개발하였다 이를 통해 효율적으로 대용량 로고로부터 효율적인 세션 분석 기능과 개선된 검색 성능을 제공할 수 있었으며 웹 서버에 대한 공격 탐지에도 활용할 수 있었다.

  • PDF

방사형 기저함수 신경회로망 기반 숫자 인식 시스템의 설계 : 전처리 알고리즘을 이용한 인식성능의 비교연구 (Design of Digits Recognition System Based on RBFNNs : A Comparative Study of Pre-processing Algorithms)

  • 김은후;김봉연;오성권
    • 전기학회논문지
    • /
    • 제66권2호
    • /
    • pp.416-424
    • /
    • 2017
  • In this study, we propose a design of digits recognition system based on RBFNNs through a comparative study of pre-processing algorithms in order to recognize digits in handwritten. Histogram of Oriented Gradient(HOG) is used to get the features of digits in the proposed digits recognition system. In the pre-processing part, a dimensional reduction is executed by using Principal Component Analysis(PCA) and (2D)2PCA which are widely adopted methods in order to minimize a loss of the information during the reduction process of feature space. Also, The architecture of radial basis function neural networks consists of three functional modules such as condition, conclusion, and inference part. In the condition part, the input space is partitioned with the use of fuzzy clustering realized by means of the Fuzzy C-Means algorithm. Also, it is used instead of gaussian function to consider the characteristic of input data. In the conclusion part, the connection weights are used as the extended type of polynomial expression such as constant, linear, quadratic and modified quadratic. By using MNIST handwritten digit benchmarking database, experimental results show the effectiveness and efficiency of proposed digit recognition system when compared with other studies.