• 제목/요약/키워드: Data Pipeline

검색결과 574건 처리시간 0.033초

Virtual reality application on MFL gas pipeline inspection system

  • 김재준
    • 한국산업정보학회논문지
    • /
    • 제15권4호
    • /
    • pp.47-52
    • /
    • 2010
  • This paper describes a visualization technique that animates geometrical defect data that are extracted using a magnetic flux leakage (MFL) operating system on nondestructive evaluation (NDE). Since data are collected from different locations and often not regular, the data must be converted to the standard format that is used within the pipeline in visualization procedures. In order to navigate inside of the pipeline, 3D virtual objects are generated and are able to explore the pipeline continuously. The major objectives of this paper are to characterize, generate general shape of defects, and enable computer interaction in virtual environment. Pipeline navigation system (PNS) has introduced the framework for interactive visual applications based upon the principles of modeling 3D objects. PNS presents some preliminary efforts to enable the user to interact human and computer with each other.

DGPS RTK와 서라운드 영상을 융합한 GIS 기반 스마트 관로정보 관리시스템 설계 (Design of a GIS-based Smart Pipeline Information Management System Combining DGPS RTK and Surround View)

  • 국중진
    • 반도체디스플레이기술학회지
    • /
    • 제22권3호
    • /
    • pp.125-129
    • /
    • 2023
  • In this paper, we propose a method to design and implement a smart pipeline information management system that can provide visualization information linked to GIS and roadmap based on the construction of precise pipeline buried information. The smart pipeline information management system consists of a positioning device for high-precision pipeline location measurement and surround view image data recording, a database for data storage and management, and a mobile app for remote monitoring and management. It connects surrounding image data and location data with GIS and roadmap. Convenience and accessibility of management can be improved.

  • PDF

KMTNet 실시간 자료처리 파이프라인 개발 (DEVELOPMENT OF REAL-TIME DATA REDUCTION PIPELINE FOR KMTNet)

  • 김동진;이충욱;김승리;박병곤
    • 천문학논총
    • /
    • 제28권1호
    • /
    • pp.1-6
    • /
    • 2013
  • Real-time data reduction pipeline for the Korea Microlensing Telescope Network (KMTNet) was developed by Korea Astronomy and Space Science Institute (KASI). The main goal of the data reduction pipeline is to find variable objects and to record their light variation from the large amount of observation data of about 200 GB per night per site. To achieve the goal we adopt three strategic implementations: precision pointing of telescope using the cross correlation correction for target fields, realtime data transferring using kernel-level file handling and high speed network, and segment data processing architecture using the Sun-Grid engine. We tested performance of the pipeline using simulated data which represent the similar circumstance to CTIO (Cerro Tololo Inter-American Observatory), and we have found that it takes about eight hours for whole processing of one-night data. Therefore we conclude that the pipeline works without problem in real-time if the network speed is high enough, e.g., as high as in CTIO.

SYSTEM ANALYSIS OF PIPELINE SOFTWARE - A CASE STUDY OF THE IMAGING SURVEY AT ESO

  • Kim, Young-Soo
    • Journal of Astronomy and Space Sciences
    • /
    • 제20권4호
    • /
    • pp.403-416
    • /
    • 2003
  • There are common features, in both imaging surveys and image processing, between astronomical observations and remote sensing. Handling large amounts of data, in an easy and fast way, has become a common issue. Implementing pipeline software can be a solution to the problem, one which allows the processing of various kinds of data automatically. As a case study, the development of pipeline software for the EIS (European Southern Observatory Imaging Survey) is introduced. The EIS team has been conducting a sky survey to provide candidate targets to the 250 VLTs (Very Large Telescopes) observations. The survey data have been processed in a sequence of five major data corrections and reductions, i.e. preprocessing, flat fielding, photometric and astrometric corrections, source extraction, and coaddition. The processed data are eventually distributed to the users. In order to provide automatic processing of the vast volume of observed data, pipeline software has been developed. Because of the complexity of objects and different characteristic of each process, it was necessary to analyze the whole works of the EIS survey program. The overall tasks of the EIS are identified, and the scheme of the EIS pipeline software is defined. The system structure and the processes are presented, and in-depth flow charts are analyzed. During the analyses, it was revealed that handling the data flow and managing the database are important for the data processing. These analyses may also be applied to many other fields which require image processing.

국외 천연가스 배관 사고 빈도 비교 및 분석 모형에 관한 연구 (A Study on Failure Frequency Model for Risk Analysis of Natural Gas Pipeline with Comparison of Overseas Failure Data)

  • 오신규
    • 한국가스학회지
    • /
    • 제18권3호
    • /
    • pp.60-66
    • /
    • 2014
  • 본 연구에서는 국내 매설 고압가스배관의 사고빈도 데이터 구축 시 활용할 수 있도록 국외에서 발표하고 있는 고압가스배관 사고빈도 데이터에 대해 고찰 하였다. 고압가스배관 사고빈도 데이터의 대표적인 것으로는 미국의 DOT, 유럽의 EGIG 및 영국의 UKOPA가 있다. 국외 사고빈도 데이터의 국내 적용 가능성을 확인하기 위하여 이들을 비교 분석한 결과 EGIG 데이터가 국내 실정에 더 적합하였다. EGIG 8차 보고서의 사고빈도 데이터를 사용하여 비선형회귀분석을 수행한 결과 배관 설치 연도에 따른 지수형의 곡선을 얻었다. 향후 전체 사고빈도의 약 50%를 차지하고 있는 타공사 부분과 국내 데이터와 국외 데이터의 합성에 대한 집중적인 연구가 필요하다.

극한지 파이프라인 프로젝트 설계단계에서의 데이터 분류에 관한 연구 (A Study on the Data Classification in Engineering Stage of Pipeline Project in Extreme Cold Weather)

  • 김창한;원서경;이준복;한충희
    • 한국건축시공학회:학술대회논문집
    • /
    • 한국건축시공학회 2014년도 추계 학술논문 발표대회
    • /
    • pp.214-215
    • /
    • 2014
  • Recently, Russia decided to export an annual 7.5 million tons of natural gas to Korea over 30 years from 2015, as also deal with China, planed to build a pipeline connecting Siberia to Shandong Peninsula about 4000km. Risk management is required depending on the project in extreme cold weather, because it is concerned about the behavior of the seasonal changes in soil temperature and the strain of pipe according to the long-distance pipeline construction. The plan of data management shall be prepared in parallel for a sophisticated risk management, because a data is massive scale and it is generated/accumulated in real time. Therefore, this research is aimed to classify a data items in engineering stage of pipeline by previous studies for managing a generated data depending on the detail works in extreme cold weather. We expect to be provided the foundation of an efficient classification system of a generated data from the pipeline project life cycle.

  • PDF

A Universal Analysis Pipeline for Hybrid Capture-Based Targeted Sequencing Data with Unique Molecular Indexes

  • Kim, Min-Jung;Kim, Si-Cho;Kim, Young-Joon
    • Genomics & Informatics
    • /
    • 제16권4호
    • /
    • pp.29.1-29.5
    • /
    • 2018
  • Hybrid capture-based targeted sequencing is being used increasingly for genomic variant profiling in tumor patients. Unique molecular index (UMI) technology has recently been developed and helps to increase the accuracy of variant calling by minimizing polymerase chain reaction biases and sequencing errors. However, UMI-adopted targeted sequencing data analysis is slightly different from the methods for other types of omics data, and its pipeline for variant calling is still being optimized in various study groups for their own purposes. Due to this provincial usage of tools, our group built an analysis pipeline for global application to many studies of targeted sequencing generated with different methods. First, we generated hybrid capture-based data using genomic DNA extracted from tumor tissues of colorectal cancer patients. Sequencing libraries were prepared and pooled together, and an 8-plexed capture library was processed to the enrichment step before 150-bp paired-end sequencing with Illumina HiSeq series. For the analysis, we evaluated several published tools. We focused mainly on the compatibility of the input and output of each tool. Finally, our laboratory built an analysis pipeline specialized for UMI-adopted data. Through this pipeline, we were able to estimate even on-target rates and filtered consensus reads for more accurate variant calling. These results suggest the potential of our analysis pipeline in the precise examination of the quality and efficiency of conducted experiments.

극한지 자원이송망 EPC단계에서 발생되는 데이터 항목에 관한 기초연구 (A Fundamental Study on Data Item occurred in EPC Stage of Pipeline in Extreme Cold Weather)

  • 김창한;원서경;이준복;한충희
    • 한국건축시공학회:학술대회논문집
    • /
    • 한국건축시공학회 2014년도 춘계 학술논문 발표대회
    • /
    • pp.18-19
    • /
    • 2014
  • As issued the development of energy resources, EPC work process through the IT technology is essential for efficient business management, and systematic management of data generated in this process is needed. In domestic, the research related to system development for the collection and management of construction data detected in the field has been done continuously, but pipeline business target the long-distance in extreme cold weather, almost no cases have been studied up to now. Therefore, this research is aimed to derive the data item for efficient management in EPC Stage of pipeline business in extreme cold weather. WBS system of EPC work are classified easily at two levels, data items can be divided based on the type of document. In the future I will be expected to be the foundation of the systematic management of data generated in the EPC step-by-step of pipeline business.

  • PDF

Diagnosing Plant Pipeline System Performance Using Radiotracer Techniques

  • Kasban, H.;Ali, Elsayed H.;Arafa, H.
    • Nuclear Engineering and Technology
    • /
    • 제49권1호
    • /
    • pp.196-208
    • /
    • 2017
  • This study presents an experimental work in a petrochemical company for scanning a buried pipeline using $Tc^{99m}$ radiotracer based on the measured velocity changes, in order to determine the flow reduction along a pipeline. In this work, $Tc^{99m}$ radiotracer was injected into the pipeline and monitored by sodium iodide scintillation detectors located at several positions along the pipeline. The flow velocity has been calculated between every two consecutive detectors along the pipeline. Practically, six experiments have been carried out using two different data acquisition systems, each of them being connected to four detectors. During the fifth experiment, a bypass was discovered between the scanned pipeline and another buried parallel pipeline connected after the injection point. The results indicate that the bypass had a bad effect on the volumetric flow rate in the scanned pipeline.

천연가스 전국 고압 배관망 모델 수립 (Establishment of natural gas high-pressure pipeline network model in Korea)

  • 박영;이영철;이정환;조병학;임정숙
    • 한국가스학회지
    • /
    • 제5권2호
    • /
    • pp.43-51
    • /
    • 2001
  • 본 연구에서는 상용프로그램(STONER) 상에 천연가스 전국 배관망 모델이 수립되었다. 이를 위해 STONER 상에 전국 배관망도가 작성되었으며, 배관망도 상에 기존 자료를 토대로 전국 각 배관의 배관 관경, 연장 길이가 입력되었다. 그리고 배관내를 흐르는 가스를 정의하기 위해 천연가스의 비중값이 입력되었다. 마지막으로 배관의 성질과 가스 온도를 결정하기 위해 실측치와의 비교 검증을 통하여 오류를 최소화하였다. 이에 먼저 주 배관성질 값이 가정되었고, 이에 대해 실측 수요 자료를 가지고 배관망 분석이 수행되었다. 그리고 분석 결과 계산된 공급압력과 실측된 공급 압력을 분산 비교하여 최종적으로 배관의 성질값을 결정하였다. 이렇게 배관의 성질 결정에 있어서 기존의 배관망 모델 수립 방법과는 다르게 실측자료와의 검증 방법을 사용하여 좀더 실제에 접근한 모델을 수립할 수 있었다.

  • PDF