• Title/Summary/Keyword: profiling.

Search Result 1,535, Processing Time 0.031 seconds

Development of Data Profiling Software Supporting a Microservice Architecture (마이크로 서비스 아키텍처를 지원하는 데이터 프로파일링 소프트웨어의 개발)

  • Chang, Jae-Young;Kim, Jihoon;Jee, Seowoo
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.21 no.5
    • /
    • pp.127-134
    • /
    • 2021
  • Recently, acquisition of high quality data has become an important issue as the expansion of the big data industry. In order to acquiring high quality data, accurate evaluation of data quality should be preceded first. The quality of data can be evaluated through meta-information such as statistics on data, and the task to extract such meta-information is called data profiling. Until now, data profiling software has typically been provided as a component or an additional service of traditional data quality or visualization tools. Hence, it was not suitable for utilizing directly in various environments. To address this problem, this paper presents the development result of data profiling software based on a microservice architecture that can be serviced in various environments. The presented data profiler provides an easy-to-use interface that requests of meta-information can be serviced through the restful API. Also, a proposed data profiler is independent of a specific environment, thus can be integrated efficiently with the various big data platforms or data analysis tools.

Deep Learning Based User Safety Profiling Using User Feature Information Modeling (딥러닝 기반 사용자 특징 정보 모델링을 통한 사용자 안전 프로파일링)

  • Kim, Kye-Kyung
    • Journal of Software Assessment and Valuation
    • /
    • v.17 no.2
    • /
    • pp.143-150
    • /
    • 2021
  • There is a need for an artificial intelligent technology that can reduce various types of safety accidents by analyzing the risk factors that cause safety accidents in industrial site. In this paper, user safety profiling methods are proposed that can prevent safety accidents in advance by specifying and modeling user information data related to safety accidents. User information data is classified into normal and abnormal conditions through deep learning based artificial intelligence analysis. As a result of verifying user safety profiling technology using more than 10 types of industrial field data, 93.6% of user safety profiling accuracy was obtained.

Surveying for Monitoring Topographic Changes of Tidal Zone (조간대 지형변화측량의 방법과 문제)

  • 이창경;진준호
    • Proceedings of the Korean Society of Surveying, Geodesy, Photogrammetry, and Cartography Conference
    • /
    • 2004.04a
    • /
    • pp.553-558
    • /
    • 2004
  • Periodic profiling by level is a conventional method for monitoring topographic changes in a specific part of tidal zone. Periodic aerial photographs are used for monitoring topographic change of broad tidal zone area. In this study, spot heights at interval of 50m on 5 profiling lines were leveled periodically for precise monitoring topographic change of tidal zone. For monitoring broad topographic change of tidal zone, aerial photographs were also taken by film camera loaded on pilotless helicopter periodically Periodic profiling shows the change of heights on the lines well. On the other hand, aerial photographs taken by film camera loaded on pilotless helicopter have some problems to detect topographic change of tidal zone precise. Because the scale and incline of the photographs were not same, it is hard to compare them. Therefore, for more precise monitoring of topographic changes in tidal zone, it is need to take aerial pictures with same scale and same incline.

  • PDF

Enhancing GPU Performance by Efficient Hardware-Based and Hybrid L1 Data Cache Bypassing

  • Huangfu, Yijie;Zhang, Wei
    • Journal of Computing Science and Engineering
    • /
    • v.11 no.2
    • /
    • pp.69-77
    • /
    • 2017
  • Recent GPUs have adopted cache memory to benefit general-purpose GPU (GPGPU) programs. However, unlike CPU programs, GPGPU programs typically have considerably less temporal/spatial locality. Moreover, the L1 data cache is used by many threads that access a data size typically considerably larger than the L1 cache, making it critical to bypass L1 data cache intelligently to enhance GPU cache performance. In this paper, we examine GPU cache access behavior and propose a simple hardware-based GPU cache bypassing method that can be applied to GPU applications without recompiling programs. Moreover, we introduce a hybrid method that integrates static profiling information and hardware-based bypassing to further enhance performance. Our experimental results reveal that hardware-based cache bypassing can boost performance for most benchmarks, and the hybrid method can achieve performance comparable to state-of-the-art compiler-based bypassing with considerably less profiling cost.

The calibration of a laser profiling system for seafloor micro-topography measurements

  • Loeffler, Kathryn R.;Chotiros, Nicholas P.
    • Ocean Systems Engineering
    • /
    • v.1 no.3
    • /
    • pp.195-205
    • /
    • 2011
  • A method for calibrating a laser profiling system for seafloor micro-topography measurements is described. The system consists of a digital camera and an arrangement of six red lasers that are mounted as a unit on a remotely operated vehicle (ROV). The lasers project as parallel planes onto the seafloor, creating profiles of the local topography that are interpreted from the digital camera image. The goal of the calibration was to determine the plane equations for the six lasers relative to the camera. This was accomplished in two stages. First, distortions in the digital image were corrected using an interpolation method based on a virtual pinhole camera model. Then, the laser planes were determined according to their intersections with a calibration target. The position and orientation of the target were obtained by a registration process. The selection of the target shape and size was found to be critical to a successful calibration at sea, due to the limitations in the manoeuvrability of the ROV.

Genomic approaches for the understanding of aging in model organisms

  • Park, Sang-Kyu
    • BMB Reports
    • /
    • v.44 no.5
    • /
    • pp.291-297
    • /
    • 2011
  • Aging is one of the most complicated biological processes in all species. A number of different model organisms from yeast to monkeys have been studied to understand the aging process. Until recently, many different age-related genes and age-regulating cellular pathways, such as insulin/IGF-1-like signal, mitochondrial dysfunction, Sir2 pathway, have been identified through classical genetic studies. Parallel to genetic approaches, genome-wide approaches have provided valuable insights for the understanding of molecular mechanisms occurring during aging. Gene expression profiling analysis can measure the transcriptional alteration of multiple genes in a genome simultaneously and is widely used to elucidate the mechanisms of complex biological pathways. Here, current global gene expression profiling studies on normal aging and age-related genetic/environmental interventions in widely-used model organisms are briefly reviewed.

Static and Dynamic Analysis of Efficiency of Korean Regional Public Hospitals (지방의료원의 효율성에 대한 정태적 및 동태적 분석)

  • Kim, Jong-Ki;Jeon, Jinh-Wan
    • Korea Journal of Hospital Management
    • /
    • v.15 no.1
    • /
    • pp.27-48
    • /
    • 2010
  • The purpose of this paper is to analyze the efficiency change and its determinants of the regional public hospitals. We utilize 34 regional public hospital's panel data for 6 years from 2003 to 2008. We use DEA(Data Envelopment Analysis)-CCR, BCC model, DEA/Window model, and DEA Profiling. The empirical results show the following findings. First, technical efficiency shows that approximately 3.6% of inefficiency exists on the regional public hospitals and it reveals that the cause for technical inefficiency is due to scale inefficiency. Second, DEA/Window results show that the stable dissimilarity by standard deviation, LDP of CCR. Third, the results of partial efficiency by DEA Profiling show that increase efficiency depends on the number of beds, doctors, and nurses.

  • PDF

Classification of the Korean Road Roughness (국내 도로면 거칠기 특성 분류 기준에 관한 연구)

  • Choi, Gyoo-Jae;Heo, Seung-Jin
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.14 no.5
    • /
    • pp.115-120
    • /
    • 2006
  • A Korean Road Roughness Classification(KRC) method is proposed. Using a dynamic road profiling device equipped with the Accelerometer Established Inertial Profiling Reference(AEIPR) method, road profile measurement is performed on various types of public paved roads in Korea. The road profiling data are processed to classify the characteristics of Korean road roughness. The resultant Korean road roughness classification(KRC) is shown different characteristics compared to the road classification proposed by ISO, MIRA, and Wong. The proposed KRC is composed of 8 classes(A-H, very good-poor) based on the power spectral density and is in good agreements with the characteristics of Korean paved road roughness and can be used well in vehicle ride comfort simulation using domestic road profile.

Insights into the signal transduction pathways of mouse lung type II cells revealed by transcription factor profiling in the transcriptome

  • Ramana, Chilakamarti V.
    • Genomics & Informatics
    • /
    • v.17 no.1
    • /
    • pp.8.1-8.10
    • /
    • 2019
  • Alveolar type II cells constitute a small fraction of the total lung cell mass. However, they play an important role in many cellular processes including trans-differentiation into type I cells as well as repair of lung injury in response to toxic chemicals and respiratory pathogens. Transcription factors are the regulatory proteins dynamically modulating DNA structure and gene expression. Transcription factor profiling in microarray datasets revealed that several members of AP1, ATF, $NF-{\kappa}B$, and C/EBP families involved in diverse responses were expressed in mouse lung type II cells. A transcriptional factor signature consisting of Cebpa, Srebf1, Stat3, Klf5, and Elf3 was identified in lung type II cells, Sox9+ pluripotent lung stem cells as well as in mouse lung development. Identification of the transcription factor profile in mouse lung type II cells will serve as a useful resource and facilitate the integrated analysis of signal transduction pathways and specific gene targets in a variety of physiological conditions.

Gene expression profiling after ochratoxin A treatment in small intestinal epithelial cells from pigs

  • Jung Woong, Yoon;Sang In, Lee
    • Journal of Animal Science and Technology
    • /
    • v.64 no.5
    • /
    • pp.842-853
    • /
    • 2022
  • Ochratoxin A (OTA) is a well-known mycotoxin that causes disease through the ingestion of contaminated food or feed, for example, in the porcine industry. The intestinal epithelium acts as the first barrier against food contamination. We conducted a study on the exposure of the porcine intestinal epithelium to OTA. We used the intestinal porcine epithelial cell line IPEC-J2 as an in vitro model to evaluate the altered molecular mechanisms following OTA exposure. Gene expression profiling revealed that OTA upregulated 782 genes and downregulated 896, totalling 1678 differentially expressed genes. Furthermore, immunofluorescence, quantitative real-time polymerase chain reaction, and western blotting confirmed that OTA damages the tight junction protein ZO-1. Moreover, OTA activated the expression of inflammatory genes (IL-6, IL-8, IL-10, NF-kB, TLR4, and TNF-α). In summary, this study confirmed that OTA alters various molecular mechanisms and has several adverse effects on IPEC-J2 cells.