• 제목/요약/키워드: Large-scale database

검색결과 299건 처리시간 0.027초

하둡 기반의 효율적인 보안로그 분석시스템 설계 및 구현 (Design and Implementation of a Hadoop-based Efficient Security Log Analysis System)

  • 안광민;이종윤;양동민;이봉환
    • 한국정보통신학회논문지
    • /
    • 제19권8호
    • /
    • pp.1797-1804
    • /
    • 2015
  • 통합로그관리시스템은 보안 위험 사항을 예측하고 기관의 보안성 향상에 기여하여 적합한 보안 정책을 마련할 수 있도록 도와준다. 본 논문에서는 대용량의 로그 데이터를 저장할 수 있는 분산 데이터베이스 모델과 로그 수집 절차를 자동화하여 분석 시간을 줄일 수 있는 하둡 기반의 로그 분석 시스템을 설계하고 구현하였다. 제안하는 시스템에서는 HBase를 사용하여 데이터 용량에 따라 Scale-Out 방식으로 유연하게 저장할 수 있게 하였고 정규식을 이용하여 분석에 용이한 저장 기법을 제안하여 기존 시스템 대비 분석 속도를 높일 수 있다.

An Estimation Method of Representative Humanoids for Digital Human Simulation

  • Jung, Kihyo
    • 대한인간공학회지
    • /
    • 제32권3호
    • /
    • pp.237-243
    • /
    • 2013
  • Objective: The present study developed an estimation method of boundary zone representative humanoids(hereafter, EBZ method) using descriptive statistics on the design target population. Background: The boundary zone method(hereafter, BZ method) generates representative humanoids at a boundary zone that statistically accommodates a designated percent of the design target population; however, the BZ method has a practical limitation because it requires a large scale anthropometric database on the design target population. Method: The EBZ method developed in the present study consisted of 3 steps. In the first step, the boundary zone of accommodating a designated percent(e.g., 90%) is formed under the assumption of normal distributions for anthropometric sizes. In the second step, cases that fall within the boundary zone are estimated using descriptive statistics(mean, standard deviation, and covariance) on the design target population. In the last step, K-mean cluster analysis is conducted for the cases, and representative humanoids are selected from each of clusters. Results: Evaluation results showed that mean accommodation percent of the EBZ method was 90.9%(range: 90.8~91.1%) which is similar to the target percent(90%). In addition, standard deviation of accommodation percent for 100 repetitions was 0.1%. Lastly, the number of representative humanoids generated by the EBZ method(n = 20) was similar to the BZ method(n = 16). Conclusion: The EBZ method can generate representative humanoids which accommodate a designated percent of the design target population using descriptive statistics. Application: The EBZ method can be utilized in the generation of humanoids for ergonomic design and evaluation of products when the large scale anthropometric database on the design target population is not existed.

국내 학술논문 저자명 전거데이터 구축 방안에 관한 연구 (A Study on the Construction for Name Authority Data of the Korean Academic Papers)

  • 이석형;곽승진
    • 한국비블리아학회지
    • /
    • 제21권1호
    • /
    • pp.105-118
    • /
    • 2010
  • 본 연구의 목적은 국내 학술지, 회의자료 등 학술논문에 나타나는 저자명을 중심으로 저자명 전거데이터를 구축하기 위한 방안과 이를 적용한 전거데이터 구축시스템을 제시하는데 있다. 학술논문 저자명 전거데이터를 구축하기 위해 저자명 식별 요소를 분석하고 이를 토대로 저자 식별방법을 제안하였으며, 국내 학술논문의 저자명을 대상으로 실제 저자명 전거레코드를 구성하였다. 또한, 학술논문의 입수주기 및 규모를 고려하여 학술정보 데이터베이스구축과 동시에 전거데이터가 구축, 관리되고 학술정보 서비스와 연계될 수 있도록 학술논문 관리시스템과 서비스시스템과 본 연구의 제안 시스템이 상호 연계성을 가질 수 있도록 설계되었다.

Seismic fragility assessment of isolated structures by using stochastic response database

  • Eem, Seung-Hyun;Jung, Hyung-Jo
    • Earthquakes and Structures
    • /
    • 제14권5호
    • /
    • pp.389-398
    • /
    • 2018
  • The seismic isolation system makes a structure isolated from ground motions to protect the structure from seismic events. Seismic isolation techniques have been implemented in full-scale buildings and bridges because of their simplicity, economic effectiveness, inherent stability and reliability. As for the responses of an isolated structure due to seismic events, it is well known that the most uncertain aspects are the seismic loading itself and structural properties. Due to the randomness of earthquakes and uncertainty of structures, seismic response distributions of an isolated structure are needed when evaluating the seismic fragility assessment (or probabilistic seismic safety assessment) of an isolated structure. Seismic response time histories are useful and often essential elements in its design or evaluation stage. Thus, a large number of non-linear dynamic analyses should be performed to evaluate the seismic performance of an isolated structure. However, it is a monumental task to gather the design or evaluation information of the isolated structure from too many seismic analyses, which is impractical. In this paper, a new methodology that can evaluate the seismic fragility assessment of an isolated structure is proposed by using stochastic response database, which is a device that can estimate the seismic response distributions of an isolated structure without any seismic response analyses. The seismic fragility assessment of the isolated nuclear power plant is performed using the proposed methodology. The proposed methodology is able to evaluate the seismic performance of isolated structures effectively and reduce the computational efforts tremendously.

A Flash-based B+-Tree using Sibling-Leaf Blocks for Efficient Node Updates and Range Searches

  • Lim, Seong-Chae
    • International Journal of Internet, Broadcasting and Communication
    • /
    • 제8권3호
    • /
    • pp.12-24
    • /
    • 2016
  • Recently, as the price per bit is decreasing at a fast rate, flash memory is considered to be used as primary storage of large-scale database systems. Although flash memory shows off its high speeds of page reads, however, it has a problem of noticeable performance degradation in the presence of increasing update workloads. When updates are requested for pages with random page IDs, in particular, the shortcoming of flash tends to impair significantly the overall performance of a flash-based database system. Therefore, it is important to have a way to efficiently update the B+-tree, when it is stored in flash storage. This is because most of updates in the B+-tree arise at leaf nodes, whose page IDs are in random. In this light, we propose a new flash B+-tree that stores up-to-date versions of leaf nodes in sibling-leaf blocks (SLBs), while updating them. The use of SLBs improves the update performance of B-trees and provides the mechanism for fast key range searches. To verify the performance advantages of the proposed flash B+-tree, we developed a mathematical performance evaluation model that is suited for assessing B-tree operations. The performance comparisons from it show that the proposed flash B+-tree provides faster range searches and reduces more than 50% of update costs.

A data management system for microbial genome projects

  • Ki-Bong Kim;Hyeweon Nam;Hwajung Seo and Kiejung Park
    • 한국생물정보학회:학술대회논문집
    • /
    • 한국생물정보시스템생물학회 2000년도 International Symposium on Bioinformatics
    • /
    • pp.83-85
    • /
    • 2000
  • A lot of microbial genome sequencing projects is being done in many genome centers around the world, since the first genome, Haemophilus influenzae, was sequenced in 1995. The deluge of microbial genome sequence data demands new and highly automatic data flow system in order for genome researchers to manage and analyze their own bulky sequence data from low-level to high-level. In such an aspect, we developed the automatic data management system for microbial genome projects, which consists mainly of local database, analysis programs, and user-friendly interface. We designed and implemented the local database for large-scale sequencing projects, which makes systematic and consistent data management and retrieval possible and is tightly coupled with analysis programs and web-based user interface, That is, parsing and storage of the results of analysis programs in local database is possible and user can retrieve the data in any level of data process by means of web-based graphical user interface. Contig assembly, homology search, and ORF prediction, which are essential in genome projects, make analysis programs in our system. All but Contig assembly program are open as public domain. These programs are connected with each other by means of a lot of utility programs. As a result, this system will maximize the efficiency in cost and time in genome research.

  • PDF

클라우드 기반 센서 데이터 관리 시스템 설계 및 구현 (Design and Implementation of Cloud-based Sensor Data Management System)

  • 박경욱;김경옥;반경진;김응곤
    • 한국전자통신학회논문지
    • /
    • 제5권6호
    • /
    • pp.672-677
    • /
    • 2010
  • 최근 대규모 센서 네트워크의 구축이 증가하면서 대규모의 센서 데이터를 효율적으로 관리하는 시스템이 요구되고 있다. 본 논문에서는 저비용, 높은 확장성 그리고 고 효율성을 지닌 클라우드 기반의 센서 데이터 관리 시스템을 제안한다. 제안된 시스템에서는 센서 데이터는 클라우드 게이트웨이를 통해 클라우드로 전송되며 이때 이상상황 검출과 이벤트 처리가 수행된다. 클라우드로 전송된 센서 데이터는 분산 컬럼 지향 데이터 베이스인 하둡 HBase에 저장되며 맵리듀스 모델 기반의 질의처리 모듈을 통해 병렬 처리된다. 처리된 결과는 REST 기반의 웹서비스를 통해 제공되므로 다양한 플랫폼의 응용프로그램과 연동이 가능하다.

방사선 검사 관련 의료장비와 PACS 간의 연동을 위한 DICOM 및 Non-DICOM 인터페이스 방안 (Methods of DICOM and Non-DICOM Interfacing for various Radiological Equipments with PACS)

  • 김현철
    • 대한디지털의료영상학회논문지
    • /
    • 제6권1호
    • /
    • pp.51-64
    • /
    • 2003
  • This thesis describes the effective interfacing methods of PACS Modality based on the system installation andoperating experiences. PACS(Picture Archiving and Communication Systems) is a system for medical image archiving and communication using large storage device and high-speed network. The standard communication protocol of PACS is DICOM(Digital Imaging and Communication in Medicine) based on TCP/IP and point-to-point protocol. However, there are many Non-DICOM Modalities and DICOM Modalities having problems. First, we had interfaced almost modalities. Fuji CR, GE CT, MRI, Angio, Fluoro, Phillips Angio, Shimadzu Fluoro. Ultrasound PACS, with the main PACS in the Seoul S Hospital as large scale hospital. And we manipulated the intelligent image distribution and the CT. MRI Interfaces never experienced beforein the Anyang J Hospital and the Chungju C Hospital as mid or small scale hospital. Technically, we developed both the DICOM Interface and the Non-DICOM Interface. At the last, the DICOM Worklist and the DICOM Print Interface were implemented in the Seoul B Hospital, the Bucheon SJ Hospital and the Seoul K Hospital independently with PACS. The Oracle, Sybase and MS-SQL are used as database, and UNIX, Macintosh, MS Windows as operating systems. And the Visual C++ and UNIX C are the main programming tools. We have used UTP, coaxial and fiber optic cable under 10/100 mbps LAN for networking.

  • PDF

방사선 검사 관련 의료장비와 PACS 간의 연동을 위한 DICOM 및 Non-DICOM 인터페이스 방안 (Methods of DICOM and Non-DICOM Interfacing for various Radiological Equipments with PACS)

  • 김현철
    • 대한디지털의료영상학회논문지
    • /
    • 제5권1호
    • /
    • pp.46-63
    • /
    • 2002
  • This thesis describes the effective interfacing methods of PACS Modality based on the system installation and operating experiences. PACS(Picture Archiving and Communication Systems) is a system for medical image archiving and communication using large storage device and high-speed network. The standard communication protocol of PACS is DICOM(Digital Imaging and Communication in Medicine) based on TCP/IP and point-to-point protocol. However, there are many Non-DICOM Modalities and DICOM Modalities having problems. First, we had interfaced almost modalities, Fuji CR, GE CT, MRI, Angio, Fluoro, Phillips Angio, Shimadzu Fluoro, Ultrasound PACS, with the main PACS in the Seoul S Hospital as large scale hospital. And we manipulated the intelligent image distribution and the CT, MRI Interfaces never experienced before in the Anyang J Hospital and the Chungju C Hospital as mid or small scale hospital. Technically, we developed both the DICOM Interface and the Non-DICOM Interface. At the last, the DICOM Worklist and the DICOM Print Interface were implemented in the Seoul B Hospital, the Bucheon SJ Hospital and the Seoul K Hospital independently with PACS. The Oracle, Sybase and MS-SQL are used as database, and UNIX, Macintosh, MS Windows as operating systems. And the Visual C++ and UNIX C are the main programming tools. We have used UTP, coaxial and fiber optic Gable under 10/100 mbps LAN for networking.

  • PDF

Space-Time Characteristics of the Wall Shear-Stress Fluctuations in an Axial Turbulent Boundary Layer with Transverse Curvature

  • Shin, Dong-Shin;Lee, Seung-Bae;Na, Yang
    • Journal of Mechanical Science and Technology
    • /
    • 제19권8호
    • /
    • pp.1682-1691
    • /
    • 2005
  • Direct numerical simulation database of an axial turbulent boundary layer is used to compute frequency and wave number spectra of the wall shear-stress fluctuations in a low-Reynolds number axial turbulent boundary layer. One-dimensional and two-dimensional power spectra of flow variables are calculated and compared. At low wave numbers and frequencies, the power of streamwise shear stress is larger than that of spanwise shear stress, while the powers of both stresses are almost the same at high wave numbers and frequencies. The frequency/streamwise wave number spectra of the wall flow variables show that large-scale fluctuations to the rms value is largest for the stream wise shear stress, while that of small-scale fluctuations to the rms value is largest for pressure. In the two-point auto-correlations, negative correlation occurs in streamwise separations for pressure, and in span wise correlation for both shear stresses.