• Title/Summary/Keyword: Structured Data

Search Result 4,007, Processing Time 0.027 seconds

Analysis of the Influence Factors of Data Loading Performance Using Apache Sqoop (아파치 스쿱을 사용한 하둡의 데이터 적재 성능 영향 요인 분석)

  • Chen, Liu;Ko, Junghyun;Yeo, Jeongmo
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.4 no.2
    • /
    • pp.77-82
    • /
    • 2015
  • Big Data technology has been attracted much attention in aspect of fast data processing. Research of practicing Big Data technology is also ongoing to process large-scale structured data much faster in Relatioinal Database(RDB). Although there are lots of studies about measuring analyzing performance, studies about structured data loading performance, prior step of analyzing, is very rare. Thus, in this study, structured data in RDB is tested the performance that loads distributed processing platform Hadoop using Apache sqoop. Also in order to analyze the influence factors of data loading, it is tested repeatedly with different options of data loading and compared with data loading performance among RDB based servers. Although data loading performance of Apache Sqoop in test environment was low, but in large-scale Hadoop cluster environment we can expect much better performance because of getting more hardware resources. It is expected to be based on study improving data loading performance and whole steps of performance analyzing structured data in Hadoop Platform.

A Study on the Relative Localization Algorithm for Mobile Robots using a Structured Light Technique (Structured Light 기법을 이용한 이동 로봇의 상대 위치 추정 알고리즘 연구)

  • Noh Dong-Ki;Kim Gon-Woo;Lee Beom-Hee
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.11 no.8
    • /
    • pp.678-687
    • /
    • 2005
  • This paper describes a relative localization algorithm using odometry data and consecutive local maps. The purpose of this paper is the odometry error correction using the area matching of two consecutive local maps. The local map is built up using a sensor module with dual laser beams and USB camera. The range data form the sensor module is measured using the structured lighting technique (active stereo method). The advantage in using the sensor module is to be able to get a local map at once within the camera view angle. With this advantage, we propose the AVS (Aligned View Sector) matching algorithm for. correction of the pose error (translational and rotational error). In order to evaluate the proposed algorithm, experiments are performed in real environment.

Study on the Application Methods of Big Data at a Corporation -Cases of A and Y corporation Big Data System Projects- (기업의 빅데이터 적용방안 연구 -A사, Y사 빅데이터 시스템 적용 사례-)

  • Lee, Jae Sung;Hong, Sung Chan
    • Journal of Internet Computing and Services
    • /
    • v.15 no.1
    • /
    • pp.103-112
    • /
    • 2014
  • In recent years, the rapid diffusion of smart devices and growth of internet usage and social media has led to a constant production of huge amount of valuable data set that includes personal information, buying patterns, location information and other things. IT and Production Infrastructure has also started to produce its own data with the vitalization of M2M (Machine-to-Machine) and IoT (Internet of Things). This analysis study researches the applicable effects of Structured and Unstructured Big Data in various business circumstances, and purposes to find out the value creation method for a corporation through the Structured and Unstructured Big Data case studies. The result demonstrates that corporations looking for the optimized big data utilization plan could maximize their creative values by utilizing Unstructured and Structured Big Data generated interior and exterior of corporations.

An Experimental Study on the Effects of Structured Preoperative Teaching on Postoperative Recovery (계획된 수술전 교육이 수술후 회복에 미치는 영향에 관한 임상실험적 연구)

  • 김명숙
    • Journal of Korean Academy of Nursing
    • /
    • v.14 no.2
    • /
    • pp.38-46
    • /
    • 1984
  • The purpose of this study was to test the effect of the structured preoperative teaching on post-operative recovery and to observe the effects of an structured preoperative teaching on the adult surgical patient's ventilatory function ability, the length of hospital stay, the number of analgesics within a 72 hour postoperative period, the length of early ambulation. The research question investigated in this study was: What would be the effects of a structured preoperative teaching upon the adult surgical patients postoperative recovery? This study was based on a sample of 40 patients who were scheduled for abdominal surgery. They were asssigned alternately to experimental and control group. Among 40 subjects, 20 were placed in the experimental group and 20 in the control group. Preoperative ventilation function testing of control and experimental subjects was done the evening before surgery and before the patient received the structured preoperative teaching. A structured preoperative teaching was given to the subjects in the exporimental group only by writer. Postoperative testing was done the 5th postoperative day. The data were collected over a period of two months, from Aug. 8 to Oct. 31, 1983. For the analysis of the data and test for the hypotheses, the t-test with mean difference was used. The results of this study regarding the four-hypotheses were as follows: 1. Experimental group which received structured preoperative eaching will have more increase to-cough and deep breathe as measured byhis forced vital capacity(FVC), forced expiratory volume 1 (FEV1), maximal voluntary volume 15 (MVV 15) than control group without structured preoperative teaching. The ventilation function ability was more increase in experimental group than in control group, the mean difference was statistically significant at 0.01 level. Hypotheses 1 was supported. 2. Experimental group with structured preoperative teaching will have more reduced the length of hospital stay than control group without structured preoperative teaching. The length of hospital stay of the experimental group and control group were 11.90 days and 16.05 days respectively. However, the difference was. not statistically significant at .05 level. Therefore the hypothese 2 was not supported. 3. Experimental group with structured preoperative teaching will have more reduce the number of analgesics within a 72 hour postoperative period than control group. The number of analgesics within a 72 hour' postoperative period of experimental group and control group were 1.65 times and 2.4 times. The difference was not statically significant at .05 level. Therefore, the hypotheses 3 was not supported. 4. Experimental group with structured preoperative. teaching will have more reduce the length of early ambulation than control group without structured preoperative teaching. The length of early ambulation of experimental group and control group were 2.2 days and 3.5 days respectively The difference was statistically signficant at 0.05 level. Thus the hypothess 4 was supported.

  • PDF

An effective approach to generate Wikipedia infobox of movie domain using semi-structured data

  • Bhuiyan, Hanif;Oh, Kyeong-Jin;Hong, Myung-Duk;Jo, Geun-Sik
    • Journal of Internet Computing and Services
    • /
    • v.18 no.3
    • /
    • pp.49-61
    • /
    • 2017
  • Wikipedia infoboxes have emerged as an important structured information source on the web. To compose infobox for an article, considerable amount of manual effort is required from an author. Due to this manual involvement, infobox suffers from inconsistency, data heterogeneity, incompleteness, schema drift etc. Prior works attempted to solve those problems by generating infobox automatically based on the corresponding article text. However, there are many articles in Wikipedia that do not have enough text content to generate infobox. In this paper, we present an automated approach to generate infobox for movie domain of Wikipedia by extracting information from several sources of the web instead of relying on article text only. The proposed methodology has been developed using semantic relations of article content and available semi-structured information of the web. It processes the article text through some classification processes to identify the template from the large pool of template list. Finally, it extracts the information for the corresponding template attributes from web and thus generates infobox. Through a comprehensive experimental evaluation the proposed scheme was demonstrated as an effective and efficient approach to generate Wikipedia infobox.

Development of 3D Scanner Based on Laser Structured-light Image (레이저 구조광 영상기반 3차원 스캐너 개발)

  • Ko, Young-Jun;Yi, Soo-Yeong;Lee, Jun-O
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.22 no.3
    • /
    • pp.186-191
    • /
    • 2016
  • This paper addresses the development of 3D data acquisition system (3D scanner) based laser structured-light image. The 3D scanner consists of a stripe laser generator, a conventional camera, and a rotation table. The stripe laser onto an object has distortion according to 3D shape of an object. By analyzing the distortion of the laser stripe in a camera image, the scanner obtains a group of 3D point data of the object. A simple semiconductor stripe laser diode is adopted instead of an expensive LCD projector for complex structured-light pattern. The camera has an optical filter to remove illumination noise and improve the performance of the distance measurement. Experimental results show the 3D data acquisition performance of the scanner with less than 0.2mm measurement error in 2 minutes. It is possible to reconstruct a 3D shape of an object and to reproduce the object by a commercially available 3D printer.

Experimental Estimation of Data Flow Diagram for Man/Month Prediction Model Derivation (공수 예측 모델 요도를 위한 자료 흐름도의 실험적 평가)

  • Kim, Myeong-Ok;Baek, Cheong-Ho;Yang, Hae-Sul
    • The Transactions of the Korea Information Processing Society
    • /
    • v.2 no.1
    • /
    • pp.34-44
    • /
    • 1995
  • One of the most important problems faced by software developers and users is the prediction of the size of programming system and its development effort. This article define the identical characteristics for structured specification which is consisted of Data Flow Diagram, Data Dictionary and Mini Specification and apply quantitative estimation factor of structured specification to program code metrics, Moreover, concerning DFD which is made up of component element of structured specification executed quantitative estimation experiment. In the result, we propose man/month prediction model of lower progression with production on analysis phase of upper progression.

  • PDF

The Structured Grid Calibration Based On Triangulation Method (삼각법을 기반으로 한 구조화된 격자 캘리브레이션)

  • KIM EUN-SEOK;JOO KI-SEE;WANG GI-NAM
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2002.05a
    • /
    • pp.248-252
    • /
    • 2002
  • Many sensors such as a structured grid pattern generator, a laser, and CCD camera to information have been used, but most of algorithms for a calibration are inefficient memory and experiment data are required. In this paper, the calibration algorithm of a structured grid pattern based on triang is introduced to calculate 3D information in the real world. The beams generated from str pattern generator established horizontally with the CCD camera are projected on the calibn CCD camera observes the intersection plane of a light and an object plane. The 3D infon calculated using observed and calibration data. This proposed method in this paper has advantages such as a memory saving and an experimental data since the 3D information are obtained simply triangulation method.

  • PDF

A Structured Method of User Data for User Interface Design in Home Network (홈 네트워크에서 UI 디자인을 위한 사용자 데이터 구조화에 관한 연구)

  • Jung, Ji-Hong;Kim, R.Young-Chul;Pan, Young-Hwan
    • Journal of the Ergonomics Society of Korea
    • /
    • v.26 no.2
    • /
    • pp.61-66
    • /
    • 2007
  • The networked home is connected to the external world using a high speed network. The devices inside the house are connected using a wired and wireless network. Acquiring the user data is an essential step for designing the user interface in user centered design. In networked home, the numbers of use cases are exponentially increased because connected use cases are considered. Because the user data for networked home are too complicated, they are acquired and analyzed by a structured methodology. We surveyed 40 people to acquire the context data home and analyzed by 5W1H (Who, Where, What, When, Why, How). We established a framework for the user data using tasks, user, time, space, objects and environment. The data for home context was structured by our framework. This framework makes simple the home context and is helpful for user interface design in home network.

A Study on Information Linkage Service for Disaster Situation Management : Focusing on Earthquake (재난 상황관리를 위한 재난안전정보 연계 서비스 방안 연구 : 지진을 중심으로)

  • Yu, Eun-Ji;Shim, Hyoung Seop
    • Journal of Digital Contents Society
    • /
    • v.19 no.1
    • /
    • pp.67-73
    • /
    • 2018
  • Researchers have increased their interest in effectively managing the disaster that appear in large scale and complex form. There are two types of disaster information, which are unstructured text data and structured data. Unstructured text data usually refers to text documents that have been referenced by disaster management personnel such as disaster manuals and related regulations, while structured data refers to various disaster information build in the disaster related organization system. This paper proposes a methodology of constructing a disaster information sharing system that enables joint use of disaster related organizations through the establishment of a mutual linkage system by utilizing both unstructured and structured form of disaster information. Especially, Based on the linkage information between structured earthquake information in earthquake related system and earthquake manuals and countermeasures against earthquake disaster, we propose a service that provides the necessary information for earthquake management. It is expected that the task manager will perform effective earthquake state management by acquiring the integrated structured and unstructured earthquake information of the ministries and related organizations.