• Title/Summary/Keyword: Hive

Search Result 81, Processing Time 0.028 seconds

Hierarchical Visualization of Cloud-Based Social Network Service Using Fuzzy (퍼지를 이용한 클라우드 기반의 소셜 네트워크 서비스 계층적 시각화)

  • Park, Sun;Kim, Yong-Il;Lee, Seong Ro
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.38B no.7
    • /
    • pp.501-511
    • /
    • 2013
  • Recently, the visualization method of social network service have been only focusing on presentation of visualizing network data, which the methods do not consider an efficient processing speed and computational complexity for increasing at the ratio of arithmetical of a big data regarding social networks. This paper proposes a cloud based on visualization method to visualize a user focused hierarchy relationship between user's nodes on social network. The proposed method can intuitionally understand the user's social relationship since the method uses fuzzy to represent a hierarchical relationship of user nodes of social network. It also can easily identify a key role relationship of users on social network. In addition, the method uses hadoop and hive based on cloud for distributed parallel processing of visualization algorithm, which it can expedite the big data of social network.

Big Data-based Sensor Data Processing and Analysis for IoT Environment (IoT 환경을 위한 빅데이터 기반 센서 데이터 처리 및 분석)

  • Shin, Dong-Jin;Park, Ji-Hun;Kim, Ju-Ho;Kwak, Kwang-Jin;Park, Jeong-Min;Kim, Jeong-Joon
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.19 no.1
    • /
    • pp.117-126
    • /
    • 2019
  • The data generated in the IoT environment is very diverse. Especially, the development of the fourth industrial revolution has made it possible to increase the number of fixed and unstructured data generated in manufacturing facilities such as Smart Factory. With Big Data related solutions, it is possible to collect, store, process, analyze and visualize various large volumes of data quickly and accurately. Therefore, in this paper, we will directly generate data using Raspberry Pi used in IoT environment, and analyze using various Big Data solutions. Collected by using an Sqoop solution collected and stored in the database to the HDFS, and the process is to process the data by using the solutions available Hive parallel processing is associated with Hadoop. Finally, the analysis and visualization of the processed data via the R programming will be used universally to end verification.

Development of Artificial Intelligence-based Legal Counseling Chatbot System

  • Park, Koo-Rack
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.3
    • /
    • pp.29-34
    • /
    • 2021
  • With the advent of the 4th industrial revolution era, IT technology is creating new services that have not existed by converging with various existing industries and fields. In particular, in the field of artificial intelligence, chatbots and the latest technologies have developed dramatically with the development of natural language processing technology, and various business processes are processed through chatbots. This study is a study on a system that provides a close answer to the question the user wants to find by creating a structural form for legal inquiries through Slot Filling-based chatbot technology, and inputting a predetermined type of question. Using the proposal system, it is possible to construct question-and-answer data in a more structured form of legal information, which is unstructured data in text form. In addition, by managing the accumulated Q&A data through a big data storage system such as Apache Hive and recycling the data for learning, the reliability of the response can be expected to continuously improve.

Big Data Analysis and Prediction of Traffic in Los Angeles

  • Dauletbak, Dalyapraz;Woo, Jongwook
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.2
    • /
    • pp.841-854
    • /
    • 2020
  • The paper explains the method to process, analyze and predict traffic patterns in Los Angeles county using Big Data and Machine Learning. The dataset is used from a popular navigating platform in the USA, which tracks information on the road using connected users' devices and also collects reports shared by the users through the app. The dataset mainly consists of information about traffic jams and traffic incidents reported by users, such as road closure, hazards, accidents. The major contribution of this paper is to give a clear view of how the large-scale road traffic data can be stored and processed using the Big Data system - Hadoop and its ecosystem (Hive). In addition, analysis is explained with the help of visuals using Business Intelligence and prediction with classification machine learning model on the sampled traffic data is presented using Azure ML. The process of modeling, as well as results, are interpreted using metrics: accuracy, precision and recall.

Reliability Analysis of Degradation Data Based on Accelerated Model -With Photointerrupter Used in Home VCR(Video Cassette Recorder)- (가속 모델에 기초한 열화 데이터의 신뢰성 해석 -가정용 영상 재생기에 사용되는 광센서를 중심으로-)

  • Kwon, Soo-Ho;Huh, Yang-Hyun;Lim, Tae-Jin
    • IE interfaces
    • /
    • v.12 no.3
    • /
    • pp.448-457
    • /
    • 1999
  • Accelerated degradation is concerned with models and data analyses for degradation of product performance over time at overstress and design conditions. Although there have been numerous studies with accelerated degradation theory in reliability, very few actually apply to parametric statistical analyses. This paper shows how to analyze degradation data, provides tests for how well the assumptions hold. Reel sensors, a sort of photointerrupters in home VCR, hive been tested, and least-square analyses are used to illustrate our approach. Tests for linearity of the performance-time relationship, dependence of the lognormal distribution, and the standard deviation on time are performed. The mean life of tested sensors is assessed at about 414,000 hours, and the Arrhenius activation energy of this reaction is concluded to be 0.39 eV as results.

  • PDF

Controcller design using parametric neural networks

  • HashemiNejad, M.;Murata, J.;Banihabib, M.E.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1994.10a
    • /
    • pp.616-621
    • /
    • 1994
  • Neural Networks (henceforth NNs, with adjective "artificial" implied) has been used in the field of control however, has a long way to fit to its abilities. One of the best ways to aid it is "supporting it with the knowledge about the linear classical control theory". In this regard we hive developed two kinds of parametric activation function and then used them in both identification and control strategy. Then using a nonlinear tank system we are to test its capabilities. The simulation results for the identification phase is promising. phase is promising.

  • PDF

Development of a twist-roller friction drive (트위스트 롤러를 이용한 마찰구동기구의 개발)

  • 신영재;이후상;황주호
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 1996.11a
    • /
    • pp.658-661
    • /
    • 1996
  • For ultraprecision positioning, the use of the twist roller-type friction drive is proposed. In our study, it is difficult to decrease the resolution of positioning below 100 nm when we use general servo motors. Therefore we propose the feed hive with a small lead like a the cam-roller type traction drive leadscrew and modify it more accurately. By using the semi-loop control system, the positioning resolution of the drive can be 22.4 nm, where the pulse per revolution of the motor is 655360 and the the lead is 0.734 mm.

  • PDF

Design of High-Speed Brushless DC Motor for Turbo-Compressor (터보 압축기용 초고속 브러시리스 DC 전동기의 설계)

  • Jang Seok-Myeong;Cho Han-Wook;Choi Jang-Young;Choi Sang-Kyu;Jeong Yeon-Ho
    • The Transactions of the Korean Institute of Electrical Engineers B
    • /
    • v.54 no.6
    • /
    • pp.278-286
    • /
    • 2005
  • Recently, high-speed centrifugal turbo-compressors have been under intensive research and development. Since, compared to conventional compressors, high-speed centrifugal compressors hive numerous qualities such as simple structure, light weight small size, and high efficiency, etc. In cope with such industrial demands, a high-speed brushless DC motor for a 50-kW, 70-krpm turbo-compressor was developed based on a 2-D analytical method, of which design was verified using the FE analysis. A prototype machine was also fabricated and tested to confirm the analytical design. Preliminarily obtained experimental data using the prototype mac]line shows the validity of the analytical approach.

Design and Implementation of an Integrated Streaming Service Architecture (통합 스트리밍 서비스 구조 설계 및 구현)

  • 이승룡;홍충선
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.26 no.6A
    • /
    • pp.1019-1033
    • /
    • 2001
  • 본 논문에서는 멀티미디어 스트리밍을 위한 표준 프로토콜과 미디어 포맷을 지원하고, 실시간 객체지향형 멀티미디어 데이터베이스(BeeHive)를 지원하는 통합 멀티미디어 스트리밍 서비스 프레임워크(ISSA)를 제안한다. ISSA의 핵심 구성요소는 세션의 생성과 스트림 제어를 담당하는 세션 관리자, 스트리밍 데이터의 전송을 담당하는 전송 관리자, 미디어의 압축과 복원 및 재생을 담당하는 미디어 관리자, 그리고 데이터베이스와의 연동을 담당하는 데이터베이스 커넥터이다. ISSA는 스트림의 제어를 위하여 IETF에서 제안한 RTSP, 스트림과 세션의 표현과 초기화를 위해 SDP와 SIP, 스트림 데이터의 실시간 전송을 위하여 RTP 및 TCP, UDP를 지원한다. 또한, ISSA는 VOD, MOD, 웹캐스팅을 위한 개발과 라이브러리를 제공하며, 웹서버와 CORBA A/V 스트리밍 서비스와의 연동을 위한 게이트웨이도 제공한다. ISSA는 운영체제 환경에서 플랫폼에 독립적으로 작동하고, 객체지향 멀티미디어 데이터베이스 서비스를 지원한다. 그리고 멀티캐스팅, 웹캐스팅, 멀티미디어 통신을 위한 표준 프로토콜을 지원하며, 상용 코덱인 Microsoft 사의 Direct Show를 지원할 수 있는 RTP 소스필터를 가지고 있다. 마지막으로, 기존의 다양한 표준 미디어 포맷을 지원할 뿐만 아니라, 새로운 미디어 포맷도 쉽게 수용할 수 있도록 설계되어 있다.

  • PDF

Development of Single-stage Power Factor Corrected Converter for Single-Phase SRM Drive (단상 SRM 구동을 위한 1단 방식 역률보상형 컨버터 개발)

  • 빈재구;이정한;조승현;박성준;김철우
    • The Transactions of the Korean Institute of Power Electronics
    • /
    • v.8 no.6
    • /
    • pp.519-526
    • /
    • 2003
  • A singl-phase power factor corrected converter for switched reluctance motor hive is presented to achieve a sinusoidal and new unity power factor input currents. Because it combines a power factor corrected converter and a conventional asymmetric SRM driver into one power stage, the configuration has a simple structure resulted in low cost. A prototype to drive 6/6 poles SRM employing a parking magnet Is designed to evaluate the proposed topology. The characteristics and operational mode will be discussed in depth, and the validity of proposed driver will be verified through the experimental results.