• Title/Summary/Keyword: distributed visualization

Search Result 133, Processing Time 0.026 seconds

A Security Log Analysis System using Logstash based on Apache Elasticsearch (아파치 엘라스틱서치 기반 로그스태시를 이용한 보안로그 분석시스템)

  • Lee, Bong-Hwan;Yang, Dong-Min
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.22 no.2
    • /
    • pp.382-389
    • /
    • 2018
  • Recently cyber attacks can cause serious damage on various information systems. Log data analysis would be able to resolve this problem. Security log analysis system allows to cope with security risk properly by collecting, storing, and analyzing log data information. In this paper, a security log analysis system is designed and implemented in order to analyze security log data using the Logstash in the Elasticsearch, a distributed search engine which enables to collect and process various types of log data. The Kibana, an open source data visualization plugin for Elasticsearch, is used to generate log statistics and search report, and visualize the results. The performance of Elasticsearch-based security log analysis system is compared to the existing log analysis system which uses the Flume log collector, Flume HDFS sink and HBase. The experimental results show that the proposed system tremendously reduces both database query processing time and log data analysis time compared to the existing Hadoop-based log analysis system.

Analysis of Three-Dimensional Profile of Bacterial Colony and Visualization of Fluidic Biofilm Using Fluorescent Microbeads (형광 미세입자를 이용한 박테리아 군집의 3차원 형상 분석 및 유동성 생물막의 가시화)

  • Kim, Kyung-Hoon;Park, Eun-Jung;Kim, Jung-Kyung
    • Transactions of the Korean Society of Mechanical Engineers B
    • /
    • v.36 no.11
    • /
    • pp.1119-1126
    • /
    • 2012
  • The collective behavior of bacteria plays an important role in biofilm development. In this study, the fluidic properties of biofilms formed in Escherichia coli (E. coli) and Bacillus subtilis (B. subtilis) colonies were compared by visualizing 200-nm fluorescent beads that were initially embedded in an agar plate and distributed spontaneously on the upper surface of the growing colonies. We conducted experiments to measure the three-dimensional profile of the E. coli colony using fluorescent microbeads that did not flow in the colony. Vortical flow patterns near the edge of the B. subtilis colony were observed clearly by tracking the movement of the beads in the biofilm of the colony. The present study should be the first step toward determining the effect of fluidic biofilms on the growth and swarming dynamics of bacteria.

Design of a Disaster Big Data Platform for Collecting and Analyzing Social Media (소셜미디어 수집과 분석을 위한 재난 빅 데이터 플랫폼의 설계)

  • Nguyen, Van-Quyet;Nguyen, Sinh-Ngoc;Nguyen, Giang-Truong;Kim, Kyungbaek
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2017.04a
    • /
    • pp.661-664
    • /
    • 2017
  • Recently, during disasters occurrence, dealing with emergencies has been handled well by the early transmission of disaster relating notifications on social media networks (e.g., Twitter or Facebook). Intuitively, with their characteristics (e.g., real-time, mobility) and big communities whose users could be regarded as volunteers, social networks are proved to be a crucial role for disasters response. However, the amount of data transmitted during disasters is an obstacle for filtering informative messages; because the messages are diversity, large and very noise. This large volume of data could be seen as Social Big Data (SBD). In this paper, we proposed a big data platform for collecting and analyzing disasters' data from SBD. Firstly, we designed a collecting module; which could rapidly extract disasters' information from the Twitter; by big data frameworks supporting streaming data on distributed system; such as Kafka and Spark. Secondly, we developed an analyzing module which learned from SBD to distinguish the useful information from the irrelevant one. Finally, we also designed a real-time visualization on the web interface for displaying the results of analysis phase. To show the viability of our platform, we conducted experiments of the collecting and analyzing phases in 10 days for both real-time and historical tweets, which were about disasters happened in South Korea. The results prove that our big data platform could be applied to disaster information based systems, by providing a huge relevant data; which can be used for inferring affected regions and victims in disaster situations, from 21.000 collected tweets.

Landscape Information Visualization of Landscape Potential Index in Hilly Openspace Conservation of Urban Fringe Area (도시주변 녹지경관의 보전.관리에 있어 경관잠재력 지표의 경관정보화와 가시화 연구)

  • Cho, Tong-Buhm
    • Journal of Korean Society of Rural Planning
    • /
    • v.7 no.1 s.13
    • /
    • pp.37-48
    • /
    • 2001
  • The purpose of this study is to suggest the landscape potential index for visualizing landscape information in the conservation of hilly landscape in urban fringe. For the visual and quantitative approach to topological landscape assessment, numerical entity data of DEM(digital elevation model) were processed with CAD-based utilities that we developed and were mainly focused on analysis of visibility and visual sensitivity. Some results, with reference in assessing greenbelt area of Eodeung Mt. in Gwangju, proved to be considerable in the landscape assessment of suburban hilly landscapes. 1) Since the viewpoints and viewpoint fields were critical to landscape structure, randomized 194 points(spatially 500m interval) were applied to assessing the generalized visual sensitivity, we called. Because there were similar patterns of distribution comparing to those by 56 points and 18 Points given appropriately, it could be more efficient by a few viewpoints which located widely. 2) Regressional function was derived to represent the relationships between probabilities of visibility frequency and the topological factors(topological dominance, landform complexity and relational aspect) of target field. 3) Visibility scores of each viewpoint were be calculated by summing the visual sensitivity indices within a scene. The scores to the upper part including ridge line have been more representative to overall distributions of visual sensitivities. Also, with sum of deviations of sensitivity indices from each single point's specific index to the weighting values of view points could be estimated rotationally. 4) The deviational distributions of visual sensitivity classes in the topological unit of target field were proved to represent the visual vulnerability of the landform. 5) Landscape potential indices combined with the visual sensitivity and the DGN(degree of green naturality) were proposed as visualized landscape information distributed by topological unit.

  • PDF

A Study of the UML modeling and simulation for an analysis and design of the reconnaissance UAV system (정찰용 무인기 체계 분석/설계를 위한 UML 모델링 및 시뮬레이션 연구)

  • Kim, Cheong-Young;Park, Young-Keun;Lee, Jun-Kyu;Kim, Myun-Yeol;Reu, Tae-Kyu
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.36 no.11
    • /
    • pp.1112-1120
    • /
    • 2008
  • The real-time distributed simulation at the present age concentrates on the construction of a system development environment in order to accomplish a synthetic battlefield environment connected with Live-Virtual-Constructive simulation and to realize the Simulation Based Acquisition which supports the life cycle of weapon system. Accordingly this paper describes the development environment of the UML modeling and simulation which integrates the system analysis and design methods performed during the conceptual design phase of the reconnaissance UAV system development. An integrated framework linked with the UML simulation and X-plane visualization is suggested to efficiently perform the system analysis and design, and finally the implementation contents, the analysis of experiment results and concluding remarks are described.

Web based 3-D Medical Image Visualization System on the PC (웹 기반 3차원 의료모델 시각화 시스템)

  • Kim, Nam-Kug;Lee, Dong-Hyuk;Kim, Jong-Hyo;Kang, Heung-Sik;Min, Byung-Goo;Kim, Young-Ho
    • Proceedings of the KOSOMBE Conference
    • /
    • v.1997 no.11
    • /
    • pp.201-205
    • /
    • 1997
  • With the recent advance of Web and its associated technologies, information sharing on distribute computing environments has gained a great amount of attention from many researchers in many application areas, such as medicine, engineering, and business. One basic requirement of distributed medical consultation systems is that geographically dispersed, disparate participants are allowed to exchange information readily with each other. Such software also needs to be supported on a broad range of computer platforms to increase the software's accessibility. In this paper, the development of world-wide-web based medical consultation system or radiology imaging is addressed to provide the platform independence and great accessibility. The system supports sharing of 3-dimensional objects. We use VRML (Virtual Reality Modeling Language), which is the de-facto standard in 3-D modeling on the Web. 3-D objects are reconstructed from CT or MRI volume data using a VRML format, which can be viewed and manipulated easily in Web-browsers with a VRML plug-in. A Marching cubes method is used in the transformation of scanned volume data set to polygonal surfaces of VRML. A decimation algorithm is adopted to reduce the number of meshes in the resulting VRML file. 3-D volume data are often very large-sized, and hence loading the data on PC level computers requires a significant reduction of the size of the data, while minimizing the loss of the original shape information. This is also important to decrease network delays. A prototype system has been implemented (http://netopia.snu.ac.kr/-cyber/). and several sessions of experiments are carried out.

  • PDF

Performance Evaluation of Medical Big Data Analysis based on RHadoop (RHadoop 기반 보건의료 빅데이터 분석의 성능 평가)

  • Ryu, Woo-Seok
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.13 no.1
    • /
    • pp.207-212
    • /
    • 2018
  • As a data analysis tool which is becoming popular in the Big Data era, R is rapidly expanding its user range by providing powerful statistical analysis and data visualization functions. Major advantage of R is its functional scalability based on open source, but its scale scalability is limited, resulting in performance degrades in large data processing. RHadoop, one of the extension packages to complement it, can improve data analysis performance as it supports Hadoop platform-based distributed processing of programs written in R. In this paper, we evaluate the validity of RHadoop by evaluating the performance improvement of RHadoop in real medical big data analysis. Performance evaluation of the analysis of the medical history information, which is provided by National Health Insurance Service, using R and RHadoop shows that RHadoop cluster composed of 8 data nodes can improve performance up to 8 times compared with R.

The Core Module, "Viz-Data" of the User Interface Platform using the Public Data (공공데이터를 활용한 사용자 인터페이스 플랫폼의 핵심모듈 "Viz-Data")

  • Kim, Mi-Yun
    • Journal of Digital Convergence
    • /
    • v.14 no.1
    • /
    • pp.75-82
    • /
    • 2016
  • The most of public services that we use these days is distributed and supplied as 'App' service because of wide spread of smat phones. Especially, since the interest of general citizens about usabilitu of public data has been increased, in case of Seoul, people can reach the data through 'Seoul Open Data Plaza' of 25 regions of Seoul. It becomes possible to construct various throughout this system. Ultimately, in case of users, they are provided many services through their electronic media. Looking at the development and research of public data service, they are mostly focusing on service or building up the service, but the research on visualization of contents is insufficient. This study is suggesting the specific plan and directionality of building public service using the public data which studied in the advanced research, "The user interface platform". Finally. this research is for a right usage of public data in the smart urban environment in near future and providing the practical public service.

Occurrence, Type and Ultrastructure of Calcium Oxalate Crystals in Panax ginseng (인삼(Panax ginseng)에 존재하는 Calcium Oxalate 결정체의 분포, 유형 및 미세구조)

  • Lee, Sang-Wook;Kwon, Woo-Saeng;Jeong, Byung-Kap
    • Journal of Ginseng Research
    • /
    • v.26 no.4
    • /
    • pp.213-218
    • /
    • 2002
  • Crystalline calcium oxalate occur throughout near)y all plants species in five major forms; styloids, druses, raphids, prisms and sands. These crystals are known to be distributed in specific tissue such as cortex, xylem, phloem, cambium and epidermis. This research was undertaken to identify the occurrence, type, location and ultrastructure of druse crystals in Panax ginseng. In situ visualization, conventional light microscopy, histochemistry and scanning electron microscopy were applied for these purposes. Druse crystals in ginseng were identified as calcium oxalate by silver nitraterubeanic acid histochemistry. Calcium oxalate crystals are observed in nearly all plant organs such as leaf, petiole, peduncle, stem, rhizome, tap root and lateral root except fine root. Most frequent observation of crystals in the leaf and rhizomes were noticed. Three different types of calcium of oxalate druse crystals were identified by scanning electron microscopy.

Blockchain Watchdog: Real-time Blockchain Surveillance System Connecting Smart Contract Code and Distributed Storage (Blockchain Watchdog: 분산 저장소와 스마트 컨트랙트 코드 연동 실시간 블록체인 관제시스템)

  • Hong, Joongi;Kim, Suntae;Ryu, Duksan
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.20 no.4
    • /
    • pp.115-121
    • /
    • 2020
  • As the participation of blockchain increases, governance to maintain the ecosystem is being activated. Governance must be managed/supervised to maintain and improve the blockchain. However, as the usage of blockchain increases, there is a limit for people to manage it individually. In addition, smart contracts applied from Ethereum need to be verified for trade that are determined according to status values, as new trade types are possible. This research proposes a surveillance system, Blockchain Watchdog, based on the state monitoring of the blockchain smart contract as a tool for maintaining and developing the blockchain ecosystem of governance, and implemented and tested the surveillance system. As a case study, we conducted experiments on Ropsten and Ganache, and were able to see real-time information collection and visualization using dashboards, graphs, and charts. We expect to contribute to the maintenance and development of the ecosystem of blockchain governance through Blockchain Watchdog.