• Title/Summary/Keyword: large data visualization

Search Result 240, Processing Time 0.03 seconds

Developing A Multi-dimensional Spatio-visual Information System (다차원기반 고정밀 공간영상정보 시스템 구축에 관한 연구)

  • Kim, Mi-Yun;Yeo, Wook-Hyun;Choi, Jin-Won
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.27 no.6
    • /
    • pp.649-658
    • /
    • 2009
  • The recent emergence of the paradigm of new urban planning for building intelligent urban spaces, such as U-City and U-Eco City, of which the concept of ubiquitous technology is applied, requires high quality three-dimensional spatial information of the urban area. The aim of this study is to build a multi-dimensional spatio-visual information system that includes the solution for visualization, spatial information search, analysis, and evaluation by integrating various types of 3D-modeled spatial information concerning the large urban-size area based on the latest GIS application technology. The range of this study is the integration, visualization, and utilization of spatial information with the goal of building 3D virtual urban environment of high-quality and high-resolution by increasing the utilization of the systematic urban facilities in order to fully reflect the actual user's needs, using the aerial LiDAR data as the plan to overcome the limitations of the existing 3D urban modeling. By reproducing the virtual urban environment the most similar to the actual world through the mash-up of satellite images and aerial photos on the standard format of spatial information constituted of properties and signs, the system will be built with many analysis and utilization functions that support the view and sunlight analysis, various administrative tasks, as well as the decision making process of the city.

Rough Computational Annotation and Hierarchical Conserved Area Viewing Tool for Genomes Using Multiple Relation Graph. (다중 관계 그래프를 이용한 유전체 보존영역의 계층적 시각화와 개략적 전사 annotation 도구)

  • Lee, Do-Hoon
    • Journal of Life Science
    • /
    • v.18 no.4
    • /
    • pp.565-571
    • /
    • 2008
  • Due to rapid development of bioinformatics technologies, various biological data have been produced in silico. So now days complicated and large scale biodata are used to accomplish requirement of researcher. Developing visualization and annotation tool using them is still hot issues although those have been studied for a decade. However, diversity and various requirements of users make us hard to develop general purpose tool. In this paper, I propose a novel system, Genome Viewer and Annotation tool (GenoVA), to annotate and visualize among genomes using known information and multiple relation graph. There are several multiple alignment tools but they lose conserved area for complexity of its constrains. The GenoVA extracts all associated information between all pair genomes by extending pairwise alignment. High frequency conserved area and high BLAST score make a block node of relation graph. To represent multiple relation graph, the system connects among associated block nodes. Also the system shows the known information, COG, gene and hierarchical path of block node. In this case, the system can annotates missed area and unknown gene by navigating the special block node's clustering. I experimented ten bacteria genomes for extracting the feature to visualize and annotate among them. GenoVA also supports simple and rough computational annotation of new genome.

Twitter Issue Tracking System by Topic Modeling Techniques (토픽 모델링을 이용한 트위터 이슈 트래킹 시스템)

  • Bae, Jung-Hwan;Han, Nam-Gi;Song, Min
    • Journal of Intelligence and Information Systems
    • /
    • v.20 no.2
    • /
    • pp.109-122
    • /
    • 2014
  • People are nowadays creating a tremendous amount of data on Social Network Service (SNS). In particular, the incorporation of SNS into mobile devices has resulted in massive amounts of data generation, thereby greatly influencing society. This is an unmatched phenomenon in history, and now we live in the Age of Big Data. SNS Data is defined as a condition of Big Data where the amount of data (volume), data input and output speeds (velocity), and the variety of data types (variety) are satisfied. If someone intends to discover the trend of an issue in SNS Big Data, this information can be used as a new important source for the creation of new values because this information covers the whole of society. In this study, a Twitter Issue Tracking System (TITS) is designed and established to meet the needs of analyzing SNS Big Data. TITS extracts issues from Twitter texts and visualizes them on the web. The proposed system provides the following four functions: (1) Provide the topic keyword set that corresponds to daily ranking; (2) Visualize the daily time series graph of a topic for the duration of a month; (3) Provide the importance of a topic through a treemap based on the score system and frequency; (4) Visualize the daily time-series graph of keywords by searching the keyword; The present study analyzes the Big Data generated by SNS in real time. SNS Big Data analysis requires various natural language processing techniques, including the removal of stop words, and noun extraction for processing various unrefined forms of unstructured data. In addition, such analysis requires the latest big data technology to process rapidly a large amount of real-time data, such as the Hadoop distributed system or NoSQL, which is an alternative to relational database. We built TITS based on Hadoop to optimize the processing of big data because Hadoop is designed to scale up from single node computing to thousands of machines. Furthermore, we use MongoDB, which is classified as a NoSQL database. In addition, MongoDB is an open source platform, document-oriented database that provides high performance, high availability, and automatic scaling. Unlike existing relational database, there are no schema or tables with MongoDB, and its most important goal is that of data accessibility and data processing performance. In the Age of Big Data, the visualization of Big Data is more attractive to the Big Data community because it helps analysts to examine such data easily and clearly. Therefore, TITS uses the d3.js library as a visualization tool. This library is designed for the purpose of creating Data Driven Documents that bind document object model (DOM) and any data; the interaction between data is easy and useful for managing real-time data stream with smooth animation. In addition, TITS uses a bootstrap made of pre-configured plug-in style sheets and JavaScript libraries to build a web system. The TITS Graphical User Interface (GUI) is designed using these libraries, and it is capable of detecting issues on Twitter in an easy and intuitive manner. The proposed work demonstrates the superiority of our issue detection techniques by matching detected issues with corresponding online news articles. The contributions of the present study are threefold. First, we suggest an alternative approach to real-time big data analysis, which has become an extremely important issue. Second, we apply a topic modeling technique that is used in various research areas, including Library and Information Science (LIS). Based on this, we can confirm the utility of storytelling and time series analysis. Third, we develop a web-based system, and make the system available for the real-time discovery of topics. The present study conducted experiments with nearly 150 million tweets in Korea during March 2013.

D4AR - A 4-DIMENSIONAL AUGMENTED REALITY - MODEL FOR AUTOMATION AND VISUALIZATION OF CONSTRUCTION PROGRESS MONITORING

  • Mani Golparvar-Fard;Feniosky Pena-Mora
    • International conference on construction engineering and project management
    • /
    • 2009.05a
    • /
    • pp.30-31
    • /
    • 2009
  • Early detection of schedule delay in field construction activities is vital to project management. It provides the opportunity to initiate remedial actions and increases the chance of controlling such overruns or minimizing their impacts. This entails project managers to design, implement, and maintain a systematic approach for progress monitoring to promptly identify, process and communicate discrepancies between actual and as-planned performances as early as possible. Despite importance, systematic implementation of progress monitoring is challenging: (1) Current progress monitoring is time-consuming as it needs extensive as-planned and as-built data collection; (2) The excessive amount of work required to be performed may cause human-errors and reduce the quality of manually collected data and since only an approximate visual inspection is usually performed, makes the collected data subjective; (3) Existing methods of progress monitoring are also non-systematic and may also create a time-lag between the time progress is reported and the time progress is actually accomplished; (4) Progress reports are visually complex, and do not reflect spatial aspects of construction; and (5) Current reporting methods increase the time required to describe and explain progress in coordination meetings and in turn could delay the decision making process. In summary, with current methods, it may be not be easy to understand the progress situation clearly and quickly. To overcome such inefficiencies, this research focuses on exploring application of unsorted daily progress photograph logs - available on any construction site - as well as IFC-based 4D models for progress monitoring. Our approach is based on computing, from the images themselves, the photographer's locations and orientations, along with a sparse 3D geometric representation of the as-built scene using daily progress photographs and superimposition of the reconstructed scene over the as-planned 4D model. Within such an environment, progress photographs are registered in the virtual as-planned environment, allowing a large unstructured collection of daily construction images to be interactively explored. In addition, sparse reconstructed scenes superimposed over 4D models allow site images to be geo-registered with the as-planned components and consequently, a location-based image processing technique to be implemented and progress data to be extracted automatically. The result of progress comparison study between as-planned and as-built performances can subsequently be visualized in the D4AR - 4D Augmented Reality - environment using a traffic light metaphor. In such an environment, project participants would be able to: 1) use the 4D as-planned model as a baseline for progress monitoring, compare it to daily construction photographs and study workspace logistics; 2) interactively and remotely explore registered construction photographs in a 3D environment; 3) analyze registered images and quantify as-built progress; 4) measure discrepancies between as-planned and as-built performances; and 5) visually represent progress discrepancies through superimposition of 4D as-planned models over progress photographs, make control decisions and effectively communicate those with project participants. We present our preliminary results on two ongoing construction projects and discuss implementation, perceived benefits and future potential enhancement of this new technology in construction, in all fronts of automatic data collection, processing and communication.

  • PDF

A Markerless Augmented Reality Approach for Indoor Information Visualization System (실내 정보 가시화에 의한 u-GIS 시스템을 위한 Markerless 증강현실 방법)

  • Kim, Albert Hee-Kwan;Cho, Hyeon-Dal
    • Journal of Korea Spatial Information System Society
    • /
    • v.11 no.1
    • /
    • pp.195-199
    • /
    • 2009
  • Augmented reality is a field of computer research which deals with the combination of real-world and computer-generated data, where computer graphics objects are blended into real footage in real time and it has tremendous potential in visualizing geospatial information. However, to utilize augmented reality in mobile system, many researches have undergone with GPS or marker based approaches. Localization and tracking of current position become more complex problem when it is used in indoor environments. Many proposed RF based tracking and localization. However, it does cause deployment problems of large sensors and readers. In this paper, we present a noble markerless AR approach for indoor navigation system only using a camera. We will apply this work to mobile seamless indoor/outdoor u-GIS system.

  • PDF

3D-GIS Network Modeling for Optimal Path Finding in Indoor Spaces (건물 내부공간의 최적경로 탐색을 위한 3차원 GIS 네트워크 모델링)

  • Park, In-Hye;Jun, Chul-Min;Choi, Yoon-Soo
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.15 no.3
    • /
    • pp.27-32
    • /
    • 2007
  • 3D based information is demanded increasingly as cities grow three dimensionally and buildings become large and complex. The use of 3D GIS is also getting attention as fundamental data for ubiquitous computing applications such as location-based guidance, path finding and emergency escaping. However, most 3D modeling techniques are focused on the visualization of buildings or terrains and do not have topological structures required in spatial analyses. In this paper, we introduce a method to incorporate topological relationship into 3D models by combining 2D GIS layers and 3D model. We divide indoor spaces of a 3D model into discrete objects and then define the relationship with corresponding features in 2D GIS layers through database records. We also show how to construct hallways network in the 2D-3D integrated building model. Finally, we test different cases of route finding situations inside a building such as normal origin-destination path finding and emergency evacuation.

  • PDF

Evaluations on Performances of a Non-Contact Torque Measurement Technique for Rotatory Machinery (회전기계용 비접촉식 토크 측정법 성능 평가)

  • KIM, YEONGHWAN;KIM, YEONGHO;CHO, GYEONGRAE;KIM, UEIKAN;DOH, DEOGHEE
    • Transactions of the Korean hydrogen and new energy society
    • /
    • v.29 no.6
    • /
    • pp.642-647
    • /
    • 2018
  • Gas compressors are mostly driven by motors. It is important to measure the power of motors to evaluate their power efficiency, because the mechanical loads of gas compressors are always varied. In order to measure the power given to the driving motors, the torque should be measured. Manufacturers of compressors usually use the torque data to calculate the compressors qualities such as power consumption, efficiencies and failures. In general, measurements for the shaft torque of the compressors have been based upon contact types, strain gauges. In the cases of larger compressors, the contact type of strain gauges have several disadvantages such as large size and high cost. In this study, a relatively inexpensive and simple torque sensing technique that is not restricted to shaft diameter is introduced using visualization technique. Particle image velocimetry (PIV) has been adopted to complete non-contact torques measurements for rotating motors. In order to compare the performance of the newly constructed torque measurement technique, torque measurement by a transducer based on MEMS technology has been performed simultaneously during experiments.

A Study on Application of Multi-Texture and Multi-Thread for Multi-Dimensions Urban Facility Management System (다차원 도시시설물 관리를 위한 멀티 텍스처 기법과 다중 스레드 기법의 적용에 관한 연구)

  • Choi, Keun-Ho;Kang, Byoung-Jun;Cho, Hong-Beom;Kim, Won-Cheol
    • Spatial Information Research
    • /
    • v.18 no.1
    • /
    • pp.57-67
    • /
    • 2010
  • Recently, 2D GIS technology is applied for urban facility management. However, urban facilities are located in 3D space and the information loss is occurring during data abstraction from 3D urban facility to 2D object. Also, the number of urban facilities is increasing steadily and most of urban facilities are located in underground space in the city. Therefore 2D urban facility management system has a limitation on visualization and management for a large number of urban facilities. In this paper, a multi-dimensions urban facility management system based on multi-texture technology is proposed. The proposed system reduces the information loss and improves the readability of information by visualizing urban facilities on 3D virtual space. A multi-texturing technology is applied for integrating of 2D vector data and 3D raster data, and a multi-thread technology is used for improving speed and performance of the system. The proposed technology can be used as a guideline for urban facility monitoring as providing visual information of a facility status with 3D image and facility data.

Parallel Cell-Connectivity Information Extraction Algorithm for Ray-casting on Unstructured Grid Data (비정렬 격자에 대한 광선 투사를 위한 셀 사이 연결정보 추출 병렬처리 알고리즘)

  • Lee, Jihun;Kim, Duksu
    • Journal of the Korea Computer Graphics Society
    • /
    • v.26 no.1
    • /
    • pp.17-25
    • /
    • 2020
  • We present a novel multi-core CPU based parallel algorithm for the cell-connectivity information extraction algorithm, which is one of the preprocessing steps for volume rendering of unstructured grid data. We first check the synchronization issues when parallelizing the prior serial algorithm naively. Then, we propose a 3-step parallel algorithm that achieves high parallelization efficiency by removing synchronization in each step. Also, our 3-step algorithm improves the cache utilization efficiency by increasing the spatial locality for the duplicated triangle test process, which is the core operation of building cell-connectivity information. We further improve the efficiency of our parallel algorithm by employing a memory pool for each thread. To check the benefit of our approach, we implemented our method on a system consisting of two octa-core CPUs and measured the performance. As a result, our method shows continuous performance improvement as we add threads. Also, it achieves up to 82.9 times higher performance compared with the prior serial algorithm when we use thirty-two threads (sixteen physical cores). These results demonstrate the high parallelization efficiency and high cache utilization efficiency of our method. Also, it validates the suitability of our algorithm for large-scale unstructured data.

An Analysis System for Whole Genomic Sequence Using String B-Tree (스트링 B-트리를 이용한 게놈 서열 분석 시스템)

  • Choe, Jeong-Hyeon;Jo, Hwan-Gyu
    • The KIPS Transactions:PartA
    • /
    • v.8A no.4
    • /
    • pp.509-516
    • /
    • 2001
  • As results of many genome projects, genomic sequences of many organisms are revealed. Various methods such as global alignment, local alignment are used to analyze the sequences of the organisms, and k -mer analysis is one of the methods for analyzing the genomic sequences. The k -mer analysis explores the frequencies of all k-mers or the symmetry of them where the k -mer is the sequenced base with the length of k. However, existing on-memory algorithms are not applicable to the k -mer analysis because a whole genomic sequence is usually a large text. Therefore, efficient data structures and algorithms are needed. String B-tree is a good data structure that supports external memory and fits into pattern matching. In this paper, we improve the string B-tree in order to efficiently apply the data structure to k -mer analysis, and the results of k -mer analysis for C. elegans and other 30 genomic sequences are shown. We present a visualization system which enables users to investigate the distribution and symmetry of the frequencies of all k -mers using CGR (Chaotic Game Representation). We also describe the method to find the signature which is the part of the sequence that is similar to the whole genomic sequence.

  • PDF