• Title/Summary/Keyword: Structured Data

Search Result 3,986, Processing Time 0.03 seconds

A Tombstone Filtered LSM-Tree for Stable Performance of KVS (키밸류 저장소 성능 제어를 위한 삭제 키 분리 LSM-Tree)

  • Lee, Eunji
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.22 no.4
    • /
    • pp.17-22
    • /
    • 2022
  • With the spread of web services, data types are becoming more diversified. In addition to the form of storing data such as images, videos, and texts, the number and form of properties and metadata expressing the data are different for each data. In order to efficiently process such unstructured data, a key-value store is widely used for state-of-the-art applications. LSM-Tree (Log Structured Merge Tree) is the core data structure of various commercial key-value stores. LSM-Tree is optimized to provide high performance for small writes by recording all write and delete operations in a log manner. However, there is a problem in that the delay time and processing speed of user requests are lowered as batches of deletion operations for expired data are inserted into the LSM-Tree as special key-value data. This paper presents a Filtered LSM-Tree (FLSM-Tree) that solves the above problem by separating the deleted key from the main tree structure while maintaining all the advantages of the existing LSM-Tree. The proposed method is implemented in LevelDB, a commercial key-value store and it shows that the read performance is improved by up to 47% in performance evaluation.

An Application of XML Based Manufacturing Information for Forming Shop (XML을 이용한 곡면 가공 시스템의 정보 구조화에 관한 연구)

  • Ha, Kwang-Cheol;Lee, Jang-Hyun;Oh, Dae-Kyun;Shin, Jong-Gye;Ryu, Cheol-Ho
    • Journal of the Society of Naval Architects of Korea
    • /
    • v.41 no.6
    • /
    • pp.126-133
    • /
    • 2004
  • As the automation of ship production system proliferates, it is unavoidable to move the real machinery, facility, application software, and virtual environment from the heterogeneous data environment to the integrated one. However, it is a prevailing situation that each component operates under the different environment, due to the inability of interchanging the data in a structured manner between the components. The issue is obstacles to improvement of the application system. To facilitate seamless exchange of data among the manufacturing systems, STEP, PDML, and XML has been tried by other studies. This study has investigated how XML data can be applied to exchange the data among the ship production system components. XML data is applied to the forming shop in shipyard to overcome the present difficulties on sharing and exchanging of the information. An example of forming information is represented by XML to demonstrate the feasibility of the proposed approach. In addition, an application of XML information applicable to virtual factory and electronic work order sheet is included.

A Study on Concept and Services Framework of Geo-Spatial Big Data (공간 빅데이터의 개념 및 서비스 프레임워크 구상에 관한 연구)

  • Yu, Seon Cheol;Choi, Won Wook;Shin, Dong Bin;Ahn, Jong Wook
    • Spatial Information Research
    • /
    • v.22 no.6
    • /
    • pp.13-21
    • /
    • 2014
  • This study defines concept and service framework of Geo-Spatial Big Data(GSBD). The major concept of the GSBD is formulated based on the 7V characteristics: the general characteristics of big data with 3V(Volume, Variety, Velocity); Geo-spatial oriented characteristics with 4V(Veracity, Visualization, Versatile, Value). GSBD is the technology to extract meaningful information from Geo-spatial fusion data and support decision making responding with rapidly changing activities by analysing with almost realtime solutions while efficiently collecting, storing and managing structured, semi-structured or unstructured big data. The application area of the GSBD is segmented in terms of technical aspect(store, manage, analyze and service) and public/private area. The service framework for the GSBD composed of modules to manage, contain and monitor GSBD services is suggested. Such additional studies as building specific application service models and formulating service delivery strategies for the GSBD are required based on the services framework.

An Experimental Study on Semantic Searches for Image Data Using Structured Social Metadata (구조화된 소셜 메타데이터를 활용한 이미지 자료의 시맨틱 검색에 관한 실험적 연구)

  • Kim, Hyun-Hee;Kim, Yong-Ho
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.44 no.1
    • /
    • pp.117-135
    • /
    • 2010
  • We designed a structured folksonomy system in which queries can be expanded through tag control; equivalent, synonym or related tags are bound together, in order to improve the retrieval efficiency (recall and precision) of image data. Then, we evaluated the proposed system by comparing it to a tag-based system without tag control in terms of recall, precision, and user satisfaction. Furthermore, we also investigated which query expansion method is the most efficient in terms of retrieval performance. The experimental results showed that the recall, precision, and user satisfaction rates of the proposed system are statistically higher than the rates of the tag-based system, respectively. On the other hand, there are significant differences among the precision rates of query expansion methods but there are no significant differences among their recall rates. The proposed system can be utilized as a guide on how to effectively index and retrieve the digital content of digital library systems in the Library 2.0 era.

An Efficient Cleaning Scheme for File Defragmentation on Log-Structured File System (로그 구조 파일 시스템의 파일 단편화 해소를 위한 클리닝 기법)

  • Park, Jonggyu;Kang, Dong Hyun;Seo, Euiseong;Eom, Young Ik
    • Journal of KIISE
    • /
    • v.43 no.6
    • /
    • pp.627-635
    • /
    • 2016
  • When many processes issue write operations alternately on Log-structured File System (LFS), the created files can be fragmented on the file system layer although LFS sequentially allocates new blocks of each process. Unfortunately, this file fragmentation degrades read performance because it increases the number of block I/Os. Additionally, read-ahead operations which increase the number of data to request at a time exacerbates the performance degradation. In this paper, we suggest a new cleaning method on LFS that minimizes file fragmentation. During a cleaning process of LFS, our method sorts valid data blocks by inode numbers before copying the valid blocks to a new segment. This sorting re-locates fragmented blocks contiguously. Our cleaning method experimentally eliminates 60% of file fragmentation as compared to file fragmentation before cleaning. Consequently, our cleaning method improves sequential read throughput by 21% when read-ahead is applied.

The Effect of Education for Prevention of Osteoporosis Patients with Bone Fracture (골다공증교육이 골절환자의 지식과 생활양식변화 수행에 미치는 영향)

  • 이향련;김숙녕
    • Journal of Korean Academy of Nursing
    • /
    • v.31 no.2
    • /
    • pp.194-205
    • /
    • 2001
  • The purpose of the study was to identify the effect of structured patients education had on prevention of osteoporosis, with fracture and the resulting of life style changes in patients. In this study, a non equivalent control group pre and a post test design was employed. Data were collected through an interview process using questionnaires from April to December of 1999. The subjects, consisting of 59 patients with fractures and over 40 years of age, were diagnosed in K University Hospital. This study tested the patients knowledge at three times. The times were before the program 2 weeks into the program, and 6 months after education program. Life style change related to prevention of osteoporosis was shown twice (before and 6 months after the education program) in the experimental group, and control group went without it. The instruments used for this study were developed by literature review according to a reliability test. Data was analyzed using X2 test and t test to determine similarities between the experimental and control groups. The hypothesis was tested using repeated measures of ANOVA, t-test and Pearson correlation coefficients. The results of the study were summarized as follows: 1. The first hypothesis was accepted: a higher level of knowledge about osteoporosis was found in experimental groups who received education than to the control group during the period (F=19.82, p=.0001). 2. The second hypothesis was accepted: a higher level of life style changes about osteoporosis on experimental group were recorded than as compared to control group (t=3.55, p=.001). 3. The third hypothesis was accepted: the higher the knowledge about osteoporosis the higher the level of performance of life style changes about prevention of osteoporosis (r=.600, p=.0001). In conclusion, structured patient education in patient with fractures improved the level of knowledge about osteoporosis and more likely undergo of life style changes 6 months after the education program. Also reeducation would be needed 6 months after program ends. That is structured patient education in pamphlet form would be very effective in nursing intervention that may to result in life style changes. Therefore further research is needed to reinforce the education material and to generalize the education effect.

  • PDF

Spatio-temporal Fluctuations of Size-structured Phytoplankton over an Annual Cycle in the Youngsan Lake

  • Song, Eun-Sook;Shin, Yong-Sik
    • Korean Journal of Ecology and Environment
    • /
    • v.41 no.4
    • /
    • pp.530-540
    • /
    • 2008
  • The temporal and spatial variations of size-structured phytoplankton dynamics in Youngsan Lake were investigated to explore potential mechanims controlling the dynamics in the Youngsan Lake. Field data were collected monthly from February to October, 2003 at 6 stations along the axis of Youngsan Lake. In this study, phytoplankton (chlorophyll $\alpha$) were categorized into three size classes: micro-size ($>20{\mu}m$), nano-size ($2{\sim}20{\mu}m$) and pico-size ($<20{\mu}m$). Water temperature, light attenuation coefficients, PAR (photosynthetically active radiation) and suspended solids were measured to analyze relationship between physical-chemical properties and size structure of phytoplankton. Phytoplankton blooms developed during March, July and October in the upper region of the main stem whereas small-scaled spring bloom was observed in the lower region. The scales of phytoplankton blooms were higher in the upper regions than the lower region and blooms were predominated by micro-size class in upper region but predominated by nano-size class in lower region. Growth of size-structured phytoplankton appeared to be controlled by rather light availability than temperature-dependant metabolisms in the system. Phytoplankton growth may be also supported by ambient nutrients available in the water column from analyses of chlorophyll $\alpha$ vs. nutrient concentrations including nitrite+nitrate and orthophosphate. Growth of nano-sized phytoplankton alone appeared to be supported by orthophosphate as well as nitrite+nitrate indicating that response of phytoplankton to nutrient inputs may be size-dependent.

A Structured and Multi-cellular Model of Starch Biosynthesis in Potato

  • Saithong, Treenut;Saraboon, Piyaporn;Meechai, Asawin;Cheevadhanarak, Supapon;Bhumiratana, Sakarindr
    • Proceedings of the Korean Society for Bioinformatics Conference
    • /
    • 2005.09a
    • /
    • pp.151-155
    • /
    • 2005
  • Recently, systems biology has been increasingly applied to gain insights into the complexity of living organisms. Many inaccessible biological information and hidden evidences fur example flux distribution of the metabolites are simply revealed by investigation of artificial cell behaviors. Most bio-models are models of single cell organisms that cannot handle the multi-cellular organisms like plants. Herein, a structured and multi-cellular model of potato was developed to comprehend the root starch biosynthesis. On the basis of simplest plant cell biology, a potato structured model on the platform of Berkley Madonna was divided into three parts: photosynthetic (leaf), non-photosynthetic (tuber) and transportation (phloem) cells. The model of starch biosynthesis begins with the fixation of CO$_2$ from atmosphere to the Calvin cycle. Passing through a series of reactions, triose phosphate from Calvin cycle is converted to sucrose which is transported to sink cells and is eventually formed the amylose and amylopectin (starch constituents). After validating the model with data from a number of literatures, the results show that the structured model is a good representative of the studied system. The result of triose phosphate (DHAP and GAP) elevation due to lessening the aldolase activity is an illustration of the validation. Furthermore, the representative model was used to gain more understanding of starch production process such as the effect of CO$_2$ uptake on qualitative and quantitative aspects of starch biosynthesis.

  • PDF

Bayesian Sensor Fusion of Monocular Vision and Laser Structured Light Sensor for Robust Localization of a Mobile Robot (이동 로봇의 강인 위치 추정을 위한 단안 비젼 센서와 레이저 구조광 센서의 베이시안 센서융합)

  • Kim, Min-Young;Ahn, Sang-Tae;Cho, Hyung-Suck
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.16 no.4
    • /
    • pp.381-390
    • /
    • 2010
  • This paper describes a procedure of the map-based localization for mobile robots by using a sensor fusion technique in structured environments. A combination of various sensors with different characteristics and limited sensibility has advantages in view of complementariness and cooperation to obtain better information on the environment. In this paper, for robust self-localization of a mobile robot with a monocular camera and a laser structured light sensor, environment information acquired from two sensors is combined and fused by a Bayesian sensor fusion technique based on the probabilistic reliability function of each sensor predefined through experiments. For the self-localization using the monocular vision, the robot utilizes image features consisting of vertical edge lines from input camera images, and they are used as natural landmark points in self-localization process. However, in case of using the laser structured light sensor, it utilizes geometrical features composed of corners and planes as natural landmark shapes during this process, which are extracted from range data at a constant height from the navigation floor. Although only each feature group of them is sometimes useful to localize mobile robots, all features from the two sensors are simultaneously used and fused in term of information for reliable localization under various environment conditions. To verify the advantage of using multi-sensor fusion, a series of experiments are performed, and experimental results are discussed in detail.

User-friendly 3D Object Reconstruction Method based on Structured Light in Ubiquitous Environments (유비쿼터스 환경에서 구조광 기반 사용자 친화적 3차원 객체 재구성 기법)

  • Jung, Sei-Hwa;Lee, Jeongjin
    • The Journal of the Korea Contents Association
    • /
    • v.13 no.11
    • /
    • pp.523-532
    • /
    • 2013
  • Since conventional methods for the reconstruction of 3D objects used a number of cameras or pictures, they required specific hardwares or they were sensitive to the photography environment with a lot of processing time. In this paper, we propose a 3D object reconstruction method using one photograph based on structured light in ubiquitous environments. We use color pattern of the conventional method for structured light. In this paper, we propose a novel pipeline consisting of various image processing techniques for line pattern extraction and matching, which are very important for the performance of the object reconstruction. And we propose the optimal cost function for the pattern matching. Using our method, it is possible to reconstruct a 3D object with efficient computation and easy setting in ubiquitous or mobile environments, for example, a smartphone with a subminiature projector like Galaxy Beam.