• Title/Summary/Keyword: FileSystem

Search Result 2,285, Processing Time 0.031 seconds

Design of Distributed Hadoop Full Stack Platform for Big Data Collection and Processing (빅데이터 수집 처리를 위한 분산 하둡 풀스택 플랫폼의 설계)

  • Lee, Myeong-Ho
    • Journal of the Korea Convergence Society
    • /
    • v.12 no.7
    • /
    • pp.45-51
    • /
    • 2021
  • In accordance with the rapid non-face-to-face environment and mobile first strategy, the explosive increase and creation of many structured/unstructured data every year demands new decision making and services using big data in all fields. However, there have been few reference cases of using the Hadoop Ecosystem, which uses the rapidly increasing big data every year to collect and load big data into a standard platform that can be applied in a practical environment, and then store and process well-established big data in a relational database. Therefore, in this study, after collecting unstructured data searched by keywords from social network services based on Hadoop 2.0 through three virtual machine servers in the Spring Framework environment, the collected unstructured data is loaded into Hadoop Distributed File System and HBase based on the loaded unstructured data, it was designed and implemented to store standardized big data in a relational database using a morpheme analyzer. In the future, research on clustering and classification and analysis using machine learning using Hive or Mahout for deep data analysis should be continued.

Development of Walk Score Application GUI in Smart Device for Improvement of User Convenience (사용자 편의성 향상을 위한 스마트 단말에서의 워크스코어 어플리케이션 GUI 개발)

  • An, Donghyeok;Kim, Eun Jung
    • Smart Media Journal
    • /
    • v.8 no.2
    • /
    • pp.86-93
    • /
    • 2019
  • The purpose of this study is to develop walk score application GUI in a smart device for improving user convenience. This study uses the walk score dataset of Seoul City developed in previous studies. Application GUI consists of five parts: address input window and search button, detail information (address, latitude, longitude, walk score), window switching and input window for a number of data, data input window, and menu button. For verifying application GUI, this study uses 12 locations (sets of address, latitude, longitude, and walk score) near Gangnam Station and Myungdong Station in Seoul in several scenarios. First, this study checks if the application has been implemented with address and keyword search options. Then, new data insertion and file output operations are evaluated. The application system developed in this study operated properly in all scenarios. This walk score application can be a useful device in our daily lives.

Reliability verification of cutting force experiment by the 3D-FEM analysis from reverse engineering design of milling tool (밀링 공구의 역 공학 설계에서 3D 유한요소 해석을 통한 절삭력 실험의 신뢰성 검증)

  • Jung, Sung-Taek;Wi, Eun-Chan;Kim, Hyun-Jeong;Song, Ki-Hyeok;Baek, Seung-Yub
    • Design & Manufacturing
    • /
    • v.13 no.2
    • /
    • pp.54-59
    • /
    • 2019
  • CNC(Computer Numerical Control) machine tools are being used in various industrial fields such as aircraft and automobiles. The machining conditions used in the mold industry are used, and the simulation and the experiment are compared. The tool used in the experiment was carried out to increase the reliability of the simulation of the cutting machining. The program used in the 3D-FEM (finite element method) was the AdvantEdge and predicted by down-milling. The tool model is used 3D-FEM simulation by using the cutting force, temperature prediction. In this study, we carried out the verification of cutting force by using a 3-axis tool dynamometer (Kistler 9257B) system when machining the plastic mold Steel machining of NAK-80. The cutting force experiment data using on the charge amplifier (5070A) is amplified, and the 3-axis cutting force data are saved as a TDMS file using the Lab-View based program using on NI-PXIe-1062Q. The machining condition 7 was the most similar to the simulation and the experimental results. The material properties of the NAK-80 material and the simulation trends reflected in the reverse design of the tool were derived similarly to the experimental results.

Improved dentin disinfection by combining different-geometry rotary nickel-titanium files in preparing root canals

  • Bedier, Marwa M.;Hashem, Ahmed Abdel Rahman;Hassan, Yosra M.
    • Restorative Dentistry and Endodontics
    • /
    • v.43 no.4
    • /
    • pp.46.1-46.10
    • /
    • 2018
  • Objectives: This study was to evaluate the antibacterial effect of different instrumentation and irrigation techniques using confocal laser scanning microscopy (CLSM) after root canal inoculation with Enterococcus faecalis (E. faecalis). Materials and Methods: Mesiobuccal and mesiolingual canals of extracted mandibular molars were apically enlarged up to a size 25 hand K-file, then autoclaved and inoculated with E. faecalis. The samples were randomly divided into 4 main groups according to the system of instrumentation and irrigation: an XP-endo Shaper (XPS) combined with conventional irrigation (XPS/C) or an XP-endo Finisher (XPF) (XPS/XPF), and iRaCe combined with conventional irrigation (iRaCe/C) or combined with an XPF (iRaCe/XPF). A middle-third sample was taken from each group, and then the bacterial reduction was evaluated using CLSM at a depth of $50{\mu}m$ inside the dentinal tubules. The ratio of red fluorescence (dead cells) to green-and-red fluorescence (live and dead cells) represented the percentage of bacterial reduction. The data were then statistically analyzed using the Kruskal-Wallis test for comparisons across the groups and the Dunn test was used for pairwise comparisons. Results: The instrumentation and irrigation techniques had a significant effect on bacterial reduction (p < 0.05). The iRaCe/XPF group showed the strongest effect, followed by the XPS/XPF and XPS/C group, while the iRaCe/C group had the weakest effect. Conclusions: Combining iRaCe with XPF improved its bacterial reduction effect, while combining XPS with XPF did not yield a significant improvement in its ability to reduce bacteria at a depth of $50{\mu}m$ in the dentinal tubules.

Design of a Simple PCM Encoder Architecture Based on Programmable ROM (프로그래머블 ROM 기반의 심플 PCM 엔코더 설계)

  • Kim, Geon-Hee;Jin, Mi-Hyun;Kim, Bok-Ki
    • Journal of Advanced Navigation Technology
    • /
    • v.23 no.2
    • /
    • pp.186-193
    • /
    • 2019
  • This paper presents and implements a simple programmable PCM encoder structure uisng the commutation method. In the telemetry system, information is required to assign each data to the channel in order to generate a frame format the data acpuired from the sensor. In this case, when the number of state information is large or the data type is various, there is a necessity to input a large amount of information to each channel. However, the more the number of channels and data, the more probability the error will occur. Therefore, in this paper, the channel information is created using the program. And PCM encoder was implemented to store channel information in ROM. The proposed PCM encoder architecture reduces the likelihood of errors. And it can improve the development speed. The validity of proposed structure is proved by simulation.

Design of Web Content Update Algorithm to Reduce Communication Data Consumption using Service Worker and Hash (서비스워커와 해시를 이용한 통신 데이터 소모 감소를 위한 웹 콘텐츠 갱신 알고리즘 설계)

  • Kim, Hyun-gook;Park, Jin-tae;Choi, Moon-Hyuk;Moon, Il-young
    • Journal of Advanced Navigation Technology
    • /
    • v.23 no.2
    • /
    • pp.158-165
    • /
    • 2019
  • The existing web page was downloaded and provided to the user every time the user requested the page. Therefore, if the same page is repeatedly requested by the user, only the download for the same resource is repeated. This is a factor that causes unnecessary consumption of data. We focus on reducing data consumption caused by unnecessary requests between users and servers, and improving content delivery speed. Therefore, in this paper, we propose a caching system and an algorithm that can reduce the data consumption while maintaining the latest cache by comparing the hash value using the hash function that can detect the change of the file requested by the user.

Design of Efficient Big Data Collection Method based on Mass IoT devices (방대한 IoT 장치 기반 환경에서 효율적인 빅데이터 수집 기법 설계)

  • Choi, Jongseok;Shin, Yongtae
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.14 no.4
    • /
    • pp.300-306
    • /
    • 2021
  • Due to the development of IT technology, hardware technologies applied to IoT equipment have recently been developed, so smart systems using low-cost, high-performance RF and computing devices are being developed. However, in the infrastructure environment where a large amount of IoT devices are installed, big data collection causes a load on the collection server due to a bottleneck between the transmitted data. As a result, data transmitted to the data collection server causes packet loss and reduced data throughput. Therefore, there is a need for an efficient big data collection technique in an infrastructure environment where a large amount of IoT devices are installed. Therefore, in this paper, we propose an efficient big data collection technique in an infrastructure environment where a vast amount of IoT devices are installed. As a result of the performance evaluation, the packet loss and data throughput of the proposed technique are completed without loss of the transmitted file. In the future, the system needs to be implemented based on this design.

Parallelization of Genome Sequence Data Pre-Processing on Big Data and HPC Framework (빅데이터 및 고성능컴퓨팅 프레임워크를 활용한 유전체 데이터 전처리 과정의 병렬화)

  • Byun, Eun-Kyu;Kwak, Jae-Hyuck;Mun, Jihyeob
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.8 no.10
    • /
    • pp.231-238
    • /
    • 2019
  • Analyzing next-generation genome sequencing data in a conventional way using single server may take several tens of hours depending on the data size. However, in order to cope with emergency situations where the results need to be known within a few hours, it is required to improve the performance of a single genome analysis. In this paper, we propose a parallelized method for pre-processing genome sequence data which can reduce the analysis time by utilizing the big data technology and the highperformance computing cluster which is connected to the high-speed network and shares the parallel file system. For the reliability of analytical data, we have chosen a strategy to parallelize the existing analytical tools and algorithms to the new environment. Parallelized processing, data distribution, and parallel merging techniques have been developed and performance improvements have been confirmed through experiments.

Lightweighted CTS Preconstruction Techniques for Checking Clock Tree Synthesizable Paths in RTL Design Time (레지스터 전달 수준 설계단계에서 사전 클럭트리합성 가능여부 판단을 위한 경량화된 클럭트리 재구성 방법)

  • Kwon, Nayoung;Park, Daejin
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.26 no.10
    • /
    • pp.1537-1544
    • /
    • 2022
  • When designing chip, it considers design specification, timing problem, and clock synchronization on place & route (P&R) process. P&R process is complicated because of considering various factors. Chip uses clock tree synthesis (CTS) to reduce clock path delay. The purpose of this study is to examine shallow-CTS algorithm for checking clock tree synthesizable. Using open source Parser-Verilog, register transfer level (RTL) synthesizable Verilog file is parsed and it uses Pre-CTS and Post-CTS process that is included shallow-CTS. Based on longest clock path in the Pre-CTS and Post-CTS stages, the standard deviation before and after buffer insertion is compared and analyzed for the accuracy of CTS. In this paper, It is expected that the cost and time problem could be reduced by providing a pre-clock tree synthesis verification method at the RTL level without confirming the CTS result using the time-consuming licensed EDA tool.

Methodology of Fire Safety IFC Schema Extension through Architectural WBS Hierarchy Analysis (건축 WBS 위계 분석을 통한 소방 IFC 스키마 확장 방법론에 관한 연구)

  • Kim, Tae-Hoon;Won, Jung-Hye;Hong, Soon-Min;Choo, Seung-Yeon
    • Journal of KIBIM
    • /
    • v.12 no.4
    • /
    • pp.70-79
    • /
    • 2022
  • As BIM(Building Information Modeling) technology advances in architecture around the world, projects and industries using BIM are increasing. Unlike previous developments that were limited to buildings, BIM is now spreading to other fields such as civil engineering and electricity. In architecture, BIM is used in the entire process from design to maintenance of a building, and IFC(Industry Foundation Classes), a neutral format with interoperability, is used as an open BIM format. Since firefighting requires intuitive 3D models for evacuation and fire simulations, BIM models are desirable. However, due to the BIM model, which was developed centered on building objects, there are no objects and specific properties for fire evacuation in the IFC scheme. Therefore, in this study, when adding a new object in the firefighting area to the IFC schema, the IFC interoperability is not broken and the building WBS(Work Breakdown Structure) is analyzed with a hierarchical system similar to the IFC format to define the scope for a new object and the firefighting part within of the building WBS to derive a firefighting HBS(Hierarchy Breakdown Structure) with the extension of the object-oriented IFC file. And according to HBS, we propose an IFC schema extension method. It is a methodology that allows BIM users to instantly adapt the IFC schema to their needs. Accordingly, the methodology derived from this study is expected to be expanded in various areas to minimize information loss from IFC. In the future, we will apply the IFC extension methodology to the actual development process using HBS to verify that it is actually applicable within the IFC schema.