• Title/Summary/Keyword: Processing Platform

Search Result 1,607, Processing Time 0.021 seconds

Processing Method of Mass Small File Using Hadoop Platform (하둡 플랫폼을 이용한 대량의 스몰파일 처리방법)

  • Kim, Chang-Bok;Chung, Jae-Pil
    • Journal of Advanced Navigation Technology
    • /
    • v.18 no.4
    • /
    • pp.401-408
    • /
    • 2014
  • Hadoop is composed with MapReduce programming model for distributed processing and HDFS distributed file system. Hadoop is suitable framework for big data processing, but processing of mass small files have many problems. The processing of mass small file in hadoop have problems to created one mapper per one file, and it have problems to needed many memory for store of meta information of file. This paper have comparison evaluation processing method of mass small file with various method in hadoop platform. The processing of general compression format is inadequate because of processing by one mapper regardless of data size. The processing of sequence and hadoop archive file is removed memory problem of namenode by compress and combine of small file. Hadoop archive file is faster then sequence file about combine time of small file. The processing using CombineFileInputFormat class is needed not combine of small file, and it have similar speed big data processing method.

The Customer Premise Platform for Processing Multimedia Data on the ATM network (ATM망의 멀티미디어 데이터 처리를 위한 가입자단 플랫폼)

  • Kim Yunhong;Son Yoonsik
    • Journal of the Institute of Electronics Engineers of Korea SD
    • /
    • v.42 no.2 s.332
    • /
    • pp.89-96
    • /
    • 2005
  • In this paper, we propose a customer premise platform for processing multimedia data service on the ATM network. The proposed platform has a specific AAL2 processor that includes AAL2 protocol and scheduler algorithm so as to off-load large potion of burden from host processor and make it easy to process multimedia data from the ATM network in real time compared with conventional platform in which AAL/ATM tasks are processed by software. The ATS scheduler that is implemented based on 2-level time slot ring provides a simple and efficient method for scheduling data of VBR-rt, UBR and CBR traffics. TMS320C5402 DSP is used to process voice-related tasks such as voice compression and voice packet manupulation and AAL2 processor is implemented on $0.35\;{\mu}m$ process line. We implemented the customer premise equipment for VoDSL service and tested the proposed platform on a test bed network. The experimental results show that the proposed equipment has the call success rate of $97\%$ at least and provides voice service of toll-qualify.

A Study on the Public Officials-AI Collaboration Platform for the Government's Successful Intelligent Informatization Innovation (정부의 지능 정보화 혁신 성공을 위한 공무원-AI 협업 플랫폼에 관한 연구)

  • ChangIk Oh;KiJung Ryu;Joonyeong Ahn;Dongho Kim
    • Journal of Information Technology Services
    • /
    • v.22 no.4
    • /
    • pp.111-122
    • /
    • 2023
  • Since the organization of civil servants has been divided and stratified according to the characteristics of the bureaucracy, it is inevitable that the organization and personnel will increase when new tasks arise. Even in the process of informatization, only the processing method was brought online while leaving the existing business processing procedures as they were, so there was no reduction in manpower through informatization. In order to maintain or upgrade the current administrative services while reducing the number of civil servants, it is inevitable to use AI technology. By using data and AI to integrate the 'powers and responsibilities assigned to the officials in charge', manpower can be reduced, and the reduced costs can be reinvested in the collection, analysis, and utilization of on-site data to further promote intelligent informatization. In this study, as a way for the government's success in intelligent informatization innovation, we proposed a 'Civil Servants-AI Collaboration Platform'. This Platform based on the civil servant proposal system as a reward system and the characteristics of intelligent informatization that are different from the informatization. By establishing a 'Civil Servants-AI Collaboration Platform', the performance evaluation system of the short-term evaluation method by superiors can be improved to a data-driven always-on evaluation method, thereby alleviating the rigid hierarchy of government organizations. In addition, through the operation of Collaboration Platform, it will become common to define and solve problems using data and AI, and the intelligence informatization of government organizations will be activated.

IX-Platform : 한국형 주거문화를 위한 홈게이트웨이 및 플랫폼

  • 전영표
    • Korea Information Processing Society Review
    • /
    • v.11 no.3
    • /
    • pp.67-73
    • /
    • 2004
  • 홈네트워크는 1980년대 Home Automation에서 출발한 개념으로서 가전기기의 자동 및 원격제어, 가정에 쓰이는 에너지(전기ㆍ가스 등)의 효율적 이용, 각종 방범 등을 목적으로 시작하였다. 그러나 Home Automation은 많은 비용을 수반하였고 가전장비와의 통신에 제한이 있었기 때문에 일반인들 속으로 파고들지는 못하였다. (중략)

  • PDF

A Hadoop-based Multimedia Transcoding System for Processing Social Media in the PaaS Platform of SMCCSE

  • Kim, Myoungjin;Han, Seungho;Cui, Yun;Lee, Hanku;Jeong, Changsung
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.6 no.11
    • /
    • pp.2827-2848
    • /
    • 2012
  • Previously, we described a social media cloud computing service environment (SMCCSE). This SMCCSE supports the development of social networking services (SNSs) that include audio, image, and video formats. A social media cloud computing PaaS platform, a core component in a SMCCSE, processes large amounts of social media in a parallel and distributed manner for supporting a reliable SNS. Here, we propose a Hadoop-based multimedia system for image and video transcoding processing, necessary functions of our PaaS platform. Our system consists of two modules, including an image transcoding module and a video transcoding module. We also design and implement the system by using a MapReduce framework running on a Hadoop Distributed File System (HDFS) and the media processing libraries Xuggler and JAI. In this way, our system exponentially reduces the encoding time for transcoding large amounts of image and video files into specific formats depending on user-requested options (such as resolution, bit rate, and frame rate). In order to evaluate system performance, we measure the total image and video transcoding time for image and video data sets, respectively, under various experimental conditions. In addition, we compare the video transcoding performance of our cloud-based approach with that of the traditional frame-level parallel processing-based approach. Based on experiments performed on a 28-node cluster, the proposed Hadoop-based multimedia transcoding system delivers excellent speed and quality.

An Exploratory Study on the Uniqueness of Crowds and its Implications for Public Data Platform Design from the Information Processing View (정보처리관점에서 본 대중의 특성과 공공데이터 플랫폼 설계 시사점에 관한 탐색 연구)

  • Kim, Sang Wook;Lee, Jae Sook
    • Journal of the Korea Convergence Society
    • /
    • v.8 no.11
    • /
    • pp.373-381
    • /
    • 2017
  • As the viewpoint of data evolves from business resources to value resources, the focus on the data processing is rapidly shifting from the cartesian (alphanumeric) to the contextual. In response to this trend, the government is actively promoting the utilization of public data by the private sectors. With a focus on the fact that the mainstream of public data users is the crowds, this study, therefore, seeks to identify differences between the members and the crowds from information processing view, followed by presenting directions and main points for the design of data platform. This study is perhaps to be a starting point for finding practical alternatives for creating 'collective intelligence ecosystem' and to be a basis for building a big data base in response to the opening of public data.

A New SoC Platform with an Application-Specific PLD (전용 PLD를 가진 새로운 SoC 플랫폼)

  • Lee, Jae-Jin;Song, Gi-Yong
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.8 no.4
    • /
    • pp.285-292
    • /
    • 2007
  • SoC which deploys software modules as well as hardware IPs on a single chip is a major revolution taking place in the implementation of a system design, and high-level synthesis is an important process of SoC design methodology. Recently, SPARK parallelizing high-level synthesis software tool has been developed. It takes a behavioral ANSI-C code as an input, schedules it using code motion and various code transformations, and then finally generates synthesizable RTL VHDL code. Although SPARK employs various loop transformation algorithms, the synthesis results generated by SPARK are not acceptable for basic signal and image processing algorithms with nested loop. In this paper we propose a SoC platform with an application-specific PLD targeting local operations which are feature of many loop algorithms used in signal and image processing, and demonstrate design process which maps behavioral specification with nested loops written in a high-level language (ANSI-C) onto 2D systolic array. Finally the derived systolic array is implemented on the proposed application-specific PLD of SoC platform.

  • PDF

APPLICATION OF FINITE ELEMENT ANALYSIS TO EVALUATE PLATFORM SWITCHING

  • Kim Yang-Soo;Kim Chang-Whe;Jang Kyung-Soo;Lim Young-Jun
    • The Journal of Korean Academy of Prosthodontics
    • /
    • v.43 no.6
    • /
    • pp.727-735
    • /
    • 2005
  • Statement of problem. Platform switching in implant prosthesis has been used for esthetic and biological purpose. But there are few reports for this concept. Purpose. The purpose of this study is evaluation of platform switching in wide implant by three dimensional finite element analysis. Materials and Methods. The single implant and prosthesis was modeled in accordance with the geometric designs for Osstem implant system. Three-dimensional finite element models were developed for (1) a wide diameter 3i type titanium implant 5 mm in diameter, 13 mm in length with wide cemented abutment, titanium alloy abutment screw, and prosthesis (2) a wide diameter 3i type titanium implant 5 mm in diameter, 13 mm in length with regular cemented abutment, titanium alloy abutment screw and prosthesis(platform switching) was made for finite element analysis. The abutment screws were subjected to a tightening torque of 30 Ncm. The amount of preload was hypothesized to 650N, and round and flat type prostheses were loaded to 200 N. Four loading offset point (0, 2, 4, 6 mm from the center of the implants) were evaluated. Models were processed by the software programs HyperMesh and ANSA. The PAM-CRASH 2G simulation software was used for analysis of stress. The PAM-VIEW and HyperView were used for post processing. Results. The results from experiment were as follows; 1. von Mises stress value is increased in order of bone, abutment, implant and abutment screw. 2. von Mises stress of abutment screw is lower when platform switching. 3. von Mises stress of implant is lower when platform switching until loading offset 4 mm. 4. von Mises stress of abutment is similar between each other. 5. von Mises stress of bone is slightly higher when platform switching. Conclusion. The von Mises stress pattern of implant components is favor when platform switch ing but slightly higher in bone stress distribution than use of wide abutment. The research about stress distribution is essential for investigation of the cortical bone loss.

Reproduction based Multi-Contents Distribution Platform

  • Lee, Byung-Duck;Lee, Keun-Ho;Han, Seong-Soo;Jeong, Chang-Sung
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.2
    • /
    • pp.695-712
    • /
    • 2021
  • As the use of smart devices is being increased rapidly by the development of internet and IT technology, the contents production and utilization rate are showing higher increase, too. In addition, the type of contents also shows very diverse forms such as education, game, video, UCC, etc. In the meantime, the contents are reproduced in diverse forms by reprocessing the original contents, and they are being serviced through the contents service platform. Therefore, the platform to make the contents reprocessing easy and fast is needed. As the diverse contents distribution channels such as YouTube, SNS, App Service, etc, easier contents distribution platform is needed, and the development of the relevant area is expected. In addition, as the selective consumption of the contents having easy accessibility through diverse smart devices is distinguished, the demand for the platform and service that can identify the contents consumption propensity by individual is being increased. Therefore, in this study, to vitalize the online contents distribution, the contents reproduction and publishing platform, was designed and materialized, which can reproduce and distribute the contents based on the real-time contents editing technology in URL unit and the consumer propensity analysis technology using the data management-based broadcasting contents distribution metadata technology and the edited image contents streaming technology. In addition, in the results of comparing with other platforms through the experiment, the performance superiority of the suggested platform was verified. If the suggested platform is applied to the areas of education, broadcasting, press, etc, the multi-media contents can be reproduced and distributed easily, through which the vitalization of contents-related industry is expected.

Parallel LDPC Decoding on a Heterogeneous Platform using OpenCL

  • Hong, Jung-Hyun;Park, Joo-Yul;Chung, Ki-Seok
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.10 no.6
    • /
    • pp.2648-2668
    • /
    • 2016
  • Modern mobile devices are equipped with various accelerated processing units to handle computationally intensive applications; therefore, Open Computing Language (OpenCL) has been proposed to fully take advantage of the computational power in heterogeneous systems. This article introduces a parallel software decoder of Low Density Parity Check (LDPC) codes on an embedded heterogeneous platform using an OpenCL framework. The LDPC code is one of the most popular and strongest error correcting codes for mobile communication systems. Each step of LDPC decoding has different parallelization characteristics. In the proposed LDPC decoder, steps suitable for task-level parallelization are executed on the multi-core central processing unit (CPU), and steps suitable for data-level parallelization are processed by the graphics processing unit (GPU). To improve the performance of OpenCL kernels for LDPC decoding operations, explicit thread scheduling, vectorization, and effective data transfer techniques are applied. The proposed LDPC decoder achieves high performance and high power efficiency by using heterogeneous multi-core processors on a unified computing framework.