• Title/Summary/Keyword: HDFs

Search Result 151, Processing Time 0.023 seconds

Research of Soft-Interface Creation and Provision Methodology According to Applications Based on Mobile Device Environment (모바일 디바이스 환경에서 어플리케이션에 따른 소프트 인터페이스 제작 및 제공 방안 연구)

  • Cho, Changhee;Park, Sanghyun;Lee, Sang-Joon;Kim, Jinsul
    • Journal of Digital Contents Society
    • /
    • v.14 no.4
    • /
    • pp.513-519
    • /
    • 2013
  • In this paper, we provide interfaces according to user application environments and provide tools through web-site that users can create interface to apply a wide range of application environment. HTML5 is used in the creation processing, so users can create various interfaces by dragging mouse and apply it to multimedia, game applications as well as documents by using the ASCII code and key events that are provided in the Android OS. Database of interfaces is stored in HDFS (Hadoop Distributed File System) based on Hadoop for management and users can have their own designed interface or select interfaces through simple login any time. In order to provide interface quickly, HIVE based on Hadoop is used for search and the data is provided in XML file which smart mobile can process quickly.

Development of Retargetable Hadoop Simulation Environment Based on DEVS Formalism (DEVS 형식론 기반의 재겨냥성 하둡 시뮬레이션 환경 개발)

  • Kim, Byeong Soo;Kang, Bong Gu;Kim, Tag Gon;Song, Hae Sang
    • Journal of the Korea Society for Simulation
    • /
    • v.26 no.4
    • /
    • pp.51-61
    • /
    • 2017
  • Hadoop platform is a representative storing and managing platform for big data. Hadoop consists of distributed computing system called MapReduce and distributed file system called HDFS. It is important to analyse the effectiveness according to the change of cluster constructions and several parameters. However, since it is hard to construct thousands of clusters and analyse the constructed system, simulation method is required to analyse the system. This paper proposes Hadoop simulator based on DEVS formalism which provides hierarchical and modular modeling. Hadoop simulator provides a retargetable experimental environment that is possible to change of various parameters, algorithms and models. It is also possible to design input models reflecting the characteristics of Hadoop applications. To maximize the user's convenience, the user interface, real-time model viewer, and input scenario editor are also provided. In this paper, we validate Hadoop Simulator through the comparison with the Hadoop execution results and perform various experiments.

Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside

  • Kim, Seong-Hoon;Roh, Myung-Il;Kim, Ki-Su;Oh, Min-Jae
    • Journal of Advanced Research in Ocean Engineering
    • /
    • v.3 no.1
    • /
    • pp.32-40
    • /
    • 2017
  • Recently, the amount of data to be processed and the complexity thereof have been increasing due to the development of information and communication technology, and industry's interest in such big data is increasing day by day. In the shipbuilding and offshore industry also, there is growing interest in the effective utilization of data, since various and vast amounts of data are being generated in the process of design, production, and operation. In order to effectively utilize big data in the shipbuilding and offshore industry, it is necessary to store and process large amounts of data. In this study, it was considered efficient to apply Hadoop and R, which are mostly used in big data related research. Hadoop is a framework for storing and processing big data. It provides the Hadoop Distributed File System (HDFS) for storing big data, and the MapReduce function for processing. Meanwhile, R provides various data analysis techniques through the language and environment for statistical calculation and graphics. While Hadoop makes it is easy to handle big data, it is difficult to finely process data; and although R has advanced analysis capability, it is difficult to use to process large data. This study proposes a big data platform based on Hadoop for applications in the shipbuilding and offshore industry. The proposed platform includes the existing data of the shipyard, and makes it possible to manage and process the data. To check the applicability of the platform, it is applied to estimate the weights of offshore structure topsides. In this study, we store data of existing FPSOs in Hadoop-based Hortonworks Data Platform (HDP), and perform regression analysis using RHadoop. We evaluate the effectiveness of large data processing by RHadoop by comparing the results of regression analysis and the processing time, with the results of using the conventional weight estimation program.

Operational Big Data Analytics platform for Smart Factory (스마트팩토리를 위한 운영빅데이터 분석 플랫폼)

  • Bae, Hyerim;Park, Sanghyuck;Choi, Yulim;Joo, Byeongjun;Sutrisnowati, Riska Asriana;Pulshashi, Iq Reviessay;Putra, Ahmad Dzulfikar Adi;Adi, Taufik Nur;Lee, Sanghwa;Won, Seokrae
    • The Journal of Bigdata
    • /
    • v.1 no.2
    • /
    • pp.9-19
    • /
    • 2016
  • Since ICT convergence became a major issue, German government has carried forward a policy 'Industry 4.0' that triggered ICT convergence with manufacturing. Now this trend gets into our stride. From this facts, we can expect great leap up to quality perfection in low cost. Recently Korean government also enforces policy with 'Manufacturing 3.0' for upgrading Korean manufacturing industry with being accelerated by many related technologies. We, in the paper, developed a custom-made operational big data analysis platform for the implementation of operational intelligence to improve industry capability. Our platform is designed based on spring framework and web. In addition, HDFS and spark architectures helps our system analyze massive data on the field with streamed data processed by process mining algorithm. Extracted knowledge from data will support enhancement of manufacturing performance.

  • PDF

Trophic Role of Heterotrophic Nano- and Microplankton in the Pelagic Microbial Food Web of Drake Passage in the Southern Ocean during Austral Summer (남극 하계 드레이크 해협의 미세생물 먹이망에서 종속영양 미소형 및 소형플랑크톤의 역할)

  • Yang, Eun-Jin;Choi, Joong-Ki;Hyun, Jung-Ho
    • Ocean and Polar Research
    • /
    • v.33 no.4
    • /
    • pp.457-472
    • /
    • 2011
  • To elucidate the trophic role of heterotrophic nano- and microplankton (HNMP), we investigated their biomass, community structure, and herbivory in three different water masses, namely, south of Polar Front (SPF), Polar Front Zone (PFZ), the Sub-Antarcitc Front (SAF) in the Drake Passage in the Southern Ocean, during the austral summer in 2002. We observed a spatial difference in the relative importance of the dominant HNMP community in these water masses. Ciliates accounted for 34.7% of the total biomass on an average in the SPF where the concentration of chlorophyll-a was low with the dominance of pico- and nanophytoplankton. Moreover, the importance of ciliates declined from the SPF to the SAF. In contrast, heterotrophic dinoflagellates (HDFs) were the most dominant grazers in the PFZ where the concentration of chlorophyll-a was high with the dominance of net phytoplankton. HNMP biomass ranged from 321.9 to 751.4 $mgCm^{-2}$ and was highest in the PFZ and lowest in the SPF. This result implies that the spatial dynamic of HNMP biomass and community was significantly influenced by the composition and concentration of phytoplankton as a food source. On an average, 75.6%, 94.5%, and 78.9% of the phytoplankton production were consumed by HNMP in the SPF, PFZ, and SAF, respectively. The proportion of phytoplankton grazed by HNMP was largely determined by the composition and biomass of HNMP, as well as the composition of phytoplankton. However, the herbivory of HNMP was one of the most important loss processes affecting the biomass and composition of phytoplankton particularly in the PFZ. Our results suggest that the bulk of the photosynthetically fixed carbon was likely reprocessed by HNMP rather than contributing to the vertical flux in Drake Passage during the austral summer in 2002.

A Hadoop-based Multimedia Transcoding System for Processing Social Media in the PaaS Platform of SMCCSE

  • Kim, Myoungjin;Han, Seungho;Cui, Yun;Lee, Hanku;Jeong, Changsung
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.6 no.11
    • /
    • pp.2827-2848
    • /
    • 2012
  • Previously, we described a social media cloud computing service environment (SMCCSE). This SMCCSE supports the development of social networking services (SNSs) that include audio, image, and video formats. A social media cloud computing PaaS platform, a core component in a SMCCSE, processes large amounts of social media in a parallel and distributed manner for supporting a reliable SNS. Here, we propose a Hadoop-based multimedia system for image and video transcoding processing, necessary functions of our PaaS platform. Our system consists of two modules, including an image transcoding module and a video transcoding module. We also design and implement the system by using a MapReduce framework running on a Hadoop Distributed File System (HDFS) and the media processing libraries Xuggler and JAI. In this way, our system exponentially reduces the encoding time for transcoding large amounts of image and video files into specific formats depending on user-requested options (such as resolution, bit rate, and frame rate). In order to evaluate system performance, we measure the total image and video transcoding time for image and video data sets, respectively, under various experimental conditions. In addition, we compare the video transcoding performance of our cloud-based approach with that of the traditional frame-level parallel processing-based approach. Based on experiments performed on a 28-node cluster, the proposed Hadoop-based multimedia transcoding system delivers excellent speed and quality.

Polymeric nanoparticles as dual-imaging probes for cancer management

  • Menon, Jyothi U.;Jadeja, Parth;Tambe, Pranjali;Thakore, Dheeraj;Zhang, Shanrong;Takahashi, Masaya;Xie, Zhiwei;Yang, Jian;Nguyen, Kytai T.
    • Biomaterials and Biomechanics in Bioengineering
    • /
    • v.3 no.3
    • /
    • pp.129-140
    • /
    • 2016
  • This article reports the development of biodegradable photoluminescent polymer (BPLP)-based nanoparticles (NPs) incorporating either magnetic nanoparticles (BPLP-MNPs) or gadopentate dimeglumine (BPLP-Gd NPs), for cancer diagnosis and treatment. The aim of the study is to compare these nanoparticles in terms of their surface properties, fluorescence intensities, MR imaging capabilities, and in vitro characteristics to choose the most promising dual-imaging nanoprobe. Results indicate that BPLP-MNPs and BPLP-Gd NPs had a size of $195{\pm}43nm$ and $161{\pm}55nm$, respectively and showed good stability in DI water and 10% serum for 5 days. BPLP-Gd NPs showed similar fluorescence as the original BPLP materials under UV light, whereas BPLP-MNPs showed comparatively less fluorescence. VSM and MRI confirmed that the NPs retained their magnetic properties following encapsulation within BPLP. Further, in vitro studies using HPV-7 immortalized prostate epithelial cells and human dermal fibroblasts (HDFs) showed > 70% cell viability up to $100{\mu}g/ml$ NP concentration. Dose-dependent uptake of both types of NPs by PC3 and LNCaP prostate cancer cells was also observed. Thus, our results indicate that BPLP-Gd NPs would be more appropriate for use as a dual-imaging probe as the contrast agent does not mask the fluorescence of the polymer. Future studies would involve in vivo imaging following administration of BPLP-Gd NPs for biomedical applications including cancer detection.

Fabrication of Micro Patterned Fibronectin for Studying Adhesion and Alignment Behavior of Human Dermal Fibroblasts

  • Lee, Seung-Jae;Son, Young-Sook;Kim, Chun-Ho;Choi, Man-Soo
    • Macromolecular Research
    • /
    • v.15 no.4
    • /
    • pp.348-356
    • /
    • 2007
  • The aim of this study was to fabricate a submicro-and micro-patterned fibronectin coated wafer for a cell culture, which allows the positions and dimensions of the attached cells to be controlled. A replica molding was made into silicon via a photomask in quartz, using E-beam lithography, and then fabricated a polydimethylsiloxane stamp using the designed silicon mold. Hexadecanethiol $[HS(CH_2){_{15}}CH_3]$, adsorbed on the raised plateau of the surface of polydimethylsiloxane stamp, was contact-printed to form self-assembled monolayers (SAMs) of hexadecanethiolate on the surface of an Au-coated glass wafer. In order to form another SAM for control of the surface wafer properties, a hydrophilic hexa (ethylene glycol) terminated alkanethiol $[HS(CH_2){_{11}}(OCH_2CH_2){_6}OH]$ was also synthesized. The structural changes were confirmed using UV and $^1H-NMR$ spectroscopies. A SAM terminated in the hexa(ethylene glycol) groups was subsequently formed on the bare gold remaining on the surface of the Aucoated glass wafer. In order to aid the attachment of cells, fibronectin was adsorbed onto the resulting wafer, with the pattern formed on the gold-coated wafer confirmed using immunofluorescence staining against fibronectin. Fibronectin was adsorbed only onto the SAMs terminated in the methyl groups of the substrate. The hexa (ethylene glycol)-terminated regions resisted the adsorption of protein. Human dermal fibroblasts (P=4), obtained from newborn foreskin, only attached to the fibronectin-coated, methyl-terminated hydrophobic regions of the patterned SAMs. N-HDFs were more actively adhered, and spread in a pattern spacing below $14{\mu}m$, rather than above $17{\mu}m$, could easily migrate on the substrate containing spacing of $10{\mu}m$ or less between the strip lines.

Human collagen alpha-2 type I stimulates collagen synthesis, wound healing, and elastin production in normal human dermal fibroblasts (HDFs)

  • Hwang, Su Jin;Ha, Geun-Hyoung;Seo, Woo-Young;Kim, Chung Kwon;Kim, KyeongJin;Lee, Sang Bae
    • BMB Reports
    • /
    • v.53 no.10
    • /
    • pp.539-544
    • /
    • 2020
  • Skin aging appears to be the result of overlapping intrinsic (including genetic and hormonal factors) and extrinsic (external environment including chronic light exposure, chemicals, and toxins) processes. These factors cause decreases in the synthesis of collagen type I and elastin in fibroblasts and increases in the melanin in melanocytes. Collagen Type I is the most abundant type of collagen and is a major structural protein in human body tissues. In previous studies, many products containing collagen derived from land and marine animals as well as other sources have been used for a wide range of purposes in cosmetics and food. However, to our knowledge, the effects of human collagen-derived peptides on improvements in skin condition have not been investigated. Here we isolate and identify the domain of a human COL1A2-derived protein which promotes fibroblast cell proliferation and collagen type I synthesis. This human COL 1A2-derived peptide enhances wound healing and elastin production. Finally, the human collagen alpha-2 type I-derived peptide (SMM) ameliorates collagen type I synthesis, cell proliferation, cell migration, and elastin synthesis, supporting a significant anti-wrinkle effect. Collectively, these results demonstrate that human collagen alpha-2 type I-derived peptides is practically accessible in both cosmetics and food, with the goal of improving skin condition.

A Secure Model for Reading and Writing in Hadoop Distributed File System and its Evaluation (하둡 분산파일시스템에서 안전한 쓰기, 읽기 모델과 평가)

  • Pang, Sechung;Ra, Ilkyeun;Kim, Yangwoo
    • Journal of Internet Computing and Services
    • /
    • v.13 no.5
    • /
    • pp.55-64
    • /
    • 2012
  • Nowadays, as Cloud computing becomes popular, a need for a DFS(distributed file system) is increased. But, in the current Cloud computing environments, there is no DFS framework that is sufficient to protect sensitive private information from attackers. Therefore, we designed and proposed a secure scheme for distributed file systems. The scheme provides confidentiality and availability for a distributed file system using a secret sharing method. In this paper, we measured the speed of encryption and decryption for our proposed method, and compared them with that of SEED algorithm which is the most popular algorithm in this field. This comparison showed the computational efficiency of our method. Moreover, the proposed secure read/write model is independent of Hadoop DFS structure so that our modified algorithm can be easily adapted for use in the HDFS. Finally, the proposed model is evaluated theoretically using performance measurement method for distributed secret sharing model.