• Title/Summary/Keyword: HDFS

Search Result 152, Processing Time 0.032 seconds

An Efficient Design and Implementation of an MdbULPS in a Cloud-Computing Environment

  • Kim, Myoungjin;Cui, Yun;Lee, Hanku
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.9 no.8
    • /
    • pp.3182-3202
    • /
    • 2015
  • Flexibly expanding the storage capacity required to process a large amount of rapidly increasing unstructured log data is difficult in a conventional computing environment. In addition, implementing a log processing system providing features that categorize and analyze unstructured log data is extremely difficult. To overcome such limitations, we propose and design a MongoDB-based unstructured log processing system (MdbULPS) for collecting, categorizing, and analyzing log data generated from banks. The proposed system includes a Hadoop-based analysis module for reliable parallel-distributed processing of massive log data. Furthermore, because the Hadoop distributed file system (HDFS) stores data by generating replicas of collected log data in block units, the proposed system offers automatic system recovery against system failures and data loss. Finally, by establishing a distributed database using the NoSQL-based MongoDB, the proposed system provides methods of effectively processing unstructured log data. To evaluate the proposed system, we conducted three different performance tests on a local test bed including twelve nodes: comparing our system with a MySQL-based approach, comparing it with an Hbase-based approach, and changing the chunk size option. From the experiments, we found that our system showed better performance in processing unstructured log data.

Delayed Block Replication Scheme of Hadoop Distributed File System for Flexible Management of Distributed Nodes (하둡 분산 파일시스템에서의 유연한 노드 관리를 위한 지연된 블록 복제 기법)

  • Ryu, Woo-Seok
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.12 no.2
    • /
    • pp.367-374
    • /
    • 2017
  • This paper discusses management problems of Hadoop distributed node, which is a platform for big data processing, and proposes a novel technique for enabling flexible node management of Hadoop Distributed File System. Hadoop cannot configure Hadoop cluster dynamically because it judges temporarily unavailable nodes as a failure. Delayed block replication scheme proposed in this paper delays the removal of unavailable node as much as possible so as to be easily rejoined. Experimental results show that the proposed scheme increases flexibility of node management with little impact on distributed processing performance when the cluster size changes.

Screening of Plants with Inhibitory Activity on Cellular Senescence

  • Lee, Seung-Eun;Kim, Jae-Ryong;Noh, Hyung-Jun;Kim, Geum-Sook;Lee, Jeong-Hoon;Choi, Jehun;Lee, Dae-Young;Kim, Seung-Yu
    • Korean Journal of Plant Resources
    • /
    • v.27 no.6
    • /
    • pp.601-609
    • /
    • 2014
  • In this study, the effect of plant extract on the senescence action and cell survival rate in two types of cells, in which aging was derived by adriamycin, was analyzed to find the materials for suppressing cell senescence from natural resources. The results are as follows. For human umbilical vein endothelial cells (HUVECs), the fruit of Physalis angulata L. and the aerial part of Synurus deltoides (Aiton) Nakai showed excellent cell-senescence inhibition activities in a treatment concentration-dependent manner, demonstrating the high possibility for utilization as a material for prevention and treatment for vascular diseases. The water extract from the root of Polygonatum odoratum var. pluriflorum for variegatum Y. N. Lee showed potent cell-senescence inhibitory effect for human dermal fibroblasts (HDFs). Thus it is considered that the additional study on the plant needs for elucidating the possible utilization as material for skin health improvement.

Sulforaphane Inhibits Ultraviolet B-induced Matrix Metalloproteinase Expression in Human Dermal Fibroblasts

  • Lee, Sam Youn;Moon, Sun Rock
    • Journal of Physiology & Pathology in Korean Medicine
    • /
    • v.26 no.6
    • /
    • pp.922-928
    • /
    • 2012
  • Sulforaphane [1-isothiocyanato-4-(methylsulfinyl)-butane] is one of the most abundant isothiocyanates in some cruciferous vegetables, especially broccoli. Sulforaphaene has been shown to exhibit many pharmacological activities, including anti-oxidant, anti-inflammatory and anti-microbial activities. However, the anti-skin photoaging effects of sulforaphane have not yet been reported. In the present study, we investigated the inhibitory effects of sulforaphane on MMP-1 and -3 expressions of the human dermal fibroblasts via various in vitro experiments and elucidated the pathways of inhibition. Western blot analysis and real-time PCR revealed sulfiraphane inhibited UVB-induced MMP-1 and -3 expressions in a dose-dependent manner. UVB strongly activated nuclear factor-${\kappa}B$ (NF-${\kappa}B$) activity, which was determined by NF-${\kappa}B$ DNA binding activity. UVB-induced NF-${\kappa}B$ activation and MMP expression were completely blocked by sulforphane. These findings suggest that sulforaphane could prevent UVB-induced MMPs expressions through inhibition of NF-${\kappa}B$ activation.

Implementation and Performance Analysis of Hadoop MapReduce over Lustre Filesystem (러스터 파일 시스템 기반 하둡 맵리듀스 실행 환경 구현 및 성능 분석)

  • Kwak, Jae-Hyuck;Kim, Sangwan;Huh, Taesang;Hwang, Soonwook
    • KIISE Transactions on Computing Practices
    • /
    • v.21 no.8
    • /
    • pp.561-566
    • /
    • 2015
  • Hadoop is becoming widely adopted in scientific and commercial areas as an open-source distributed data processing framework. Recently, for real-time processing and analysis of data, an attempt to apply high-performance computing technologies to Hadoop is being made. In this paper, we have expanded the Hadoop Filesystem library to support Lustre, which is a popular high-performance parallel distributed filesystem, and implemented the Hadoop MapReduce execution environment over the Lustre filesystem. We analysed Hadoop MapReduce over Lustre by using Hadoop standard benchmark tools. We found that Hadoop MapReduce over Lustre execution has a performance 2-13 times better than a typical Hadoop MapReduce execution.

A Study on Data Storage and Recovery in Hadoop Environment (하둡 환경에 적합한 데이터 저장 및 복원 기법에 관한 연구)

  • Kim, Su-Hyun;Lee, Im-Yeong
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.2 no.12
    • /
    • pp.569-576
    • /
    • 2013
  • Cloud computing has been receiving increasing attention recently. Despite this attention, security is the main problem that still needs to be addressed for cloud computing. In general, a cloud computing environment protects data by using distributed servers for data storage. When the amount of data is too high, however, different pieces of a secret key (if used) may be divided among hundreds of distributed servers. Thus, the management of a distributed server may be very difficult simply in terms of its authentication, encryption, and decryption processes, which incur vast overheads. In this paper, we proposed a efficiently data storage and recovery scheme using XOR and RAID in Hadoop environment.

Effect of nitric oxide on the expression of matrix metalloproteinases by the UV irradiated human dermal fibroblasts

  • Taeboo Choe;Lee, Bumchun;Park, Inchul;Seokil Hong
    • Journal of the Society of Cosmetic Scientists of Korea
    • /
    • v.28 no.1
    • /
    • pp.31-41
    • /
    • 2002
  • The production of matrix matalloproteinases(MMPs) by the UV irradiated skin fibroblast and the degradation of extracellular matrix(ECM) by these enzymes is known as one of the main reasons of photoaging. Recently, Fisher group showed that the MMP expression is mainly regulated by the mitogen-activated protein(MAP) kinas family, such as extracellular signal-regulated kinase(ERK), c-Jun amino-terminal kinase(JNK) and p38, each of which forms a signaling pathway. In this work we first examined the effect of nitric oxide (NO) on the production of MMP-1 and MMP-2 by the human dermal fibroblasts (HDFs). NO is a multifunctional messenger molecule generated from L-arginine and involved in many kinds of signaling pathway. We found that the treatment of HDF with NO donor, sodium nitroprusside (SNP) enhanced the expression of MMPs with or without UV irradiation and the treatment with nitric oxide synthase (NOS) inhibitors resulted in the significant decrease of MMPs production. From these results, we concluded that the production of MMPs by the UV irradiated HDF is regulated through the signaling pathway involving NO and cyclic GMP.

Implementaion of Video Processing Framework using Hadoop-based cloud computing (Hadoop 기반 클라우드 컴퓨팅을 이용한 영상 처리 프레임워크 구현)

  • Ryu, Chungmo;Lee, Daecheol;Jang, Minwook;Kim, Cheolgi
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2013.11a
    • /
    • pp.139-142
    • /
    • 2013
  • 최근 대용량 영상데이터로부터 정보 수집, 영상 처리를 위한 클라우드 관련 연구들이 활발하다. 그러나 공개 소프트웨어를 이용한 클라우드 연구의 대부분은 라이브러리 수준이 아닌 단순히 프로그램 수준의 조합으로 작동한다. 이런 이유로 단순 조합에 따른 비효율성에 의한 성능문제는 크게 다루어지지 않는다. 본 논문에서는 이 비효율성을 해결하는데 중점을 두고 FFmpeg과 Hadoop을 라이브러리 수준으로 결합하여 기존보다 더 나은 성능의 영상클라우드 환경을 구축하였다. C기반의 영상처리 라이브러리인 FFmpeg와 JAVA기반의 클라우드 환경 Hadoop의 결합을 위해 JNI(Java Native Interface)를 이용하였다. 상세구현으로는 HDFS(Hadoop Distributed File System)을 확장하여 Hadoop MapReduce가 직접 FFmpeg을 통한 영상파일 접근이 가능하게 하였다. 이로써 FFmpeg과 Hadoop간 상이한 파일 접근 방식에서 발생하는 불필요한 작업에 의한 시스템의 성능저하를 막았다. 또한 응용의 확장성을 위해 영상작업시 작업영상을 영상처리의 최소단위인 GOP(Group of Pictures)단위로 잘라 클라우드의 노드들에게 분산시켰다. 결과적으로 기존에 존재하는 Hadoop과 FFmpeg을 프로그램적으로 결합한 영상처리 클라우드보다 총 처리시간을 앞당겼고, GOP 단위의 영상 처리는 영상기반 작업에 안정성과 응용의 확장성을 보장해주었다.

Identification of Loliolide with Anti-Aging Properties from Scenedesmus deserticola JD052

  • Dae-Hyun Cho;Jin-Ho Yun;Jina Heo;In-Kyoung Lee;Yong-Jae Lee;Seunghee Bae;Bong-Sik Yun;Hee-Sik Kim
    • Journal of Microbiology and Biotechnology
    • /
    • v.33 no.9
    • /
    • pp.1250-1256
    • /
    • 2023
  • Herein, different extracts of Scenedesmus deserticola JD052, a green microalga, were evaluated in vitro as a potential anti-aging bioagent. Although post-treatment of microalgal culture with either UV irradiation or high light illumination did not lead to a substantial difference in the effectiveness of microalgal extracts as a potential anti-UV agent, the results indicated the presence of a highly potent compound in ethyl acetate extract with more than 20% increase in the cellular viability of normal human dermal fibroblasts (nHDFs) compared with the negative control amended with DMSO. The subsequent fractionation of the ethyl acetate extract led to two bioactive fractions with high anti-UV property; one of the fractions was further separated down to a single compound. While electrospray ionization mass spectrometry (ESI-MS) and nuclear magnetic resonance (NMR) spectroscopy analysis identified this single compound as loliolide, its identification has been rarely reported in microalgae previously, prompting thorough systematic investigations into this novel compound for the nascent microalgal industry.

Development of a highly effective recombinant protein from human collagen type III Alpha 1 (COL3A1) to enhance human skin cell functionality

  • Young Un Kim;HyunJoon Gi;Eun Kyung Jeong;Seokwon Han;Woo-Young Seo;Young Jun Kim;Sang Bae Lee;KyeongJin Kim
    • BMB Reports
    • /
    • v.57 no.9
    • /
    • pp.424-429
    • /
    • 2024
  • Collagen type III, a member of the fibrillar collagen group, is a major component of the extracellular matrix in various internal organs, the vascular systems, and skin. It is essential to maintain the structural integrity and functionality of these tissues, and plays a significant role in wound healing, often found alongside collagen type I. Despite being the second most abundant collagen in human tissues after type I, its biological functions on various skin properties have not been thoroughly studied. In this study, we have isolated and developed an effective recombinant protein derived from human collagen type III alpha 1 chain (hCOL3A1). Our findings demonstrate that the recombinant proteins hCOL3A1-THR-M1 and M4 stimulate cell proliferation and collagen biosynthesis in human dermal fibroblasts (HDFs), and enhance wound healing. Notably, hCOL3A1-THR-M1 (referred to as HUCOLLATIN3) specifically penetrates both the epidermal and dermal layers in a full-thickness skin model. These results collectively indicate that hCOL3A1-THR-M1 holds promise as a potential biomaterial to prevent skin aging.