• Title/Summary/Keyword: HDFs

Search Result 151, Processing Time 0.031 seconds

Big Data-based Sensor Data Processing and Analysis for IoT Environment (IoT 환경을 위한 빅데이터 기반 센서 데이터 처리 및 분석)

  • Shin, Dong-Jin;Park, Ji-Hun;Kim, Ju-Ho;Kwak, Kwang-Jin;Park, Jeong-Min;Kim, Jeong-Joon
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.19 no.1
    • /
    • pp.117-126
    • /
    • 2019
  • The data generated in the IoT environment is very diverse. Especially, the development of the fourth industrial revolution has made it possible to increase the number of fixed and unstructured data generated in manufacturing facilities such as Smart Factory. With Big Data related solutions, it is possible to collect, store, process, analyze and visualize various large volumes of data quickly and accurately. Therefore, in this paper, we will directly generate data using Raspberry Pi used in IoT environment, and analyze using various Big Data solutions. Collected by using an Sqoop solution collected and stored in the database to the HDFS, and the process is to process the data by using the solutions available Hive parallel processing is associated with Hadoop. Finally, the analysis and visualization of the processed data via the R programming will be used universally to end verification.

Big Data-based Medical Clinical Results Analysis (빅데이터 기반 의료 임상 결과 분석)

  • Hwang, Seung-Yeon;Park, Ji-Hun;Youn, Ha-Young;Kwak, Kwang-Jin;Park, Jeong-Min;Kim, Jeong-Joon
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.19 no.1
    • /
    • pp.187-195
    • /
    • 2019
  • Recently, it has become possible to collect, store, process, and analyze data generated in various fields by the development of the technology related to the big data. These big data technologies are used for clinical results analysis and the optimization of clinical trial design will reduce the costs associated with health care. Therefore, in this paper, we are going to analyze clinical results and present guidelines that can reduce the period and cost of clinical trials. First, we use Sqoop to collect clinical results data from relational databases and store in HDFS, and use Hive, a processing tool based on Hadoop, to process data. Finally we use R, a big data analysis tool that is widely used in various fields such as public sector or business, to analyze associations.

A study on the enhancement and performance optimization of parallel data processing model for Big Data on Emissions of Air Pollutants Emitted from Vehicles (차량에서 배출되는 대기 오염 물질의 빅 데이터에 대한 병렬 데이터 처리 모델의 강화 및 성능 최적화에 관한 연구)

  • Kang, Seong-In;Cho, Sung-youn;Kim, Ji-Whan;Kim, Hyeon-Joung
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.20 no.6
    • /
    • pp.1-6
    • /
    • 2020
  • Road movement pollutant air environment big data is a link between real-time traffic data such as vehicle type, speed, and load using AVC, VDS, WIM, and DTG, which are always traffic volume survey equipment, and road shape (uphill, downhill, turning section) data using GIS. It consists of traffic flow data. Also, unlike general data, a lot of data per unit time is generated and has various formats. In particular, since about 7.4 million cases/hour or more of large-scale real-time data collected as detailed traffic flow information are collected, stored and processed, a system that can efficiently process data is required. Therefore, in this study, an open source-based data parallel processing performance optimization study is conducted for the visualization of big data in the air environment of road transport pollution.

FAST Design for Large-Scale Satellite Image Processing (대용량 위성영상 처리를 위한 FAST 시스템 설계)

  • Lee, Youngrim;Park, Wanyong;Park, Hyunchun;Shin, Daesik
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.25 no.4
    • /
    • pp.372-380
    • /
    • 2022
  • This study proposes a distributed parallel processing system, called the Fast Analysis System for remote sensing daTa(FAST), for large-scale satellite image processing and analysis. FAST is a system that designs jobs in vertices and sequences, and distributes and processes them simultaneously. FAST manages data based on the Hadoop Distributed File System, controls entire jobs based on Apache Spark, and performs tasks in parallel in multiple slave nodes based on a docker container design. FAST enables the high-performance processing of progressively accumulated large-volume satellite images. Because the unit task is performed based on Docker, it is possible to reuse existing source codes for designing and implementing unit tasks. Additionally, the system is robust against software/hardware faults. To prove the capability of the proposed system, we performed an experiment to generate the original satellite images as ortho-images, which is a pre-processing step for all image analyses. In the experiment, when FAST was configured with eight slave nodes, it was found that the processing of a satellite image took less than 30 sec. Through these results, we proved the suitability and practical applicability of the FAST design.

Anti-Oxidant Effect and Anti-Inflammatory of Fermented Citrus unshiu Peel Extract by using Schizophyllum commune (치마버섯을 이용한 진피 발효 배양물의 항산화 및 항염 효과)

  • Song, Min-Hyeon;Bae, Jun-Tae;Ko, Hyun-Ju;Jang, Yong-Man;Lee, Jong-Dae;Lee, Geun-Soo;Pyo, Hyeong-Bae
    • Journal of the Society of Cosmetic Scientists of Korea
    • /
    • v.37 no.4
    • /
    • pp.351-356
    • /
    • 2011
  • Citrus unshiu (C. unshiu) Markovich were dried peel of mandarin orange, of which fresh fruit was one of the famous foods in Korea and Eastern Asia. In the oriental medicine, C. unshiu peel was known to have a diuretic effect and to strengthen spleen function. Recently, natural flavonoids of C. unshiu peel have been investigated. In this study, C. unshiu peel extract containing flavonoid-glycosides was cultured with Schizophyllum commune (S. commune) mycelia producing ${\beta}$-glu- cosidase and its biological activities were investigated. ${\beta}$-glucosidase of S. commune mycelia converted the flavonoid-glycosides (rutin and hesperidin) into aglycones (naringenin and hesperetin). Fermented C. unshiu peel extract compounds were analyzed by HPLC system. The photoprotective potential of fermented C. unshiu peel extract was tested in human dermal fibroblasts (HDFs) exposed to UVA. Fermented C. unshiu peel extract extract also showed notable in vitro anti-inflammatory effect on cellular systems generating cyclooxygenase-2 (COX-2) and 5-lipoxygenase (5-LOX) metabolites. Also, UVB-induced production of interleukin-$1{\alpha}$ in human HaCaT cells was reduced in a dose-dependent manner by treatment with fermented C. unshiu peel extract. These results suggest that fermented C. unshiu peel extract may mitigate the effects of photoaging in skin by reducing UV-induced adverse skin reaction.

Antioxidant and Anti-aging Effects of Extracts from Leaves of Castanea crenata Siebold & Zucc. in Human Dermal Fibroblast (피부 섬유아세포에서 밤나무 잎 추출물의 항산화 및 항노화 효능)

  • Choi, Sun-Il;Lee, Jong Seok;Lee, Sarah;Lee, Hye Jin;Kim, Byung-Jik;Yeo, Joohong;Jung, Tae-Dong;Cho, Bong-Yeon;Choi, Seung-Hyun;Lee, Jin-Ha;Kim, Jong-Yea;Lee, Ok-Hwan
    • Journal of Food Hygiene and Safety
    • /
    • v.32 no.3
    • /
    • pp.243-248
    • /
    • 2017
  • Intracellular and extracellular oxidative stress initiated by reactive oxygen species (ROS) causes skin aging, which is characterized by wrinkles and atypical pigmentation. Use of antioxidant is an effective approach to prevent symptoms related to ROS-induced aging of the skin. Therefore, the antioxidant and anti-aging effect of Castanea crenata Siebold & Zucc. extracts (LCE) was investigated in this study. The LCE markedly reduced the hydrogen peroxide-induced cell damage, intracellular ROS, and oxidative stress-induced senescence in human dermal fibroblasts (HDFs). These results indicate that LCE might have beneficial effects on oxidative stress-induced damage and thus reduce skin aging.

Cell Biological Function of Secretome of Adipose-Derived Stem Cells on Human Dermal Fibroblasts and Keratinocytes (인체 섬유아세포 및 케라티노사이트에 대한 지방줄기세포 분비물의 세포생물학적 기능)

  • Lee, Jae-Seol;Lee, Jong-Hwan
    • Microbiology and Biotechnology Letters
    • /
    • v.40 no.2
    • /
    • pp.117-127
    • /
    • 2012
  • The beneficial effects of adipose-derived stem cell conditioned media (ADSC-CM) for skin regeneration have previously been reported, despite the precise mechanism of how ADSC-CM promotes skin regeneration remaining unclear. ADSC-CM contains various secretomes and this may be a factor in it being a good resource for the treatment of skin conditions. It is also known that ADSC-CM produced in hypoxia conditions, in other words Advanced Adipose-Derived Stem cell Protein Extract (AAPE), has excellent skin regenerative properties. In this study, a human primary skin cell was devised to examine how AAPE affects human dermal fibroblast (HDF) and human keratinocyte (HK), which both play fundamental roles in skin regeneration. The promotion of collagen formation by HDFs was observed at 0.32 mg/ml of AAPE. AAPE treatment significantly stimulated stress fiber formation. DNA gene chips demonstrated that AAPE in HKs (p<0.05) affected the expression of 133 identifiable transcripts, which were associated with cell proliferation, migration, cell adhesion, and response to wounding. Twenty five identified proteins, including MMP, growth factor and cytokines such as CD54, FGF-2, GM-CSF, IL-4, IL-6, VEGF, TGF-${\beta}2$, TGF-${\beta}3$, MMP-1, MMP-10, and MMP-19, were contained in AAPE via antibody arrays. Thus, AAPE might activate the HK biological function and induce the collagen synthesis of HDF. These results demonstrate that AAPE has the potential to be used for clinic applications aimed at skin regeneration.

A Study on Big Data Based Method of Patient Care Analysis (빅데이터 기반 환자 간병 방법 분석 연구)

  • Park, Ji-Hun;Hwang, Seung-Yeon;Yun, Bum-Sik;Choe, Su-Gil;Lee, Don-Hee;Kim, Jeong-Joon;Moon, Jin-Yong;Park, Kyung-won
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.20 no.3
    • /
    • pp.163-170
    • /
    • 2020
  • With the development of information and communication technologies, the growing volume of data is increasing exponentially, raising interest in big data. As technologies related to big data have developed, big data is being collected, stored, processed, analyzed, and utilized in many fields. Big data analytics in the health care sector, in particular, is receiving much attention because they can also have a huge social and economic impact. It is predicted that it will be able to use Big Data technology to analyze patients' diagnostic data and reduce the amount of money that is spent on simple hospital care. Therefore, in this thesis, patient data is analyzed to present to patients who are unable to go to the hospital or caregivers who do not have medical expertise with close care guidelines. First, the collected patient data is stored in HDFS and the data is processed and classified using R, a big data processing and analysis tool, in the Hadoop environment. Visualize to a web server using R Shiny, which is used to implement various functions of R on the web.

Taxol Produced from Endophytic Fungi Induces Apoptosis in Human Breast, Cervical and Ovarian Cancer Cells

  • Wang, Xin;Wang, Chao;Sun, Yu-Ting;Sun, Chuan-Zhen;Zhang, Yue;Wang, Xiao-Hua;Zhao, Kai
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.16 no.1
    • /
    • pp.125-131
    • /
    • 2015
  • Currently, taxol is mainly extracted from the bark of yews; however, this method can not meet its increasing demand on the market because yews grow very slowly and are a rare and endangered species belonging to first-level conservation plants. Recently, increasing efforts have been made to develop alternative means of taxol production; microbe fermentation would be a very promising method to increase the production scale of taxol. To determine the activities of the taxol extracted from endophytic fungus N. sylviforme HDFS4-26 in inhibiting the growth and causing the apoptosis of cancer cells, on comparison with the taxol extracted from the bark of yew, we used cellular morphology, cell counting kit (CCK-8) assay, staining (HO33258/PI and Giemsa), DNA agarose gel electrophoresis and flow cytometry (FCM) analyses to determine the apoptosis status of breast cancer MCF-7 cells, cervical cancer HeLa cells and ovarian cancer HO8910 cells. Our results showed that the fungal taxol inhibited the growth of MCF-7, HeLa and HO8910 cells in a dose-and time-dependent manner. IC50 values of fungal taxol for HeLa, MCF-7 and HO8910 cells were $0.1-1.0{\mu}g/ml$, $0.001-0.01{\mu}g/ml$ and $0.01-0.1{\mu}g/ml$, respectively. The fungal taxol induced these tumor cells to undergo apoptosis with typical apoptotic characteristics, including morphological changes for chromatin condensation, chromatin crescent formation, nucleus fragmentation, apoptotic body formation and G2/M cell cycle arrest. The fungal taxol at the $0.01-1.0{\mu}g/ml$ had significant effects of inducing apoptosis between 24-48 h, which was the same as that of taxol extracted from yews. This study offers important information and a new resource for the production of an important anticancer drug by endofungus fermentation.

Inhibitory effect of Aralia elata ethanol extract against skin damage in UVB-exposed human keratinocytes and human dermal fibroblasts (두릅순 에탄올 추출물의 인간유래 피부각질형성세포와 피부섬유아세포에서의 자외선에 의한 광노화 억제효과)

  • Yang, Jiwon;Kwak, Chungshil
    • Journal of Nutrition and Health
    • /
    • v.49 no.6
    • /
    • pp.429-436
    • /
    • 2016
  • Purpose: Solar ultraviolet (UV) radiation causes inflammation and matrix metalloproteinase (MMP) overexpression and extracellular matrix depletion, leading to skin photoaging such as wrinkle formation, dryness, and sagging. Activation of MMP is influenced by various molecules such as reactive oxygen species (ROS), proinflammatory cytokines, and transient receptor potential vanilloid type (TRPV)-1, which are increased in UV-irradiated skin cells. Aralia elata (AE) ethanolic extract was reported to inhibit ROS generation caused by UVB-irradiation in keratinocytes. In this study, we investigated the photoprotective effect of AE ethanolic extract on UVB-irradiated human keratinocytes (HaCaT) and human dermal fibroblasts (HDF). Methods: AE was freeze-dried, extracted in 70% ethanol, and concentrated. Skin cells were treated with AE extract for 24 h and then exposed to UVB ($55mJ/cm^2$). After 48 h of incubation, proinflammatory cytokines, MMP-1, type-1 procollagen, and TRPV-1 levels were measured by ELISA or Western blotting. Results: Treatment with AE extract ($100{\mu}g/mL$) significantly inhibited UVB-induced IL-6, IL-8, and $PGE_2$ production in HaCaT by 25.6%, 5.3%, and 70.2%, respectively, and also inhibited elevation of MMP-1 and TRPV-1 caused by UVB irradiation by 20.0% and 41.9%, respectively (p < 0.05). In HDF, AE extract treatment significantly inhibited both elevation of MMP-1 and reduction of type-1 procollagen caused by UVB irradiation (p < 0.05). In addition, type-1 procollagen was elevated by AE extract treatment in normal HDFs (p < 0.05). Conclusion: AE 70% ethanol extract has photoprotective ability via reduction of proinflammatory mediators, TRPV-1 and MMP-1 production, and elevation of collagen synthesis. Our findings suggest that AE extract might be a good natural material to protect against UVB-induced premature skin aging.