• Title/Summary/Keyword: Scientific Workflow

Search Result 21, Processing Time 0.029 seconds

Workflow Reconfiguration Scheme for Collaborative Scientific Applications (협업기반의 과학 어플리케이션을 위한 워크플로우 재구성 기법)

  • Kim, Byung-Sang;Youn, Chan-Hyun
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2011.11a
    • /
    • pp.175-176
    • /
    • 2011
  • 협업 컴퓨팅 환경은 컴퓨팅, 네트워크 자원을 통하여 연구자들간의 협력을 하는 일련의 작업 과정을 의미한다. 사람이 포함되어 있는 복잡한 연구환경에서 워크플로우 기반의 작업 수행은 협업환경을 위해 유용하게 사용된다. 하지만 자원의 예기치 못한 자원의 성능 저하는 전체 워크플로우의 성능을 저하시키게 된다. 본 논문에서는 워크플로우 자원 스케줄링에 있어서 최초에 결정되어 할당된 자원을 재배치 시키는 재구성 기법을 통하여 워크플로우 응용의 성능 저하를 개선하고자 한다.

Grid Middleware Support for e-Science Service Integration Workbench (e-Science 서비스 통합 워크벤치를 위한 그리드 미들웨어 지원)

  • Suh, Young-Kyoon;Kim, Byungsang;Nam, Dukyun;Lee, June Hawk;Hwang, Soonwook
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2007.11a
    • /
    • pp.574-577
    • /
    • 2007
  • e-Science Service Integration Workbench is the core tool that enables IT-based computation and engineering researchers to collaborate their research activities via data sharing, by semi-automatically supporting the activities. Workbench provides the researchers with a scientific workflow by establishing the environment that is capable of finding, registering, composing, and executing services-legacy codes wrapped with grid services or web services-they need to use. In other words, designing their scientific workflow through the workbench, they can receive or share its final result with their collegues by submitting jobs they describe to computational resources such as supercomputers or grids or requesting an experiment. In this paper, we propose an implementation architecture of e-Science Service Integration Workbench to support grid services of Grid Middleware.

  • PDF

The 2D Drawing-Based Authoring Tool for Scientific Inquiry Learning Virtual Environments (과학적 탐구학습 가상환경을 위한 2차원 Drawing 기반 저작도구)

  • Im, Jae-Won;Park, Kyoung-Shin;Cho, Yong-Joo
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.13 no.7
    • /
    • pp.1303-1311
    • /
    • 2009
  • This paper describes a new visual VR authoring tool called DEVISE (Drawing Environment for VR-based Inquiry-learning Science Education) which is designed to support scientific inquiry learning. DEVISE allows users with no programming expertise to easily build the science inquiry learning VR contents by using 2D drawing interface to place 3D objects and specify properties of the virtual worlds or objects. This paper first describes the related works of VR authoring tools and inquiry learning virtual environments. It also explains SASILE, an integrated virtual environment system for supporting science inquiry learning, and its problems. Then, it describes DEVISE system components and its workflow, and it discusses the observation results of user evaluations of developing science inquiry-learning VR contents.

Workflow Based on Pipelining for Performance Improvement of Volcano Disaster Damage Prediction System (화산재해 피해 예측 시스템의 성능 향상을 위한 파이프라인 기반 워크플로우)

  • Heo, Daeyoung;Lee, Donghwan;Hwang, Suntae
    • Journal of KIISE
    • /
    • v.42 no.3
    • /
    • pp.281-288
    • /
    • 2015
  • A volcano disaster damage prediction system supports decision making for counteracting volcanic disasters by simulating meteorological condition and volcanic eruptions. In this system, a program called Fall3D generates predicted results for the diffusion of ash after a volcanic eruption on the basis of meteorological information. The relevant meteorological information is generated by a weather numerical prediction model known as Weather Research & Forecasting (WRF). In order to reduce the entire processing time without modifying these two simulation programs, pipelining can be used by partly executing Fall3D whenever the hourly (partial) results of WRF are generated. To reduce the processing time, successor programs such as Fall3D require that certain features be suspended until the part of the results that is based on prior calculation is generated by a predecessor. Even though Fall3D does not have a suspend or resume feature, pipelining effect can be produced by using the program's restart feature, which resumes simulation from the previous session. In this study, we suggest a workflow that can control the execution type.

Dynamic Memory Allocation for Scientific Workflows in Containers (컨테이너 환경에서의 과학 워크플로우를 위한 동적 메모리 할당)

  • Adufu, Theodora;Choi, Jieun;Kim, Yoonhee
    • Journal of KIISE
    • /
    • v.44 no.5
    • /
    • pp.439-448
    • /
    • 2017
  • The workloads of large high-performance computing (HPC) scientific applications are steadily becoming "bursty" due to variable resource demands throughout their execution life-cycles. However, the over-provisioning of virtual resources for optimal performance during execution remains a key challenge in the scheduling of scientific HPC applications. While over-provisioning of virtual resources guarantees peak performance of scientific application in virtualized environments, it results in increased amounts of idle resources that are unavailable for use by other applications. Herein, we proposed a memory resource reconfiguration approach that allows the quick release of idle memory resources for new applications in OS-level virtualized systems, based on the applications resource-usage pattern profile data. We deployed a scientific workflow application in Docker, a light-weight OS-level virtualized system. In the proposed approach, memory allocation is fine-tuned to containers at each stage of the workflows execution life-cycle. Thus, overall memory resource utilization is improved.

Researches on API Networking based Scientific Workflow Implementation (API 네트워킹 기반 과학분야 워크플로우 구현방안 연구)

  • Woojin seok;Kihyeon Kim;Jeonghoon Moon
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2023.11a
    • /
    • pp.274-275
    • /
    • 2023
  • 본 논문은 ICT 기술을 활용한 과학적 연구 적용사례를 분석하고, 데이터의 전송, 저장, 처리를 위한 ICT 기술의 적용모델을 소개하고자 한다. 과학을 다루는 많은 분야에서 플랫폼을 기반으로 분석SW들의 API 네트워킹을 통하여 분석모델들을 연계하여 결과치를 활용하는 방식으로 진화하고 있다. 이러한 API 네트워킹을 위한 ICT 기술들의 구축 모델을 분석하고자 한다.

A Framework of Intelligent Middleware for DNA Sequence Analysis in Cloud Computing Environment (DNA 서열 분석을 위한 클라우드 컴퓨팅 기반 지능형 미들웨어 설계)

  • Oh, Junseok;Lee, Yoonjae;Lee, Bong Gyou
    • Journal of Internet Computing and Services
    • /
    • v.15 no.1
    • /
    • pp.29-43
    • /
    • 2014
  • The development of NGS technologies, such as scientific workflows, has reduced the time required for decoding DNA sequences. Although the automated technologies change the genome sequence analysis environment, limited computing resources still pose problems for the analysis. Most scientific workflow systems are pre-built platforms and are highly complex because a lot of the functions are implemented into one system platform. It is also difficult to apply components of pre-built systems to a new system in the cloud environment. Cloud computing technologies can be applied to the systems to reduce analysis time and enable simultaneous analysis of massive DNA sequence data. Web service techniques are also introduced for improving the interoperability between DNA sequence analysis systems. The workflow-based middleware, which supports Web services, DBMS, and cloud computing, is proposed in this paper for expecting to reduceanalysis time and aiding lightweight virtual instances. It uses DBMS for managing the pipeline status and supporting the creation of lightweight virtual instances in the cloud environment. Also, the RESTful Web services with simple URI and XML contents are applied for improving the interoperability. The performance test of the system needs to be conducted by comparing results other developed DNA analysis services at the stabilization stage.

Container-based Cluster Management System for User-driven Distributed Computing (사용자 맞춤형 분산 컴퓨팅을 위한 컨테이너 기반 클러스터 관리 시스템)

  • Park, Ju-Won;Hahm, Jaegyoon
    • KIISE Transactions on Computing Practices
    • /
    • v.21 no.9
    • /
    • pp.587-595
    • /
    • 2015
  • Several fields of science have traditionally demanded large-scale workflow support, which requires thousands of central processing unit (CPU) cores. In order to support such large-scale scientific workflows, large-capacity cluster systems such as supercomputers are widely used. However, as users require a diversity of software packages and configurations, a system administrator has some trouble in making a service environment in real time. In this paper, we present a container-based cluster management platform and introduce an implementation case to minimize performance reduction and dynamically provide a distributed computing environment desired by users. This paper offers the following contributions. First, a container-based virtualization technology is assimilated with a resource and job management system to expand applicability to support large-scale scientific workflows. Second, an implementation case in which docker and HTCondor are interlocked is introduced. Lastly, docker and native performance comparison results using two widely known benchmark tools and Monte-Carlo simulation implemented using various programming languages are presented.

Performance of the Agilent Microarray Platform for One-color Analysis of Gene Expression

  • Song Sunny;Lucas Anne;D'Andrade Petula;Visitacion Marc;Tangvoranuntakul Pam;FulmerSmentek Stephanie
    • Proceedings of the Korean Society for Bioinformatics Conference
    • /
    • 2006.02a
    • /
    • pp.78-78
    • /
    • 2006
  • Gene expression analysis can be performed by one-color (intensity-based) or two-color (ratio-based) microarray platforms depending on the specific applications and needs of the researcher. The traditional two-color approach is well founded from a historical and scientific standpoint, and the one-color approach, when paired with high quality microarrays and a robust workflow, offers additional flexibility in experimental design. Two of the major requirements of any microarray platform are system reproducibility, which provides the means for high confidence experiments and accurate comparison across multiple samples; and high sensitivity, for the detection of significant gene expression changes, including small fold changes across multiple gene sets. Each of these requirements is fulfilled by the Agilent One-color Gene Expression Platform as illustrated by the data included in this study. As a result, researchers have the ability to take advantage of the enhanced performance and sensitivity of Agilent's 60-mer oligonucleotide microarrays, and experience the first commercial microarray platform compatible with both one- and two-color detection.

  • PDF

Accuracy of digital and conventional dental implant impressions for fixed partial dentures: A comparative clinical study

  • Gedrimiene, Agne;Adaskevicius, Rimas;Rutkunas, Vygandas
    • The Journal of Advanced Prosthodontics
    • /
    • v.11 no.5
    • /
    • pp.271-279
    • /
    • 2019
  • PURPOSE. The newest technologies for digital implant impression (DII) taking are developing rapidly and showing acceptable clinical results. However, scientific literature is lacking data from clinical studies about the accuracy of DII. The aim of this study was to compare digital and conventional dental implant impressions (CII) in a clinical environment. MATERIALS AND METHODS. Twenty-four fixed zirconia restorations supported by 2 implants were fabricated using conventional open-tray impression technique with splinted transfers (CII group) and scan with Trios 3 IOS (3Shape) (DII group). After multiple verification procedures, master models were scanned using laboratory scanner D800 (3Shape). 3D models from conventional and digital workflow were imported to reverse engineering software and superimposed with high resolution 3D CAD models of scan bodies. Distance between center points, angulation, rotation, vertical shift, and surface mismatch of the scan bodies were measured and compared between conventional and digital impressions. RESULTS. Statistically significant differences were found for: a) inter-implant distance, b) rotation, c) vertical shift, and d) surface mismatch differences, comparing DII and CII groups for mesial and distal implant scan bodies ($P{\leq}.05$). CONCLUSION. Recorded linear differences between digital and conventional impressions were of limited clinical significance with two implant-supported restorations.