Browse > Article
http://dx.doi.org/10.5392/JKCA.2016.16.10.608

Implementation of Parallel Local Alignment Method for DNA Sequence using Apache Spark  

Kim, Bosung ((주)이글루시큐리티)
Kim, Jinsu (한국교통대학교 컴퓨터공학과)
Choi, Dojin (충북대학교 정보통신공학과)
Kim, Sangsoo (한국산업인력관리공단)
Song, Seokil (한국교통대학교 컴퓨터공학과)
Publication Information
The Journal of the Korea Contents Association / v.16, no.10, 2016 , pp. 608-616 More about this Journal
Abstract
The Smith-Watrman (SW) algorithm is a local alignment algorithm which is one of important operations in DNA sequence analysis. The SW algorithm finds the optimal local alignment with respect to the scoring system being used, but it has a problem to demand long execution time. To solve the problem of SW, some methods to perform SW in distributed and parallel manner have been proposed. The ADAM which is a distributed and parallel processing framework for DNA sequence has parallel SW. However, the parallel SW of the ADAM does not consider that the SW is a dynamic programming method, so the parallel SW of the ADAM has the limit of its performance. In this paper, we propose a method to enhance the parallel SW of ADAM. The proposed parallel SW (PSW) is performed in two phases. In the first phase, the PSW splits a DNA sequence into the number of partitions and assigns them to multiple nodes. Then, the original Smith-Waterman algorithm is performed in parallel at each node. In the second phase, the PSW estimates the portion of data sequence that should be recalculated, and the recalculation is performed on the portions in parallel at each node. In the experiment, we compare the proposed PSW to the parallel SW of the ADAM to show the superiority of the PSW.
Keywords
DNA Sequence; Local Alignment; Prallel Processing; Apache Spark; Smith Waterman;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, and I. Stoica, "Spark: Cluster Computing with Working Sets," Proceedings of the 2nd USENIX conference on Hot topics in cloud computing, Vol.10, pp.10-10, 2010.
2 M. Massie, F. Nothaft, C. Hartl, C. Kozanitis, A. Schumacher, A. D. Joseph, and D. A. Patterson, "Adam: Genomics Formats and Processing Patterns for Cloud Scale Computing," University of California, Berkeley Technical Report, No. UCB/EECS-2013, 2013.
3 Parquet, http://www.parquet.io.
4 Avro, http://avro.apache.org.
5 T. F. Smith and M. S. Waterman, "Identification of Common Molecular Subsequences," Journal of Molecular Biology, Vol.147, No.1, pp.195-197, 1981.   DOI
6 https://en.wikipedia.org/wiki/Smith-Waterman _algorithm
7 S. F. Altschul, W. Gish, W. Miller, E. W. Myers, and D. J. Lipman, "Basic Local Alignment Search Tool," Journal of Molecular Biology, Vol.215, No.3, pp.403-410, 1990.   DOI
8 G. Zhao, C. Ling, and D. Sun, "SparkSW: Scalable Distributed Computing System for Large-scale Biological Sequence Alignment," In 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), pp.845-852, 2015.
9 D. R. Mathog, "Parallel BLAST on Split Databases," Bioinformatics Application Node, Vol.19, No.14, pp.1865-1866, 2003.   DOI
10 김동욱, 최한석 "그리드 컴퓨팅을 이용한 BLAST 성능개선 및 유전체 서열분석 시스템 구현," 한국콘텐츠학회논문지, 제10권, 제7호, pp.81-87, 2010.   DOI
11 A. Julich, "Implementations BLAST for Parallel Computers," CABIOS, Vol.11, No.14, pp.3-6, 1995.
12 V. Breton, E. Caron, F. Desprez, and G. L. Mahec, "BLAST Application with Data-Aware Desktop Grid Middleware," In Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, pp.284-291, 2009.
13 복경수, 유재수, "빅데이터 활성화 정책 및 응용 사례," 정보과학회지, 제32권, 제11호, pp.46-57, 2014.