• Title/Summary/Keyword: Large Scale Data

Search Result 2,796, Processing Time 0.033 seconds

A Blockchain-enabled Multi-domain DDoS Collaborative Defense Mechanism

  • Huifen Feng;Ying Liu;Xincheng Yan;Na Zhou;Zhihong Jiang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.3
    • /
    • pp.916-937
    • /
    • 2023
  • Most of the existing Distributed Denial-of-Service mitigation schemes in Software-Defined Networking are only implemented in the network domain managed by a single controller. In fact, the zombies for attackers to launch large-scale DDoS attacks are actually not in the same network domain. Therefore, abnormal traffic of DDoS attack will affect multiple paths and network domains. A single defense method is difficult to deal with large-scale DDoS attacks. The cooperative defense of multiple domains becomes an important means to effectively solve cross-domain DDoS attacks. We propose an efficient multi-domain DDoS cooperative defense mechanism by integrating blockchain and SDN architecture. It includes attack traceability, inter-domain information sharing and attack mitigation. In order to reduce the length of the marking path and shorten the traceability time, we propose an AS-level packet traceability method called ASPM. We propose an information sharing method across multiple domains based on blockchain and smart contract. It effectively solves the impact of DDoS illegal traffic on multiple domains. According to the traceability results, we designed a DDoS attack mitigation method by replacing the ACL list with the IP address black/gray list. The experimental results show that our ASPM traceability method requires less data packets, high traceability precision and low overhead. And blockchain-based inter-domain sharing scheme has low cost, high scalability and high security. Attack mitigation measures can prevent illegal data flow in a timely and efficient manner.

An Overloaded Vehicle Identifying System based on Object Detection Model (객체 인식 모델을 활용한 적재 불량 화물차 탐지 시스템)

  • Jung, Woojin;Park, Jinuk;Park, Yongju
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.26 no.12
    • /
    • pp.1794-1799
    • /
    • 2022
  • Recently, the increasing number of overloaded vehicles on the road poses a risk to traffic safety, such as falling objects, road damage, and chain collisions due to the abnormal weight distribution, and can cause great damage once an accident occurs. therefore we propose to build an object detection-based AI model to identify overloaded vehicles that cause such social problems. In addition, we present a simple yet effective method to construct an object detection model for the large-scale vehicle images. In particular, we utilize the large-scale of vehicle image sets provided by open AI-Hub, which include the overloaded vehicles. We inspected the specific features of sizes of vehicles and types of image sources, and pre-processed these images to train a deep learning-based object detection model. Also, we propose an integrated system for tracking the detected vehicles. Finally, we demonstrated that the detection performance of the overloaded vehicle was improved by about 23% compared to the one using raw data.

Dynamically Induced Anomalies of the Japan/East Sea Surface Temperature

  • Trusenkova, Olga;Lobanov, Vyacheslav;Kaplunenko, Dmitry
    • Ocean and Polar Research
    • /
    • v.31 no.1
    • /
    • pp.11-29
    • /
    • 2009
  • Variability of sea surface temperature (SST) in the Japan/East Sea (JES) was studied using complex empirical orthogonal function (CEOF) analysis. Two daily data sets were analyzed: (1) New Generation 0.05o-gridded SST from Tohoku University, Japan (July 2002-July 2006), and (2) 0.25o-gridded SST from the Japan Meteorological Agency (October 1993-November 2006). Linkages with wind stress curl were revealed using 6-h 1o-gridded surface zonal and meridional winds from ancillary data of the Sea- WiFS Project, a special National Centers for Environmental Prediction/National Center for Atmospheric Research (NCEP/NCAR) product (1998-2005). SST anomalies (SSTA) were obtained by removing the seasonal signal, estimated as the leading mode of the CEOF decomposition of the original SST. Leading CEOF modes of residual SSTA obtained from both data sets were consistent with each other and were characterized by annual, semiannual, and quasi-biennial time scales estimated with 95% statistical significance. The Semiannual Mode lagged 2 months behind the increased occurrence of the anticyclonic (AC) wind stress curl over the JES. Links to dynamic processes were investigated by numerical simulations using an oceanic model. The suggested dynamic forcings of SSTA are the inflow of subtropical water into the JES through the Korea Strait, divergence in the surface layer induced by Ekman suction, meridional shifts of the Subarctic Front in the western JES, AC eddy formation, and wind-driven strengthening/weakening of large-scale currents. Events of west-east SSTA movement were identified in July-September. The SSTA moved from the northeastern JES towards the continental coast along the path of the westward branch of the Tsushima Current at a speed consistent with the advective scale.

The Study of Loneliness in Infertile Women (불임여성의 고독감 수준에 관한 연구)

  • 배경진;노승옥;김정아
    • Journal of Korean Academy of Nursing
    • /
    • v.29 no.6
    • /
    • pp.1379-1391
    • /
    • 1999
  • The purpose of this study was to investigate loneliness in infertile women and determine how loneliness related to personal characteristics, cause of infertility, family composition, and family conflicts. It also provides basic data for nursing strategies concerning infertile women.A total of 182 subjects were selected at an infertile clinic in Seoul, Korea. Data were collected from May 2 to June 21, 1997 by questionaire. It consisted of questions concerning general characteristics, items relating to infertility, and the Loneliness Scale. The UCLA Loneliness scale was used(more specifically, the Korean version of the Revised UCLA Scale by Kim Ok Soo.) The data were analyzed by using SPSS/PC computer program. The result are as follows : 1. The mean age of infertile women was 32.4 years old, and the mean age of souses was 34.8 yerars old. 30.2% of women had a marital duration of 3-5 years, and 25.8% had a marital duration of 5-10 years. 23.1% reported the main etiology of infertility as unexplained, 18.1% reported ovulation disturbances, and 26.4% reported complex causes. 3.8% of the couples had sexual relationship difficulty 83% lived in nuclear families, while 17% lived in large families. 2. The mean loneliness scores of infertile women was 35.53(SD=8.66). The total loneliness score of this study was 80. 3. There were significant differences in loneliness scores according to ages(F=6.893, p=.001), education background(t=4.418, p=.000), and the educational background of husband(t=2.339, p=.020). 4. Loneliness scores related to family situations were significantly different according to several male nephews in husbands' family(F=2.822, p=.027). 5. Loneliness scores related to conflicts were significantly different according to husbands and their family(F=11.465, p=.000). Nurses should acknowlege the fact that some infertile women may experience loneliness. In conclusion, nurses can provide infertile women with information about ways to decrease loneliness and create support groups for themselves, assisting infertile women to adjust to the experience of infertility through positive methods.

  • PDF

Development of a Small Animal CT using a Linear Detector Array and Small-Scale Slip Rings

  • An Ung Hwan;Chun In Kon;Lee Sang Chul;Cho Min Hyoung;Lee Soo Yeol
    • Journal of Biomedical Engineering Research
    • /
    • v.26 no.1
    • /
    • pp.43-47
    • /
    • 2005
  • We have developed a small bore x-ray CT for small animal imaging with a linear x-ray detector array and small-scale slip rings. The linear x-ray detector array consists of 1024 elements of 400□m×400□m with a gadolinium oxysulfide (GOS) scintillator on top of them. To avoid use of expensive large diameter slip rings for projection data transmission from the X­ray detector to the image reconstruction system, we used the wireless LAN technology. The projection data are temporally stored in the data acquisition system residing on the rotating gantry during the scan and they are transmitted to the image reconstruction system after the scan. With the wireless LAN technology, we only needed to use small-scale slip rings to deliver the AC electric power to the X-ray generator and the power supply on the rotating gantry. The performances of the small animal CT system, such as SNR, contrast, and spatial resolution, have been evaluated through experiments using various phantoms. It has been experimentally found that the SNR is almost linearly proportional to the tube current and tube voltage, and the minimum resolvable contrast is less than 30 CT numbers at 40kVp/3.0㎃. The spatial resolution of the small animal CT system has been found to be about 0.9Ip/㎜. Postmortem images of a piglet is also presented.

An Optimized Iterative Semantic Compression Algorithm And Parallel Processing for Large Scale Data

  • Jin, Ran;Chen, Gang;Tung, Anthony K.H.;Shou, Lidan;Ooi, Beng Chin
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.6
    • /
    • pp.2761-2781
    • /
    • 2018
  • With the continuous growth of data size and the use of compression technology, data reduction has great research value and practical significance. Aiming at the shortcomings of the existing semantic compression algorithm, this paper is based on the analysis of ItCompress algorithm, and designs a method of bidirectional order selection based on interval partitioning, which named An Optimized Iterative Semantic Compression Algorithm (Optimized ItCompress Algorithm). In order to further improve the speed of the algorithm, we propose a parallel optimization iterative semantic compression algorithm using GPU (POICAG) and an optimized iterative semantic compression algorithm using Spark (DOICAS). A lot of valid experiments are carried out on four kinds of datasets, which fully verified the efficiency of the proposed algorithm.

Accelerating next generation sequencing data analysis: an evaluation of optimized best practices for Genome Analysis Toolkit algorithms

  • Franke, Karl R.;Crowgey, Erin L.
    • Genomics & Informatics
    • /
    • v.18 no.1
    • /
    • pp.10.1-10.9
    • /
    • 2020
  • Advancements in next generation sequencing (NGS) technologies have significantly increased the translational use of genomics data in the medical field as well as the demand for computational infrastructure capable processing that data. To enhance the current understanding of software and hardware used to compute large scale human genomic datasets (NGS), the performance and accuracy of optimized versions of GATK algorithms, including Parabricks and Sentieon, were compared to the results of the original application (GATK V4.1.0, Intel x86 CPUs). Parabricks was able to process a 50× whole-genome sequencing library in under 3 h and Sentieon finished in under 8 h, whereas GATK v4.1.0 needed nearly 24 h. These results were achieved while maintaining greater than 99% accuracy and precision compared to stock GATK. Sentieon's somatic pipeline achieved similar results greater than 99%. Additionally, the IBM POWER9 CPU performed well on bioinformatic workloads when tested with 10 different tools for alignment/mapping.

A Database System for High-Throughput Transposon Display Analyses of Rice

  • Inoue, Etsuko;Yoshihiro, Takuya;Kawaji, Hideya;Horibata, Akira;Nakagawa, Masaru
    • Proceedings of the Korean Society for Bioinformatics Conference
    • /
    • 2005.09a
    • /
    • pp.15-20
    • /
    • 2005
  • We developed a database system to enable efficient and high-throughput transposon analyses in rice. We grow large-scale mutant series of rice by taking advantage of an active MITE transposon mPing, and apply the transposon display method to them to study correlation between genotypes and phenotypes. But the analytical phase, in which we find mutation spots from waveform data called fragment profiles, involves several problems from a viewpoint of labor amount, data management, and reliability of the result. As a solution, our database system manages all the analytical data throughout the experiments, and provides several functions and well designed web interfaces to perform overall analyses reliably and efficiently.

  • PDF

Practical Patching for Efficient Bandwidth Sharing in VOD Systems

  • Ha Soak-Jeong
    • Journal of Korea Multimedia Society
    • /
    • v.8 no.12
    • /
    • pp.1597-1604
    • /
    • 2005
  • Recursive Patching is an efficient multicast technique for large-scale video on demand systems and recursively shares existing video streams with asynchronous clients. When Recursive Patching initiates a transition stream, it always makes a transition stream have additional data for the worst future request. In order to share a VOD server's limited network bandwidth efficiently, this paper proposes Practical Patching that removes the unnecessary data included in the transition stream. The proposed Practical Patching dynamically expands ongoing transition streams when a new request actually arrives at the server. As a result, the transition streams never have unnecessary data. Simulation result confirmed that the proposed technique is better than Recursive Patching in terms of service latency and defection rate.

  • PDF

A study on the optimal distance between the data center and the disaster recovery center for the business continuity (업무 연속성 확보를 위한 재해복구센터의 최적 거리에 관한 연구)

  • 서용원
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2003.11a
    • /
    • pp.57-60
    • /
    • 2003
  • As the business dependency to information systems and the frequency of the large scale disasters increase, implementing the disaster recovery center has been a common practice. However, since there has been little quantitative decision method for the distance between the data center and the disaster recovery center, the distance decision has been commonly made by qualitative guidelines. In this research, the decision method for the optimal distance between the data center and the disaster recovery center is developed, using the cost analysis including the operation cost and the expected disaster cost. An illustrative numerical example is provided.

  • PDF