• Title/Summary/Keyword: Large dynamic data

Search Result 613, Processing Time 0.038 seconds

Refresh Cycle Optimization for Web Crawlers (웹크롤러의 수집주기 최적화)

  • Cho, Wan-Sup;Lee, Jeong-Eun;Choi, Chi-Hwan
    • The Journal of the Korea Contents Association
    • /
    • v.13 no.6
    • /
    • pp.30-39
    • /
    • 2013
  • Web crawler should maintain fresh data with minimum server overhead for large amount of data in the web sites. The overhead in the server increases rapidly as the amount of data is exploding as in the big data era. The amount of web information is increasing rapidly with advanced wireless networks and emergence of diverse smart devices. Furthermore, the information is continuously being produced and updated in anywhere and anytime by means of easy web platforms, and smart devices. Now, it is becoming a hot issue how frequently updated web data has to be refreshed in data collection and integration. In this paper, we propose dynamic web-data crawling methods, which include sensitive checking of web site changes, and dynamic retrieving of web pages from target web sites based on historical update patterns. Furthermore, we implemented a Java-based web crawling application and compared efficiency between conventional static approaches and our dynamic one. Our experiment results showed 46.2% overhead benefits with more fresh data compared to the static crawling methods.

Dynamic RNN-CNN malware classifier correspond with Random Dimension Input Data (임의 차원 데이터 대응 Dynamic RNN-CNN 멀웨어 분류기)

  • Lim, Geun-Young;Cho, Young-Bok
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.23 no.5
    • /
    • pp.533-539
    • /
    • 2019
  • This study proposes a malware classification model that can handle arbitrary length input data using the Microsoft Malware Classification Challenge dataset. We are based on imaging existing data from malware. The proposed model generates a lot of images when malware data is large, and generates a small image of small data. The generated image is learned as time series data by Dynamic RNN. The output value of the RNN is classified into malware by using only the highest weighted output by applying the Attention technique, and learning the RNN output value by Residual CNN again. Experiments on the proposed model showed a Micro-average F1 score of 92% in the validation data set. Experimental results show that the performance of a model capable of learning and classifying arbitrary length data can be verified without special feature extraction and dimension reduction.

Investigation of wind-induced dynamic and aeroelastic effects on variable message signs

  • Meyer, Debbie;Chowdhury, Arindam Gan;Irwin, Peter
    • Wind and Structures
    • /
    • v.20 no.6
    • /
    • pp.793-810
    • /
    • 2015
  • Tests were conducted at the Florida International University (FIU) Wall of Wind (WOW) to investigate the susceptibility of Variable Message Signs (VMS) to wind induced vibrations due to vortex shedding and galloping instability. Large scale VMS models were tested in turbulence representative of the high frequency end of the spectrum in a simulated suburban atmospheric boundary layer. Data was measured for the $0^{\circ}$ and $45^{\circ}$ horizontal wind approach directions and vertical attack angles ranging from $-4.5^{\circ}$ to $+4.5^{\circ}$. Analysis of the power spectrum of the fluctuating lift indicated that vertical vortex oscillations could be significant for VMS with a large depth ratio attached to a structure with a low natural frequency. Analysis of the galloping test data indicated that VMS with large depth ratios, greater than about 0.5, and low natural frequency could also be subject to galloping instability.

Dynamic Characteristic Analyses of a Bearingless Helicopter Rotor Systems (무베어링 헬리콥터 로터 시스템의 동특성 해석)

  • Kee, Young-Jung;Yun, Chul-Yong;Kim, Seung-Ho
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2011.10a
    • /
    • pp.52-56
    • /
    • 2011
  • Recently, KARI(Korea Aerospace Research Institute) has been developing a modern 11.5m diameter four bladed bearingless main rotor system, and this rotor system can be used for 7,000lb class helicopter. Flexbeam and torque tube can be considered as the key structural components, and large elastic twist of flexbeam induced by pitch control motion of torque tube can influence the nonlinear aeroelastic behavior. In this paper, the dynamic characteristic analysis results of bearingless rotor system were presented. In order to construct a input model and validate the analysis procedures, calculated results using the comprehensive helicopter analysis program CAMRAD II were compared with the measured natural frequencies and lag damping data from small-scale wind tunnel test. Next, the analysis model was extended to a full-scale model, and the dynamic analysis results were presented.

  • PDF

Dynamic Characteristic Analyses of a Bearingless Helicopter Rotor System (무베어링 헬리콥터 로터 시스템의 동특성 해석)

  • Kee, Young-Jung;Yun, Chul-Yong;Kim, Doeg-Kwan;Kim, Seung-Ho
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.22 no.2
    • /
    • pp.187-192
    • /
    • 2012
  • Recently, KARI(Korea Aerospace Research Institute) has been developing a modern 11.5 m diameter four bladed bearingless main rotor system, and this rotor system can be used for 7,000 lb class helicopter. Flexbeam and torque tube can be considered as key structural components, and large elastic twist of flexbeam induced by pitch control motion of torque tube can influence the nonlinear aeroelastic behavior. In this paper, the dynamic characteristic analysis results of bearingless rotor system were presented. In order to construct a input model and validate the analysis procedures, calculated results using the comprehensive helicopter analysis program CAMRAD II were compared with the measured natural frequencies and lag damping data from small-scale wind tunnel test. Next, the analysis model was extended to a full-scale model, and the dynamic analysis results were presented.

An Energy-Efficient Dynamic Area Compression Scheme in Wireless Multimedia Sensor Networks (무선 멀티미디어 센서 네트워크에서 에너지 효율적인 동적 영역 압축 기법)

  • Park, Junho;Ryu, Eunkyung;Son, Ingook;Yoo, Jaesoo
    • The Journal of the Korea Contents Association
    • /
    • v.13 no.12
    • /
    • pp.9-18
    • /
    • 2013
  • In recent years, the demands of multimedia data in wireless sensor networks have been significantly increased for the high-quality environment monitoring applications that utilize sensor nodes to collect multimedia data. However, since the amount of multimedia data is very large, the network lifetime and network performance are significantly reduced due to excessive energy consumption on particular nodes. In this paper, we propose an energy-efficient dynamic area compression scheme in wireless multimedia sensor networks. The proposed scheme minimizes the energy consumption in the huge multimedia data transmission process by compression using the Chinese Remainder Theorem(CRT) and dynamic area detection and division algorithm. Our experimental results show that our proposed scheme improves the data compression ratio by about 37% and reduces the amount of transmitted data by about 56% over the existing scheme on average. In addition, the proposed scheme increases network lifetime by about 14% over the existing scheme on average.

SemFilter: A Simple and Efficient Semantic XML Message Filtering (SemFilter: 단순하며 효율적인 시맨틱 XML 메시지 필터링)

  • Kim, Jae-Hoon;Park, Seog
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.14 no.7
    • /
    • pp.680-693
    • /
    • 2008
  • Recent studies on XML filtering assume that all data sources follow a single global schema defined in a filtering system. However, beyond this simple assumption, a filtering system can provide a service that allows data publishers to have their own schema; hence, the data sources will become heterogeneous. The number of data sources is expected to be large in a filtering system and the data sources are frequently published, updated, and disappeared, that is, dynamic. In this paper, we introduce implementing a simple and efficient XPath query translation method for such a dynamic environment. The method is especially targeted for a query which is composed based only on users' knowledge and experience without a graphical guidance of the global schema. When a user queries a large number of heterogeneous data, there is a high possibility that the query is not consistent with the same local schema assumed by the user. Our query translation method also supports a function for this problem. Some experimental results for query translation performance have shown that our method has reasonable performance, and is more practical than the existing method.

Rheological Behavior of Viscoelastic Semi-Solid Ointment Base (Vaseline) in Oscillatory Shear Flow Fields (진동전단유동장에서 점탄성 반고형 연고기제(바셀린)의 레올로지 거동)

  • Song, Ki-Won;Chang, Gap-Shik
    • Journal of Pharmaceutical Investigation
    • /
    • v.36 no.1
    • /
    • pp.31-38
    • /
    • 2006
  • Using a Rheometries Dynamic Analyzer (RDA II), the dynamic viscoelastic properties of a semi-solid ointment base (vaseline) in large amplitude oscillatory shear flow fields were measured over a temperature range of $25{\sim}45^{\circ}C$ and the linear viscoelastic behavior in small amplitude oscillatory shear flow fields was investigated over a wide range of angular frequencies. In this article, the nonlinear viscoelastic behavior was reported from the experimentally obtained data and the effect of temperature on this behavior was discussed in detail. In addition, the angular frequency and temperature dependencies of a linear viscoelastic behavior were explained. Finally, the applicability of a time-temperature superposition principle originally developed for polymeric materials was examined using a shift factor. Main results obtained from this study can be summarized as follows : (1) At very small strain amplitude region, vaseline shows a linear viscoelastic behavior independent of the imposed deformation magnitudes. Above a critical strain amplitude $({\gamma}_{0}=0.1{\sim}0.2%)$, however, vaseline exhibits a nonlinear viscoelastic behavior ; indicating that both the storage modulus and dynamic viscosity are sharply decreased with increasing deformation magnitude. (2) In large amplitude oscillatory shear flow fields, an elastic behavior (storage modulus) has a stronger strain amplitude dependence and begins to show a nonlinear behavior at a smaller strain amplitude region than does a viscous behavior (dynamic viscosity). (3) In small amplitude oscillatory shear flow fields, the storage modulus as well as the loss modulus are continuously increased as an increase in angular frequency and an elastic nature is always superior to a viscous behavior over a wide range of angular frequencies. (4) A time-temperature superposition principle can successfully be applicable to vaseline. This finding allows us to estimate the dynamic viscoelastic behavior of vaseline over an extraordinarily extended range (11 decades) of angular frequencies inaccessible from the experimentally measured range (4 decades).

Evaluation of Turbulent Flame Speed Model for Turbulent Premixed Combustion Flow around Bluff Body (보염기 주위의 난류 예혼합 연소에 관한 난류화염 속도 모델의 평가)

  • Park, Nam-Seob;Ko, Sang-Cheol
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.35 no.1
    • /
    • pp.82-88
    • /
    • 2011
  • The objective of this study is to investigate the validity of the dynamic sub-grid G-equation model to a complex turbulent premixed combustion such as bluff body stabilized turbulent premixed flames for the considering of the realistic engineering application. In this study, a new turbulent flame speed model, introduced by the sub-grid turbulent diffusivity and the flame thickness, is also proposed and is compared with an usual model using sub-grid turbulent intensity and with the experimental data. The calculated results can predict the velocity and temperature of the combustion flow in good agreement with the experiment data.

Links Between Macro Facilitators of Organizational Empowerment and Ambidextrous Behaviors: An Empirical Study from Pakistan

  • IQBAL, Sumaira;PARVEZ, Anjum;ANJUM, Muhammad Adeel;SAFDAR, Tayybah;AHMED, Ammarah
    • The Journal of Asian Finance, Economics and Business
    • /
    • v.9 no.2
    • /
    • pp.113-120
    • /
    • 2022
  • The goal of this study is to see if there's a relationship between employees' ambidextrous behaviors and macro facilitators of organizational empowerment (such as control over workplace decisions, dynamic structural framework, and fluidity in information sharing) (exploration and exploitation). To acquire data, this study uses survey methods. A cross-sectional survey was done to collect information from academics at five large public sector universities in Pakistan's Balochistan province. Control over workplace decisions boosts academics' engagement in exploration and exploitation, while a dynamic structural framework merely increases their engagement in exploration, according to the findings based on data from 240 respondents (n = 240). The findings also show that information sharing flexibility has little effect on exploration and exploitation behaviors. In conclusion, the results of this study imply that organizational empowerment is critical for academics' ambidextrous behaviors to thrive. As a result, specific organizational facilitators of empowerment (such as control over workplace decisions and a dynamic structural framework) are advised in higher education institutions. This research is significant because it develops and tests a model that explains hitherto unexplored connections between macro facilitators of organizational empowerment and employees' ambidextrous behaviors. In addition, the research provides important insights for managerial practice and research.