• Title/Summary/Keyword: Storage Space

Search Result 1,397, Processing Time 0.032 seconds

A proposal on a proactive crawling approach with analysis of state-of-the-art web crawling algorithms (최신 웹 크롤링 알고리즘 분석 및 선제적인 크롤링 기법 제안)

  • Na, Chul-Won;On, Byung-Won
    • Journal of Internet Computing and Services
    • /
    • v.20 no.3
    • /
    • pp.43-59
    • /
    • 2019
  • Today, with the spread of smartphones and the development of social networking services, structured and unstructured big data have stored exponentially. If we analyze them well, we will get useful information to be able to predict data for the future. Large amounts of data need to be collected first in order to analyze big data. The web is repository where these data are most stored. However, because the data size is large, there are also many data that have information that is not needed as much as there are data that have useful information. This has made it important to collect data efficiently, where data with unnecessary information is filtered and only collected data with useful information. Web crawlers cannot download all pages due to some constraints such as network bandwidth, operational time, and data storage. This is why we should avoid visiting many pages that are not relevant to what we want and download only important pages as soon as possible. This paper seeks to help resolve the above issues. First, We introduce basic web-crawling algorithms. For each algorithm, the time-complexity and pros and cons are described, and compared and analyzed. Next, we introduce the state-of-the-art web crawling algorithms that have improved the shortcomings of the basic web crawling algorithms. In addition, recent research trends show that the web crawling algorithms with special purposes such as collecting sentiment words are actively studied. We will one of the introduce Sentiment-aware web crawling techniques that is a proactive web crawling technique as a study of web crawling algorithms with special purpose. The result showed that the larger the data are, the higher the performance is and the more space is saved.

Hydraulic Characteristics of Deep and Low Permeable Rock Masses in Gyeongju Area by High Precision Constant Pressure Injection Test (고정밀도 정압 주입시험에 의한 경주 지역 대심도 저투수성 암반 수리특성 연구)

  • Bae, SeongHo;Kim, Hagsoo;Kim, Jangsoon;Park, Eui Seob;Jo, Yeonguk;Ji, Taegu;Won, Kyung-Sik
    • Tunnel and Underground Space
    • /
    • v.31 no.4
    • /
    • pp.243-269
    • /
    • 2021
  • Since the early 2010s, the social importance of research and practical projects targeting deep geological disposal of high-level nuclear waste, underground CO2 storage and characterization of deep subsurface by borehole investigation has been increasing. In this regard, there is also a significant increase in the need for in situ test technology to obtain quantitative and reliable information on the hydraulic characteristics of deep rock mass. Through years of research and development, we have independently set up Deep borehole Hydraulic Test System (DHTS) based on the key apparatuses designed and made with our own technology. Using this system, high precision constant pressure injection tests were successfully completed at the two 1 km boreholes located in Mesozoic granite and sedimentary rock regions, Gyeongju. During the field tests, it was possible to measure very low flow rate below 0.01 l/min with micro flow rate injection/control module. In this paper, the major characteristics of DHTS are introduced and also some results obtained from the high precision field tests under the deep and low permeable rock mass environment are briefly discussed.

Probabilistic Assesment of the Effects of Vapor Cloud Explosion on a Human Body (증기운 폭발이 인체에 미치는 영향에 대한 확률론적 평가)

  • Yoon, Yong-Kyun;Ju, Eun-Hye
    • Tunnel and Underground Space
    • /
    • v.31 no.1
    • /
    • pp.52-65
    • /
    • 2021
  • In this study, authors analyzed the vapor cloud explosion induced by propane leak at the PEMIX Terminal, which is the propane storage facility outside of Mexico City. TNT equivalence mass for the leaked 4750 kg propane was estimated to be 9398 kg. Blast parameters such as peak overpressure, positive phase duration, and impact at 40-400 (m) away from the center of the explosion were calculated by applying TNT Equivalency Method and Multi-Energy Method. The probability of damage due to lung damage, eardrum rupture, head impact, and whole-body displacement impact by applying the probit function obtained using blast parameters was evaluated. The peak overpressure obtained using Multi-Energy Method was found to be greater than the peak overpressure obtained by applying the TNT Equivalency Method at all distances considered, but it was evaluated that there was no significant difference from the points above 200 m. The peak overpressure obtained by Multi-Energy Method was computed to assess the extent of damage to the structure, and it was shown that structures within 100 m of the explosion center would collapse completely, and that the glasses of the structures 400 m away would be almost broken. The probability of death due to lung damage was shown to vary depending on a human body's position located in the propagating direction of shock wave, and if there is a reflecting surface in the immediate surroundings of a human body, the probability of death was estimated to be the greatest. The impact of shock wave on lung damage, eardrum rupture, head impact, and whole-body displacement impact was evaluated and found to affect whole-body impact < lung damage < eardrum rupture

Combined Inland-River Operation Technique for Reducing Inundation in Urban Area: The Case of Mokgam Drainage Watershed (도시지역의 침수저감을 위한 내외수 연계 운영 기법 개발: 목감천 유역을 중심으로)

  • Kwon, Soon Ho;Jung, Hyun Woo;Hwang, Yoon Kwon;Lee, Eui Hoon;Kim, Joong Hoon
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.22 no.1
    • /
    • pp.257-266
    • /
    • 2021
  • Urban areas can often suffer flood damage because of the more frequent catastrophic rainfall events from climate change. Flood mitigation measures consist of (1) structural and (2) non-structural measures. In this study, the proposed method focused on operating an urban drainage system among non-structural measures. The combined inland-river operation technique estimates the inflow of pump stations based on the water level obtained from a preselected monitoring point, and the pump station expels the stored rainwater to the riverside based on those estimates. In this study, the proposed method was applied to the Mokgam drainage watershed, where catastrophic rainfall events occurred (i.e., 2010- and 2011-years), and severe flood damage was recorded in Seoul. Using the proposed method, the efficiency of flood reduction from the two rainfall events was reduced by 34.9 % and 54.4 %, respectively, compared to the current operation method. Thus, the proposed method can minimize the flood damage in the Mokgam drainage watershed by reserving the additional storage space of a reservoir. In addition, flooding from catastrophic rainfall can be prevented, and citizens' lives and property in urban areas can be protected.

A Review of In-Situ Characterization and Quality Control of EDZ During Construction of Final Disposal Facility for Spent Nuclear Fuel (사용후핵연료 최종처분장 건설과정에서의 굴착손상영역(EDZ)의 현장평가 방법 및 시공품질관리 체계에 관한 사례검토)

  • Kim, Hyung-Mok;Nam, Myung Jin;Park, Eui-Seob
    • Tunnel and Underground Space
    • /
    • v.32 no.2
    • /
    • pp.107-119
    • /
    • 2022
  • Excavation-Disturbed Zone (EDZ) is an important design factor in constructing final disposal facilities for spent nuclear fuel, since EDZ affects mechanical stability including a spacing between disposal holes, and the hydraulic properties within EDZ plays a significant role in estimating in-flow rate of groundwater as well as a subsequent corrosion rate of a canister. Thus, it is highly required to characterize in-situ EDZ with precision and control the EDZ occurrence while excavating disposal facilities and constructing relevant underground research facilities. In this report, we not only reviewed EDZ-related researches carried out in the ONKALO facility of Finland but also examined appropriate methods for field inspection and quality control of EDZ occurrence. From the review, GPR can be the most efficient method for in-situ characterization of EDZ since it does not demand drilling a borehole that may disturb a surrounding environment of caverns. And the EDZ occurrence was dominant at a cavern floor and it ranged from 0 to 70 cm. These can provide useful information in developing necessary EDZ-related regulations for domestic disposal facilities.

2D Interpolation of 3D Points using Video-based Point Cloud Compression (비디오 기반 포인트 클라우드 압축을 사용한 3차원 포인트의 2차원 보간 방안)

  • Hwang, Yonghae;Kim, Junsik;Kim, Kyuheon
    • Journal of Broadcast Engineering
    • /
    • v.26 no.6
    • /
    • pp.692-703
    • /
    • 2021
  • Recently, with the development of computer graphics technology, research on technology for expressing real objects as more realistic virtual graphics is being actively conducted. Point cloud is a technology that uses numerous points, including 2D spatial coordinates and color information, to represent 3D objects, and they require huge data storage and high-performance computing devices to provide various services. Video-based Point Cloud Compression (V-PCC) technology is currently being studied by the international standard organization MPEG, which is a projection based method that projects point cloud into 2D plane, and then compresses them using 2D video codecs. V-PCC technology compresses point cloud objects using 2D images such as Occupancy map, Geometry image, Attribute image, and other auxiliary information that includes the relationship between 2D plane and 3D space. When increasing the density of point cloud or expanding an object, 3D calculation is generally used, but there are limitations in that the calculation method is complicated, requires a lot of time, and it is difficult to determine the correct location of a new point. This paper proposes a method to generate additional points at more accurate locations with less computation by applying 2D interpolation to the image on which the point cloud is projected, in the V-PCC technology.

Geoscientific Research of Bedrock for HLW Geological Disposal using Deep Borehole (고준위방사성폐기물 심층처분을 위한 심부 시추공을 활용한 암반의 지구과학적 조사 )

  • Dae-Sung, Cheon;Won-Kyong, Song;You Hong, Kihm;Seungbeom, Choi;Seong Kon, Lee;Sung Pil, Hyun;Heejun, Suk
    • Tunnel and Underground Space
    • /
    • v.32 no.6
    • /
    • pp.435-450
    • /
    • 2022
  • In step-by-step site selection for geological disposal of high-level radioactive waste, parameters necessary for site selection will be acquired through deep drilling surveys from the basic survey stage. Unlike site investigations of rock mass structures such as tunnels and underground oil storage facilities, those related to the geological disposal of high-level radioactive waste are not only conducted in relatively deep depths, but also require a high level of quality control. In this report, based on the 750 m depth drilling experience conducted to acquire the parameters necessary for deep geological disposal, the methodology for deep drilling and the geology, geophysics, geochemistry, hydrogeology and rock mechanics obtained before, during, and after deep drilling are discussed. The procedures for multidisciplinary geoscientific investigations were briefly described. Regarding in-situ stress, one of the key evaluation parameter in the field of rock engineering, foreign and domestic cases related to the geological disposal of high-level radioactive waste were presented, and variations with depth were presented, and matters to be considered or agonized in acquiring evaluation parameters were mentioned.

Improvement of multi layer perceptron performance using combination of adaptive moments and improved harmony search for prediction of Daecheong Dam inflow (대청댐 유입량 예측을 위한 Adaptive Moments와 Improved Harmony Search의 결합을 이용한 다층퍼셉트론 성능향상)

  • Lee, Won Jin;Lee, Eui Hoon
    • Journal of Korea Water Resources Association
    • /
    • v.56 no.1
    • /
    • pp.63-74
    • /
    • 2023
  • High-reliability prediction of dam inflow is necessary for efficient dam operation. Recently, studies were conducted to predict the inflow of dams using Multi Layer Perceptron (MLP). Existing studies used the Gradient Descent (GD)-based optimizer as the optimizer among MLP operators to find the optimal correlation between data. However, the GD-based optimizers have disadvantages in that the prediction performance is deteriorated due to the possibility of convergence to the local optimal value and the absence of storage space. This study improved the shortcomings of the GD-based optimizer by developing Adaptive moments combined with Improved Harmony Search (AdamIHS), which combines Adaptive moments among GD-based optimizers and Improved Harmony Search (IHS). In order to evaluate the learning and prediction performance of MLP using AdamIHS, Daecheong Dam inflow was learned and predicted and compared with the learning and prediction performance of MLP using GD-based optimizer. Comparing the learning results, the Mean Squared Error (MSE) of MLP, which is 5 hidden layers using AdamIHS, was the lowest at 11,577. Comparing the prediction results, the average MSE of MLP, which is one hidden layer using AdamIHS, was the lowest at 413,262. Using AdamIHS developed in this study, it will be possible to show improved prediction performance in various fields.

Pallet Size Optimization for Special Cargo based on Neighborhood Search Algorithm (이웃해 탐색 알고리즘 기반의 특수화물 팔레트 크기 최적화)

  • Hyeon-Soo Shin;Chang-Hyeon Kim;Chang-Wan Ha;Hwan-Seong Kim
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • 2023.05a
    • /
    • pp.250-251
    • /
    • 2023
  • The pallet, typically a form of tertiary packaging, is a flat structure used as a base for the unitization of goods in the supply chain. In addition, standard pallets such as T-11 and T-12 are used throughout the logistics industry to reduce the cost and enhance the efficiency of transportation. However, in the case of special cargo, it is impossible to handle such cargo using a standard pallet due to its size and weight, so many have developed and are now using their customized pallet. Therefore, this study suggests a pallet size optimization method to calculate the optimal pallet size, which minimizes the loss of space on a pallet. The main input features are the specifications and the storage quantity of each cargo, and the optimization method that has modified the Neighborhood Search Algorithm calculates the optimal pallet size. In order to verify the optimality of the developed algorithm, a comparative analysis has been conducted through simulation.

  • PDF

Cortex M3 Based Lightweight Security Protocol for Authentication and Encrypt Communication between Smart Meters and Data Concentrate Unit (스마트미터와 데이터 집중 장치간 인증 및 암호화 통신을 위한 Cortex M3 기반 경량 보안 프로토콜)

  • Shin, Dong-Myung;Ko, Sang-Jun
    • Journal of Software Assessment and Valuation
    • /
    • v.15 no.2
    • /
    • pp.111-119
    • /
    • 2019
  • The existing smart grid device authentication system is concentrated on DCU, meter reading FEP and MDMS, and the authentication system for smart meters is not established. Although some cryptographic chips have been developed at present, it is difficult to complete the PKI authentication scheme because it is at the low level of simple encryption. Unlike existing power grids, smart grids are based on open two-way communication, increasing the risk of accidents as information security vulnerabilities increase. However, PKI is difficult to apply to smart meters, and there is a possibility of accidents such as system shutdown by sending manipulated packets and sending false information to the operating system. Issuing an existing PKI certificate to smart meters with high hardware constraints makes authentication and certificate renewal difficult, so an ultra-lightweight password authentication protocol that can operate even on the poor performance of smart meters (such as non-IP networks, processors, memory, and storage space) was designed and implemented. As a result of the experiment, lightweight cryptographic authentication protocol was able to be executed quickly in the Cortex-M3 environment, and it is expected that it will help to prepare a more secure authentication system in the smart grid industry.