• Journal of Korean Society for Geospatial Information Science
• /
• v.24 no.4
• /
• pp.89-96
• /
• 2016

By reviewing preceding studies of big data and spatial big data, spatial big data was defined as one part of big data, which spatialize location information and systematize time series data. Spatial big data, as one part of big data, should not be separated with big data and application methods within the system is to be examined. Therefore in this study, services that spatial big data is required to provide were suggested. Spatial big data must be available of various spatial analysis and is in need of services that considers present and future spatial information. Not only should spatial big data be able to detect time series changes in location, but also analyze various type of big data using attribute information of spatial data. To successfully provide the requirements of spatial big data and link various type of big data with spatial big data, methods of forming sample points and extracting attribute information were proposed in this study. The increasing application of spatial information related to big data is expected to attribute to the development of spatial data industry and technological advancement.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.33 no.5
• /
• pp.385-396
• /
• 2015

The purpose of this study are in selecting a core service and drawing an analysis functions and service sector, based on contents of geo-spatial big data. For the study, the demand survey in the methodology has to be done by reviewing of preceding geo-spatial big data service. The survey has conducted by targeting on those experts in Industry-Academy-Research cooperation. From the survey, we could draw out requirements for the analysis function and the geo-spatial big data service sector. Also, order of priorities in service of four fields(Society, Environment, Economy, Humanities) has been utilized by a QFD(Quality Function Deployment). With the data, the first two priorities and required sectors for each field were selected for the analysis functions. From the result, we could suggest the core service model(plan), and also expect developments following each sectoral core service in the future.

• Land and Housing Review
• /
• v.7 no.1
• /
• pp.19-29
• /
• 2016

This study proposes the big data policy and case studies in Korea and the application of land and housing of spatial big data to excavate the future business and to propose the spatial big data based application for the government policy in advance. As a result, at first, the policy and cases of big data in Korea were evaluated. Centered on the Government 3.0 Committee, the information from each department of government is being established with the big-data-based system, and the Ministry of Land, Infrastructure, and Transport is establishing the spatial big data system from 2013 to support application of big data through the platform of national spatial information and job creation. Second, based on the information system established and administrated by LH, the status of national territory information and the application of land and housing were evaluated. First of all, the information system is categorized mainly into the support of public ministration, statistical view, real estate information, on-line petition, and national policy support, and as a basic direction of major application, the national territory information (DB), demand of application (scope of work), and profit creation (business model) were regarded. After the settings of such basic direction, as a result of evaluating an approach in terms of work scope and work procedure, the four application fields were extracted: selection of candidate land for regional development business, administration and operation of rental house, settings of priority for land preservation, and settings of priority for urban generation. Third, to implement the application system of spatial big data in the four fields extracted, the required data and application and analytic procedures for each application field were proposed, and to implement the application solution of spatial big data, the improvement and future direction of evaluation required from LH were proposed.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.26 no.11
• /
• pp.1729-1740
• /
• 2022

Recently, a lot of data has been generated according to the diversity and utilization of information, and the importance of big data analysis to collect, store, process and predict data has increased, and the ability to collect only necessary information is required. More than half of the web space consists of text, and a lot of data is generated through the organic interaction of users. There is a crawling technique as a representative method for collecting text data, but many crawlers are being developed that do not consider web servers or administrators because they focus on methods that can obtain data. In this paper, we design and implement an improved dynamic web crawler that can efficiently fetch data by examining problems that may occur during the crawling process and precautions to be considered. The crawler, which improved the problems of the existing crawler, was designed as a multi-process, and the work time was reduced by 4 times on average.

• Journal of Digital Convergence
• /
• v.20 no.3
• /
• pp.343-348
• /
• 2022

Recently, With the recent rapid development of technology, the amount of data generated by various systems is increasing, and enterprise servers and data centers that have to handle large amounts of big data need to apply high-stability and high-performance storage devices even if costs increase. In such systems, SSD(solid state disk) that provide high performance of read/write are often used as storage devices. However, due to the characteristics of reading and writing on a page-by-page basis, erasing operations on a block basis, and erassing-before-writing, there is a problem that performance is degraded when duplicate writes occur. Therefore, in order to delay this performance degradation problem, over-provision technology of SSD has been applied internally. However, since over-provided technologies have the disadvantage of consuming a lot of storage space instead of performance, the application of inefficient technologies above the right performance has a problem of over-costing. In this paper, we proposed a method of measuring the performance and cost incurred when various over-provisions are applied in an SSD and predicting the system-optimized over-provided ratio based on this. Through this research, we expect to find a trade-off with costs to meet the performance requirements in systems that process big data.