• Title/Summary/Keyword: Big data platform

Search Result 506, Processing Time 0.026 seconds

Utilizing Spatial Big Data for Land and Housing Sector (토지주택분야 정보 현황과 빅데이터 연계활용 방안)

  • Jeong, Yeun-Woo;Yu, Jong-Hun
    • Land and Housing Review
    • /
    • v.7 no.1
    • /
    • pp.19-29
    • /
    • 2016
  • This study proposes the big data policy and case studies in Korea and the application of land and housing of spatial big data to excavate the future business and to propose the spatial big data based application for the government policy in advance. As a result, at first, the policy and cases of big data in Korea were evaluated. Centered on the Government 3.0 Committee, the information from each department of government is being established with the big-data-based system, and the Ministry of Land, Infrastructure, and Transport is establishing the spatial big data system from 2013 to support application of big data through the platform of national spatial information and job creation. Second, based on the information system established and administrated by LH, the status of national territory information and the application of land and housing were evaluated. First of all, the information system is categorized mainly into the support of public ministration, statistical view, real estate information, on-line petition, and national policy support, and as a basic direction of major application, the national territory information (DB), demand of application (scope of work), and profit creation (business model) were regarded. After the settings of such basic direction, as a result of evaluating an approach in terms of work scope and work procedure, the four application fields were extracted: selection of candidate land for regional development business, administration and operation of rental house, settings of priority for land preservation, and settings of priority for urban generation. Third, to implement the application system of spatial big data in the four fields extracted, the required data and application and analytic procedures for each application field were proposed, and to implement the application solution of spatial big data, the improvement and future direction of evaluation required from LH were proposed.

In Small and Medium Business the Government 3.0-based Big Data Utilization Policy (중소기업에서 정부 3.0기반의 빅 데이터 활용정책)

  • Cho, Young-Bok;Woo, Seng-hee;Lee, Sang-Ho
    • Journal of Convergence Society for SMB
    • /
    • v.3 no.1
    • /
    • pp.15-22
    • /
    • 2013
  • Recently, in Korea lacks the innovation for small and medium enterprises the proportion of enterprises' capabilities are poor. In addition, sales of small business and medium scale venture are vulnerable because it is difficult to expect developments in the situation. thus the government 3.0 based small business and medium scale venture will present ways to take advantage of big data. Government 3.0 based big data infrastructure, small businesses and small and medium-sized ventures to build their autonomy is required so that you can take advantage of the platform advantage.

  • PDF

Design of Spark SQL Based Framework for Advanced Analytics (Spark SQL 기반 고도 분석 지원 프레임워크 설계)

  • Chung, Jaehwa
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.5 no.10
    • /
    • pp.477-482
    • /
    • 2016
  • As being the advanced analytics indispensable on big data for agile decision-making and tactical planning in enterprises, distributed processing platforms, such as Hadoop and Spark which distribute and handle the large volume of data on multiple nodes, receive great attention in the field. In Spark platform stack, Spark SQL unveiled recently to make Spark able to support distributed processing framework based on SQL. However, Spark SQL cannot effectively handle advanced analytics that involves machine learning and graph processing in terms of iterative tasks and task allocations. Motivated by these issues, this paper proposes the design of SQL-based big data optimal processing engine and processing framework to support advanced analytics in Spark environments. Big data optimal processing engines copes with complex SQL queries that involves multiple parameters and join, aggregation and sorting operations in distributed/parallel manner and the proposing framework optimizes machine learning process in terms of relational operations.

An Analysis of Changes in Perception of Metaverse through Big Data - Comparing Before and After COVID-19 - (빅데이터 분석을 통한 메타버스에 대한 인식 변화 분석 - 코로나19 발생 전후 비교를 중심으로 -)

  • Kang, Yu Rim;Kim, Mun Young
    • Fashion & Textile Research Journal
    • /
    • v.24 no.5
    • /
    • pp.593-604
    • /
    • 2022
  • The purpose of this study is to analyze the flow of change in perception of metaverse before and after COVID-19 through big data analysis. This research method used Textom to collect all data, including metaverse for two years before COVID-19 (2018.1.1~2019.11.30) and after COVID-19 outbreak (2020.1.11~2021.12.31), and the collection channels were selected by Naver and Google. The collected data were text mining, and word frequency, TF-IDF, word cloud, network analysis, and emotional analysis were conducted. As a result of the analysis, first, hotels, weddings, and glades were commonly extracted as social issues related to metaverse before and after COVID-19, and keywords such as robots and launches were derived, so the frequency of keywords related to hotels and weddings was high. Second, the association of the pre-COVID-19 metaverse keywords was platform-oriented, content-oriented, economic-oriented, and online promotion-oriented, and post-COVID-19 clusters were event-oriented, ontact sales-oriented, stock-oriented, and new businesses. Third, positive keywords such as likes, interest, and joy before COVID-19 were high, and positive keywords such as likes, joy, and interest after COVID-19. In conclusion, through this study, it was found that metaverse has firmly established itself as a new platform business model that can be used in various fields such as tourism, travel, festivals, and education using smart technology and metaverse.

Operational Big Data Analytics platform for Smart Factory (스마트팩토리를 위한 운영빅데이터 분석 플랫폼)

  • Bae, Hyerim;Park, Sanghyuck;Choi, Yulim;Joo, Byeongjun;Sutrisnowati, Riska Asriana;Pulshashi, Iq Reviessay;Putra, Ahmad Dzulfikar Adi;Adi, Taufik Nur;Lee, Sanghwa;Won, Seokrae
    • The Journal of Bigdata
    • /
    • v.1 no.2
    • /
    • pp.9-19
    • /
    • 2016
  • Since ICT convergence became a major issue, German government has carried forward a policy 'Industry 4.0' that triggered ICT convergence with manufacturing. Now this trend gets into our stride. From this facts, we can expect great leap up to quality perfection in low cost. Recently Korean government also enforces policy with 'Manufacturing 3.0' for upgrading Korean manufacturing industry with being accelerated by many related technologies. We, in the paper, developed a custom-made operational big data analysis platform for the implementation of operational intelligence to improve industry capability. Our platform is designed based on spring framework and web. In addition, HDFS and spark architectures helps our system analyze massive data on the field with streamed data processed by process mining algorithm. Extracted knowledge from data will support enhancement of manufacturing performance.

  • PDF

An Extraction Method of Sentiment Infromation from Unstructed Big Data on SNS (SNS상의 비정형 빅데이터로부터 감성정보 추출 기법)

  • Back, Bong-Hyun;Ha, Ilkyu;Ahn, ByoungChul
    • Journal of Korea Multimedia Society
    • /
    • v.17 no.6
    • /
    • pp.671-680
    • /
    • 2014
  • Recently, with the remarkable increase of social network services, it is necessary to extract interesting information from lots of data about various individual opinions and preferences on SNS(Social Network Service). The sentiment information can be applied to various fields of society such as politics, public opinions, economics, personal services and entertainments. To extract sentiment information, it is necessary to use processing techniques that store a large amount of SNS data, extract meaningful data from them, and search the sentiment information. This paper proposes an efficient method to extract sentiment information from various unstructured big data on social networks using HDFS(Hadoop Distributed File System) platform and MapReduce functions. In experiments, the proposed method collects and stacks data steadily as the number of data is increased. When the proposed functions are applied to sentiment analysis, the system keeps load balancing and the analysis results are very close to the results of manual work.

ETRI AI Strategy #1: Proactively Securing AI Core Technologies (ETRI AI 실행전략 1: 인공지능 핵심기술 선제적 확보)

  • Kim, S.M.;Yeon, S.J.
    • Electronics and Telecommunications Trends
    • /
    • v.35 no.7
    • /
    • pp.3-12
    • /
    • 2020
  • In this paper, we introduce ETRI AI Strategy #1, "Proactively Securing AI Core Technologies." The first goal of this strategy is to innovate artificial intelligence (AI) service technology to overcome the current limitations of AI technologies. Even though we saw a big jump in AI technology development recently due to the rise of deep learning (DL), DL still has technical limitations and problems. This paper introduces the four major parts of the advanced AI technologies that ETRI will secure to overcome the problems of DL and harmonize AI with the human world: post DL technology, human-AI collaboration technology, intelligence for autonomous things, and big data platform technology.

Development of personal health management data server platform based on health care data (헬스케어 데이터 기반의 개인 건강관리 데이터 서버 플랫폼 개발)

  • Park, Doyoung;Song, Hojun
    • Journal of Platform Technology
    • /
    • v.10 no.1
    • /
    • pp.29-34
    • /
    • 2022
  • The emergence of new diseases such as the Covid 19 pandemic that occurs in the 21st century and the occurrence of health abnormalities according to the busy daily life of modern people are increasing. Accordingly, the importance of health care management and data-based health management is being highlighted, and in particular, interest in personal health management data based on personal health care data of patients is rapidly increasing. In this study, to solve the difficult problems of personal health management, we developed a personal health care platform incorporating IT for self-diagnosis and solution and developed an application that measures bio-signals generated in the human body and transmits them to the platform. A health management system was established. Through this, not only the health care of modern people, but also the psychological and emotional care support needs through psychological and emotional monitoring of the developmentally disabled and the vulnerable who have difficulty in expressing their opinions are to be addressed. In addition, the overall health and living environment data of the individual was integrated to develop an optimized medical and health management service for the individual.

A Study on Factors Affecting BigData Acceptance Intention of Agricultural Enterprises (농업 관련 기업의 빅데이터 수용 의도에 미치는 영향요인 연구)

  • Ryu, GaHyun;Heo, Chul-Moo
    • Asia-Pacific Journal of Business Venturing and Entrepreneurship
    • /
    • v.17 no.1
    • /
    • pp.157-175
    • /
    • 2022
  • At this moment, a paradigm shift is taking place across all sectors of society for the transition movements to the digital economy. Various movements are taking place in the global agricultural industry to achieve innovative growth using big data which is a key resource of the 4th industrial revolution. Although the government is making various attempts to promote the use of big data, the movement of the agricultural industry as a key player in the use of big data, is still insufficient. Therefore, in this study, effects of performance expectations, effort expectations, social impact, facilitation conditions, based on the Unified Theory of Acceptance and Use of Technology(UTAUT), and innovation tendencies on the acceptance intention of big data were analyzed using the economic and practical benefits that can be obtained from the use of big data for agricultural-related companies as moderating variables. 333 questionnaires collected from agricultural-related companies were used for empirical analysis. The analysis results using SPSS v22.0 and Process macro v3.4 were found to have a significant positive (+) effect on the intention to accept big data by effort expectations, social impact, facilitation conditions, and innovation tendencies. However, it was found that the effect of performance expectations on acceptance intention was insignificant, with social impact having the greatest influence on acceptance intention and innovation tendency the least. Moderating effects of economic benefit and practical benefit between effort expectation and acceptance intention, moderating effect of practical benefit between social impact and acceptance intention, and moderating effect of economic benefit and practical benefit between facilitation condition and acceptance intention were found to be significant. On the other hand, it was found that economic benefits and practical benefits did not moderate the magnitude of the influence of performance expectations and innovation tendency on acceptance intention. These results suggest the following implications. First, in order to promote the use of big data by companies, the government needs to establish a policy to support the use of big data tailored to companies. Significant results can only be achieved when corporate members form a correct understanding and consensus on the use of big data. Second, it is necessary to establish and implement a platform specialized for agricultural data which can support standardized linkage between diverse agricultural big data, and support for a unified path for data access. Building such a platform will be able to advance the industry by forming an independent cooperative relationship between companies. Finally, the limitations of this study and follow-up tasks are presented.

Processing Method of Mass Small File Using Hadoop Platform (하둡 플랫폼을 이용한 대량의 스몰파일 처리방법)

  • Kim, Chang-Bok;Chung, Jae-Pil
    • Journal of Advanced Navigation Technology
    • /
    • v.18 no.4
    • /
    • pp.401-408
    • /
    • 2014
  • Hadoop is composed with MapReduce programming model for distributed processing and HDFS distributed file system. Hadoop is suitable framework for big data processing, but processing of mass small files have many problems. The processing of mass small file in hadoop have problems to created one mapper per one file, and it have problems to needed many memory for store of meta information of file. This paper have comparison evaluation processing method of mass small file with various method in hadoop platform. The processing of general compression format is inadequate because of processing by one mapper regardless of data size. The processing of sequence and hadoop archive file is removed memory problem of namenode by compress and combine of small file. Hadoop archive file is faster then sequence file about combine time of small file. The processing using CombineFileInputFormat class is needed not combine of small file, and it have similar speed big data processing method.