• 제목/요약/키워드: 공공빅데이터

Search Result 302, Processing Time 0.028 seconds

Job-related analysis and visualization using big data distributed processing system (빅데이터를 활용한 직업관련 분석 및 시각화)

  • Choi, Dong-Cheol;Choi, Nakjin;Kim, Min-Seok;Park, Jun-wook;Lee, Jun-Dong
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2020.07a
    • /
    • pp.249-251
    • /
    • 2020
  • 본 논문에서는 코로나바이러스감염증19 사태가 국내 취업시장에 어떠한 영향을 미쳤는지에 대해 알아보기 위하여 빅데이터를 활용한 직업 관련 분석 및 시각화를 수행하였다. 빅데이터를 위한 기본 자료는 통계청 자료와 워크넷 Open API를 활용하였으며, 빅데이터 처리 과정을 거쳐 결과값을 예측을 시도하였다. 2020년도 워크넷 Open API를 통해 고용수와 통계청 자료를 통해 비교 분석 및 시각화를 실시하였고, 08년~20년 취업자수를 통해 시계열 분석 및 예측을 진행해 앞으로의 횡보를 예상해보았다. 분석한 결과 19년, 20년도를 비교 분석했을 때에는 크게 차이가 나지 않았다. 추가적으로 시계열 분석기법을 활용해 보았을 때 매년 고용수는 전체적으로 증가하고 4월에는 감소, 7월에는 증가하는 추세가 나왔다. 코로나바이러스감염증19 사태로 인해 공공기관과 언택트 시대에 따른 화상회의나 재택근무로 인해 운수·통신 취업률은 상승한다는 결과값이 도출되었고, 자영업이나 서비스 직업 등은 다른 직종에 비해 큰 감소를 보여줬으나 국가 경제 활성화에 따른 고용수는 점차 증가할 것이라 예측된다.

  • PDF

Social Big Data Analysis for Franchise Stores

  • Kim, Hyeon Gyu
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.8
    • /
    • pp.39-46
    • /
    • 2021
  • When conducting social big data analysis for franchise stores, reviews of multiple branches of a franchise can be collected together, from which analysis results can be distorted significantly. To improve its accuracy, it should be possible to filter reviews of other branches properly which are not subject to the analysis. This paper presents a method for social big data analysis which reflects characteristics of franchise stores. The proposed method consists of search key configuration and review filtering. For the former, the open data provided by Small Business Promotion Agency is used to extract region names for collecting reviews more accurately. For the latter, open search APIs provided by Naver or Kakao are used to obtain franchise branch information for filtering reviews of other branches that are not subject to analysis. To verify performance of the proposed method, experiments were conducted based on real social reviews collected from online, where the results showed that the accuracy of the proposed review filtering was 93.6% on the average.

Comparison of Micro Mobility Patterns of Public Bicycles Before and After the Pandemic: A Case Study in Seoul (팬데믹 전후 공공자전거의 마이크로 모빌리티 패턴 비교: 서울시 사례 연구)

  • Jae-Hee Cho;Ga-Eun Baek;Il-Jung Seo
    • The Journal of Bigdata
    • /
    • v.7 no.2
    • /
    • pp.235-244
    • /
    • 2022
  • The rental history data of public bicycles in Seoul were analyzed to examine how pandemic phenomena such as COVID-19 caused changes in people's micro mobility. Data for 2019 and 2021 were compared and analyzed by dividing them before and after COVID-19. Data were collected from public data portal sites, and data marts were created for in-depth analysis. In order to compare the changes in the two periods, the riding direction type dimension and the rental station type dimension were added, and the derived variables (rotation rate per unit, riding speed) were newly created. There is no significant difference in the average rental time before and after COVID-19, but the average rental distance and average usage speed decreased. Even in the mobility of Ttareungi, you can see the slow rhythm of daily life. On weekdays, the usage rate was the highest during commuting hours even before COVID-19, but it increased rapidly after COVID-19. It can be interpreted that people who are concerned about infection prefer Ttareungi to village buses as a means of micro-mobility. The results of data mart-based visualization and analysis proposed in this study will be able to provide insight into public bicycle operation and policy development. In future studies, it is necessary to combine SNS data such as Twitter and Instagram with public bicycle rental history data. It is expected that the value of related research can be improved by examining the behavior of bike users in various places.

Development of Smart City IoT Data Quality Indicators and Prioritization Focusing on Structured Sensing Data (스마트시티 IoT 품질 지표 개발 및 우선순위 도출)

  • Yang, Hyun-Mo;Han, Kyu-Bo;Lee, Jung Hoon
    • The Journal of Bigdata
    • /
    • v.6 no.1
    • /
    • pp.161-178
    • /
    • 2021
  • The importance of 'Big Data' is increasing to the point that it is likened to '21st century crude oil'. For smart city IoT data, attention should be paid to quality control as the quality of data is associated with the quality of public services. However, data quality indicators presented through ISO/IEC organizations and domestic/foreign organizations are limited to the 'User' perspective. To complement these limitations, the study derives supplier-centric indicators and their priorities. After deriving 3 categories and 13 indicators of supplier-oriented smart city IoT data quality evaluation indicators, we derived the priority of indicator categories and data quality indicators through AHP analysis and investigated the feasibility of each indicator. The study can contribute to improving sensor data quality by presenting the basic requirements that data should have to individuals or companies performing the task. Furthermore, data quality control can be performed based on indicator priorities to provide improvements in quality control task efficiency.

Hadoop-based Large Data Management and Analysis for Parking Enforcement System (주정차 단속 시스템을 위한 하둡 기반 대용량 데이터 관리 및 분석)

  • Baek, Na-Eun;Song, Youngho;Shin, Jaehwan;Chang, Jae-Woo
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2017.04a
    • /
    • pp.429-432
    • /
    • 2017
  • 자동차 보급률 증가로 인해 교통 혼잡, 불법 주정차 등의 사회적 문제가 발생하고 있다. 특히 불법 주정차는 교통 혼잡, 주차 공간 부족 등 부가적인 문제를 발생시키고 있다. 따라서 각 지방자치단체에서는 불법 주정차 문제를 해결하기 위한 방안을 연구하고 있다. 그러나 이러한 방안은 초기 비용 발생 및 인력 부족 등의 한계가 있다. 한편, 정보통신의 발달에 따라 공공 업무에도 대량의 공공데이터를 효율적으로 처리하기 위한 연구가 진행되고 있다. 하지만 이러한 연구 또한 빅데이터 처리 플랫폼 부족 및 분석 시스템이 미흡한 한계가 존재한다. 따라서 본 논문에서는 불법 주정차 데이터와 같은 공공 데이터를 효율적으로 처리하기 위해, 주정차 단속 시스템을 위한 하둡 기반 대용량 데이터 관리 및 분석 시스템을 제안한다. 제안하는 시스템은 첫째, 주차단속을 수행할 때 주차단속 데이터를 하이브(Hive)를 통해 저장하고, 단속된 차량의 차주를 검색하여 단속임을 알리거나 과태료를 부과한다. 둘째, 웹 인터페이스를 통해 수집된 주차단속 데이터에 대한 다양한 분석을 수행하고, 분석된 데이터에 대한 R을 이용한 시각화를 제공한다.

A Study on Personal Information Protection System for Big Data Utilization in Industrial Sectors (산업 영역에서 빅데이터 개인정보 보호체계에 관한 연구)

  • Kim, Jin Soo;Choi, Bang Ho;Cho, Gi Hwan
    • Smart Media Journal
    • /
    • v.8 no.1
    • /
    • pp.9-18
    • /
    • 2019
  • In the era of the 4th industrial revolution, the big data industry is gathering attention for new business models in the public and private sectors by utilizing various information collected through the internet and mobile. However, although the big data integration and analysis are performed with de-identification techniques, there is still a risk that personal privacy can be exposed. Recently, there are many studies to invent effective methods to maintain the value of data without disclosing personal information. In this paper, a personal information protection system is investigated to boost big data utilization in industrial sectors, such as healthcare and agriculture. The criteria for evaluating the de-identification adequacy of personal information and the protection scope of personal information should be differently applied for each industry. In the field of personal sensitive information-oriented healthcare sector, the minimum value of k-anonymity should be set to 5 or more, which is the average value of other industrial sectors. In agricultural sector, it suggests the inclusion of companion dogs or farmland information as sensitive information. Also, it is desirable to apply the demonstration steps to each region-specific industry.

e-Gov's Big Data utilization plan for social crisis management (사회 위기관리를 위한 전자정부의 빅데이터 활용 방안)

  • Choung, Young-chul;Choy, Ik-su;Bae, Yong-guen
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.21 no.2
    • /
    • pp.435-442
    • /
    • 2017
  • Our anxiousness has risen for recent increase in unpredicatable disaster. Accordingly, for the future society's preventing measure in advance against current considerable disasters due to societal crisis, we need to prepare secure measure ahead. Hence, we need to recognize the significance of governmental role and the value of Big Data application as ICT developed country in order to manage social crisis all the time. This manuscript analyzes human anxiety from listed disasters and describes that our government seeks new way to utilize Big Data in public in order to visualize Big Data related issues and its significance and urgency. Also, it suggests domestic/international application trend of Big Data's public sector with new practical approach to Big Data. Then, it emphasizes e-Gov's role for its Big Data application and suggests policies implying governmental use of Big Data for social crisis management by case-studying disaster measures against unpredictable crisis.

Development of Customized Trip Navigation System Using Open Government Data (공공데이터를 활용한 맞춤형 여행 네비게이션 시스템 구현)

  • Shim, Beomsoo;Lee, Hanjun;Yoo, Donghee
    • Journal of Internet Computing and Services
    • /
    • v.17 no.1
    • /
    • pp.15-21
    • /
    • 2016
  • Under the flag of creative economy, Korea government is now releasing public data in order to develop or provide a range of services. In this paper, we develop a customized trip navigation system to recommend a trip itinerary based on integration of open government data and personal tourist data. The system uses case-based reasoning (CBR) to provide a personalized trip navigation service. The main difference between existing trip information systems and ours is that our system can offers a user-oriented information service. In addition, our system supports Turn-key style contents provision to maximize convenience. Our system can be a good example of the way in which open government data can be used to design a new service.

소셜 데이터에서 재난 사건 추출을 위한 사용자 행동 및 시간 분석을 반영한 토픽 모델

  • ;Lee, Gyeong-Sun
    • Information and Communications Magazine
    • /
    • v.34 no.6
    • /
    • pp.43-50
    • /
    • 2017
  • 본고에서는 소셜 빅데이터에서 공공안전에 위협되고 사회적으로 이슈가 되는 재난사건을 추출하기 위한 방법으로 소셜 네트워크상에서 사용자 행동 분석과 시간분석을 반영한 토픽 모델링 기법을 알아본다. 소셜 사용자의 글 수, 리트윗 반응, 활동주기, 팔로워 수, 팔로잉 수 등 사용자의 행동 분석을 통하여 활동적이고 신뢰성 있는 사용자를 분류함으로써 트윗에서 스팸성과 광고성을 제외하고 이슈에 대해 신뢰성 높은 사용자가 쓴 트윗을 중요하게 반영한다. 또한, 트위터 데이터에서 새로운 이슈가 발생한 것을 탐지하기 위해 시간별 핵심어휘 빈도의 분포 변화를 측정하고, 이슈 트윗에 대해 감성 표현 분석을 통해 핵심이슈에 대해 사건 어휘를 추출한다. 소셜 빅데이터의 특성상 같은 날짜에 여러 이슈에 대한 트윗이 많이 생성될 수 있기 때문에, 트윗들을 토픽별로 그룹핑하는 것이 필요하므로, 최근 많이 사용되고 있는 LDA 토픽모델링 기법에 시간 특성과 사용자 특성을 분석한 시간상에서의 중요한 사건 어휘를 반영하고, 해당이슈에 대한 신뢰성 있는 사용자가 쓴 트윗을 중요시 반영하도록 토픽모델링 기법을 개선한 소셜 사건 탐지 방법에 대해 알아본다.

Design and Implementation of a Realtime Public Transport Route Guidance System using Big Data Analysis (빅데이터 분석 기법을 이용한 실시간 대중교통 경로 안내 시스템의 설계 및 구현)

  • Lim, Jongtae;Bok, Kyoungsoo;Yoo, Jaesoo
    • The Journal of the Korea Contents Association
    • /
    • v.19 no.2
    • /
    • pp.460-468
    • /
    • 2019
  • Recently, analysis techniques to extract new meanings using big data analysis and various services using these analysis techniques have been developed. Among them, the transport is one of the most important areas that can be utilized about big data. However, the existing traffic route guidance system can not recommend the optimal traffic route because they use only the traffic information when the user search the route. In this paper, we propose a realtime optimal traffic route guidance system using big data analysis. The proposed system considers the realtime traffic information and results of big data analysis using historical traffic data. And, the proposed system show the warning message to the user when the user need to change the traffic route.