• Title/Summary/Keyword: 빅데이터플랫폼

Search Result 483, Processing Time 0.031 seconds

Trends in Implementation of Homomorphic Encryption using GPU (GPU를 활용한 동형암호 구현 동향)

  • Eum, Si-Woo;Kim, Hyun-Jun;Lim, Se-Jin;Seo, Hwa-Jeong
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2022.11a
    • /
    • pp.213-215
    • /
    • 2022
  • 빅데이터, 인공지능, 클라우드 등의 기술이 발전함에 따라서 개인 정보나 중요 데이터가 많이 노출되고 있다. 동형암호는 암호화된 데이터에 대해서 직접 연산이 가능한 암호체계이다. 이러한 특성은 오늘날 클라우드 컴퓨팅 플랫폼에 매우 중요한 기술이지만, 많은 연산으로 인해 처리 시간이 오래 걸려 많이 사용되어 오고 있지 않다, GPU는 병렬 연산의 특성을 활용하여 CPU가 담당하는 작업을 훨씬 효율적으로 작업하는 것이 가능하다. 본 논문에서는 GPU를 활용하여 동형 암호의 속도 향상을 위한 기법 연구 동향에 대해 알아본다.

A Study on the Intention to Use Personal Financial Product Recommendation MyData Service (금융상품 비교/추천 마이데이터 서비스 이용 의도에 관한 연구)

  • Sung Hoon Cho;Jung Sook Jin;Joo Seok Park
    • The Journal of Bigdata
    • /
    • v.7 no.2
    • /
    • pp.173-193
    • /
    • 2022
  • With the revision of the Data 3 Act, the financial MyData industry was created newly. MyData services collect the financial customers' data scattered in various financial companies and provide personalized services such as personal financial product recommendation, personal expenditure advice, etc. Although MyData service started in 2022, but the use of the service has not been significantly activated. This study attempted to analyze the factors affecting the use of MyData services from the perspective of financial consumers through VAM, UTAUT2 model. The factors related to the perceived value and intention to use MyData services of financial consumers were verified using benefit and sacrifice variables. Personal Innovativeness was used as a moderating variable. As a result of this study, it was found that personal product recommendation service has an important influence on the use of MyData services, and personal innovativeness has an effect as a modulating variable. It can be said that it is meaningful as a preceding study in terms of timing because it studied the perceived value of consumers less than a year after the MyData service began. From the practical perspectives, it was possible to show the change direction and marketing points of the MyData service. In practice, it was possible to confirm the direction of the service and the marketing point.

Development Status and Prospect of Water Hazard Information Platform (국토관측센서 기반 수재해 정보 플랫폼 개발현황 및 전망)

  • Yu, Wansik;Park, Gwangha;Lee, Yonghyeon;Hwang, Euiho;Chae, Hyosok
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2020.06a
    • /
    • pp.383-383
    • /
    • 2020
  • 한반도를 비롯한 전 세계를 대상으로 가뭄과 홍수 등 물관련 재해정보를 체계적으로 수집·분석하고 이를 정부부처 및 민간에서도 제공 가능한 국가 차원의 과학적이고 효율적인 수재해 대응 및 관리 위하여 현재 수재해 정보플랫폼 융합기술 연구단이 2014년 7월 1일 출범하여 수행중에 있다. 정보플랫폼 융합기술 연구단은 국토관측센서(위성, 레이더, 지상관측자료) 기반 광역 및 지역 수재해 정보 허브 구축 및 운영기술 개발로 행복한 안심국토 및 물산업 강국 실현이라는 연구비전 아래, 고정밀 수문레이더 기반 도시홍수 관리기술, 가뭄/하천건천화 평가 및 예측 기술 개발, 홍수재해 평가 및 예측 기술 개발, 빅데이터기반 광역 및 지역 수자원정보 서비스 플랫폼 기술 개발이라는 4대 연구성과 목표로 X-Net 실증 테스트베드 구축을 통해 획득된 자료를 기반으로 수재해 감시·평가·예측 등에 필요한 관련 수문정보를 생성하고 있으며, 생성된 위성영상 및 수문레이더 등의 수문정보를 활용하여 미계측 유역에 대한 수자원 변동 감시 및 가뭄과 하천 건천화를 효율적으로 평가·예측함으로써 물안보 대응체계를 강화하기 위한 기술을 확보하고 있다. 또한 광역 및 국지 홍수 피해 범위와 규모 등을 평가·산정하고 정확히 예측함으로써 홍수재해를 저감할 수 있는 기술 개발을 추진하고 있으며, 최종적으로는 광역 및 지역 수문자료와 수재해 관련 분석정보를 체계적으로 관리하고 맞춤형 수재해 정보를 제공할 수 있는 수재해정보플랫폼 및 포털시스템을 개발 글로벌 물 정보 허브로써 기반을 조성해 나가고 있다. 이에 수재해 정보플랫폼 융합기술 연구단에서 개발하여 운영중에 있는 수재해 정보플랫폼의 고정밀 수문레이더 기반 도시홍수 관리시스템, 위성기반 가뭄 모니터링 시스템, 미계측 지역 수문정보 및 수자원 모니터링 시스템, 한국형 지표 수문정보 생성 시스템 개발현황 등 그간의 노력에 대해 소개하고자 한다.

  • PDF

A MapReduce-Based Workflow BIG-Log Clustering Technique (맵리듀스기반 워크플로우 빅-로그 클러스터링 기법)

  • Jin, Min-Hyuck;Kim, Kwanghoon Pio
    • Journal of Internet Computing and Services
    • /
    • v.20 no.1
    • /
    • pp.87-96
    • /
    • 2019
  • In this paper, we propose a MapReduce-supported clustering technique for collecting and classifying distributed workflow enactment event logs as a preprocessing tool. Especially, we would call the distributed workflow enactment event logs as Workflow BIG-Logs, because they are satisfied with as well as well-fitted to the 5V properties of BIG-Data like Volume, Velocity, Variety, Veracity and Value. The clustering technique we develop in this paper is intentionally devised for the preprocessing phase of a specific workflow process mining and analysis algorithm based upon the workflow BIG-Logs. In other words, It uses the Map-Reduce framework as a Workflow BIG-Logs processing platform, it supports the IEEE XES standard data format, and it is eventually dedicated for the preprocessing phase of the ${\rho}$-Algorithm that is a typical workflow process mining algorithm based on the structured information control nets. More precisely, The Workflow BIG-Logs can be classified into two types: of activity-based clustering patterns and performer-based clustering patterns, and we try to implement an activity-based clustering pattern algorithm based upon the Map-Reduce framework. Finally, we try to verify the proposed clustering technique by carrying out an experimental study on the workflow enactment event log dataset released by the BPI Challenges.

A Development Plan for Co-creation-based Smart City through the Trend Analysis of Internet of Things (사물인터넷 동향분석을 통한 Co-creation기반 스마트시티 구축 방안)

  • Park, Ju Seop;Hong, Soon-Goo;Kim, Na Rang
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.21 no.4
    • /
    • pp.67-78
    • /
    • 2016
  • Recently many countries around the world are actively promoting smart city projects to address various urban problems such as traffic congestion, housing shortage, and energy scarcity. Due to development of the Internet of Things (IoT), the development of a smart city with sustainability, convenience, and environment-friendliness was enabled through the effective control and reuse of urban resources. The purpose of this study is to analyze the technical trends of IoT and present a development plan for smart city which is one of the applications of the IoT. To this end, the news articles of the Electronic Times between 2013 and 2015were analyzed using the text mining technique and smart city development cases of other countries were investigated. The analysis results revealed the close relationships of big data, cloud, platforms, and sensors with smart city. For the successful development of a smart city, first, all the interested parties in the city must work together to create new values throughout the entire process of value chain. Second, they must utilize big data and disclose public data more actively than they are doing now. This study has made academic contribution in that it has presented a big data analysis method and stimulated follow-up studies. For the practical contribution, the results of this study provided useful data for the policy making of local governments and administrative agencies for smart city development. This study may have limitations in the incorporation of the total trends because only the news articles of the Electronic Times were selected to analyze the technical trends of the IoT.

Consumer Trend Platform Development for Combination Analysis of Structured and Unstructured Big Data (정형 비정형 빅데이터의 융합분석을 위한 소비 트랜드 플랫폼 개발)

  • Kim, Sunghyun;Chang, Sokho;Lee, Sangwon
    • Journal of Digital Convergence
    • /
    • v.15 no.6
    • /
    • pp.133-143
    • /
    • 2017
  • Data is the most important asset in the financial sector. On average, 71 percent of financial institutions generate competitive advantage over data analysis. In particular, in the card industry, the card transaction data is widely used in the development of merchant information, economic fluctuations, and information services by analyzing patterns of consumer behavior and preference trends of all customers. However, creation of new value through fusion of data is insufficient. This study introduces the analysis and forecasting of consumption trends of credit card companies which convergently analyzed the social data and the sales data of the company's own. BC Card developed an algorithm for linking card and social data with trend profiling, and developed a visualization system for analysis contents. In order to verify the performance, BC card analyzed the trends related to 'Six Pocket' and conducted th pilot marketing campaign. As a result, they increased marketing multiplier by 40~100%. This study has implications for creating a methodology and case for analyzing the convergence of structured and unstructured data analysis that have been done separately in the past. This will provide useful implications for future trends not only in card industry but also in other industries.

Lambda Architecture Used Apache Kudu and Impala (Apache Kudu와 Impala를 활용한 Lambda Architecture 설계)

  • Hwang, Yun-Young;Lee, Pil-Won;Shin, Yong-Tae
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.9 no.9
    • /
    • pp.207-212
    • /
    • 2020
  • The amount of data has increased significantly due to advances in technology, and various big data processing platforms are emerging, to handle it. Among them, the most widely used platform is Hadoop developed by the Apache Software Foundation, and Hadoop is also used in the IoT field. However, the existing Hadoop-based IoT sensor data collection and analysis environment has a problem of overloading the name node due to HDFS' Small File, which is Hadoop's core project, and it is impossible to update or delete the imported data. This paper uses Apache Kudu and Impala to design Lambda Architecture. The proposed Architecture classifies IoT sensor data into Cold-Data and Hot-Data, stores it in storage according to each personality, and uses Batch-View created through Batch and Real-time View generated through Apache Kudu and Impala to solve problems in the existing Hadoop-based IoT sensor data collection analysis environment and shorten the time users access to the analyzed data.

Hadoop-based Large Data Management and Analysis for Parking Enforcement System (주정차 단속 시스템을 위한 하둡 기반 대용량 데이터 관리 및 분석)

  • Baek, Na-Eun;Song, Youngho;Shin, Jaehwan;Chang, Jae-Woo
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2017.04a
    • /
    • pp.429-432
    • /
    • 2017
  • 자동차 보급률 증가로 인해 교통 혼잡, 불법 주정차 등의 사회적 문제가 발생하고 있다. 특히 불법 주정차는 교통 혼잡, 주차 공간 부족 등 부가적인 문제를 발생시키고 있다. 따라서 각 지방자치단체에서는 불법 주정차 문제를 해결하기 위한 방안을 연구하고 있다. 그러나 이러한 방안은 초기 비용 발생 및 인력 부족 등의 한계가 있다. 한편, 정보통신의 발달에 따라 공공 업무에도 대량의 공공데이터를 효율적으로 처리하기 위한 연구가 진행되고 있다. 하지만 이러한 연구 또한 빅데이터 처리 플랫폼 부족 및 분석 시스템이 미흡한 한계가 존재한다. 따라서 본 논문에서는 불법 주정차 데이터와 같은 공공 데이터를 효율적으로 처리하기 위해, 주정차 단속 시스템을 위한 하둡 기반 대용량 데이터 관리 및 분석 시스템을 제안한다. 제안하는 시스템은 첫째, 주차단속을 수행할 때 주차단속 데이터를 하이브(Hive)를 통해 저장하고, 단속된 차량의 차주를 검색하여 단속임을 알리거나 과태료를 부과한다. 둘째, 웹 인터페이스를 통해 수집된 주차단속 데이터에 대한 다양한 분석을 수행하고, 분석된 데이터에 대한 R을 이용한 시각화를 제공한다.

Design of Trajectory Data Indexing and Query Processing for Real-Time LBS in MapReduce Environments (MapReduce 환경에서의 실시간 LBS를 위한 이동궤적 데이터 색인 및 검색 시스템 설계)

  • Chung, Jaehwa
    • Journal of Digital Contents Society
    • /
    • v.14 no.3
    • /
    • pp.313-321
    • /
    • 2013
  • In recent, proliferation of mobile smart devices have led to big-data era, the importance of location-based services is increasing due to the exponential growth of trajectory related data. In order to process trajectory data, parallel processing platforms such as cloud computing and MapReduce are necessary. Currently, the researches based on MapReduce are on progress, but due to the MapReduce's properties in using batch processing and simple key-value structure, applying MapReduce framework for real time LBS is difficult. Therefore, in this research we propose a suitable system design on efficient indexing and search techniques for real time service based on detailed analysis on the properties of MapReduce.

Storm-Based Dynamic Tag Cloud for Real-Time SNS Data (실시간 SNS 데이터를 위한 Storm 기반 동적 태그 클라우드)

  • Son, Siwoon;Kim, Dasol;Lee, Sujeong;Gil, Myeong-Seon;Moon, Yang-Sae
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.6 no.6
    • /
    • pp.309-314
    • /
    • 2017
  • In general, there are many difficulties in collecting, storing, and analyzing SNS (social network service) data, since those data have big data characteristics, which occurs very fast with the mixture form of structured and unstructured data. In this paper, we propose a new data visualization framework that works on Apache Storm, and it can be useful for real-time and dynamic analysis of SNS data. Apache Storm is a representative big data software platform that processes and analyzes real-time streaming data in the distributed environment. Using Storm, in this paper we collect and aggregate the real-time Twitter data and dynamically visualize the aggregated results through the tag cloud. In addition to Storm-based collection and aggregation functionalities, we also design and implement a Web interface that a user gives his/her interesting keywords and confirms the visualization result of tag cloud related to the given keywords. We finally empirically show that this study makes users be able to intuitively figure out the change of the interested subject on SNS data and the visualized results be applied to many other services such as thematic trend analysis, product recommendation, and customer needs identification.