• Title/Summary/Keyword: The Data

Search Result 218,181, Processing Time 0.129 seconds

The Effects of Data Assimilation on Simulated Wind Fields Using Upper-Air Observations (고층기상관측자료를 이용한 바람장 개선 효과 연구)

  • Jeong, Ju-Hee;Kwun, Ji-Hye;Kim, Yoo-Keun
    • Journal of Environmental Science International
    • /
    • v.16 no.10
    • /
    • pp.1127-1137
    • /
    • 2007
  • We focused on effects on data assimilation of simulated wind fields by using upper-air observations (wind profiler and sonde data). Local Analysis Prediction System (LAPS), a type of data assimilation system, was used for wind field modeling. Five cases of simulation experiments for sensitivity analysis were performed: which are EXP0) non data assimilation, EXP1) surface data, EXP2) surface data and sonde data, EXP3) surface data and wind profiler data, EXP4) surface data, sonde data and wind profiler data. These were compared with observation data. The result showed that the effects of data assimilation with wind profiler data were found to be greater than sonde data. The delicate wind fields in complex coastal area were simulated well in EXP3. EXP3 and EXP4 using wind profiler data with vertically high resolution represented well sophisticated differences of wind speed compared with EXP1 and EXP2, this is because the effects of wind profiler data assimilation were sensitively adjusted to first guess field than those of sonde observations.

A Study on a Statistical Matching Method Using Clustering for Data Enrichment

  • Kim Soon Y.;Lee Ki H.;Chung Sung S.
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.2
    • /
    • pp.509-520
    • /
    • 2005
  • Data fusion is defined as the process of combining data and information from different sources for the effectiveness of the usage of useful information contents. In this paper, we propose a data fusion algorithm using k-means clustering method for data enrichment to improve data quality in knowledge discovery in database(KDD) process. An empirical study was conducted to compare the proposed data fusion technique with the existing techniques and shows that the newly proposed clustering data fusion technique has low MSE in continuous fusion variables.

A Comparative Study of Big Data, Open Data, and My Data (빅데이터, 오픈데이터, 마이데이터의 비교 연구)

  • Park, Jooseok
    • The Journal of Bigdata
    • /
    • v.3 no.1
    • /
    • pp.41-46
    • /
    • 2018
  • With the advent of the fourth industrial revolution, data becomes very important resource. Now is called as 'Data Revolution Age.' It is said that Data Revolution Age started with Big Data, then accelerated with Open Data, finally completed with My Data. In this paper, we compared Big Data, Open Data, and suggested roles and effects of My Data as a digital resource.

Searchable Encrypted String for Query Support on Different Encrypted Data Types

  • Azizi, Shahrzad;Mohammadpur, Davud
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.10
    • /
    • pp.4198-4213
    • /
    • 2020
  • Data encryption, particularly application-level data encryption, is a common solution to protect data confidentiality and deal with security threats. Application-level encryption is a process in which data is encrypted before being sent to the database. However, cryptography transforms data and makes the query difficult to execute. Various studies have been carried out to find ways in order to implement a searchable encrypted database. In the current paper, we provide a new encrypting method and querying on encrypted data (ZSDB) for different data types. It is worth mentioning that the proposed method is based on secret sharing. ZSDB provides data confidentiality by dividing sensitive data into two parts and using the additional server as Dictionary Server. In addition, it supports required operations on various types of data, especially LIKE operator functioning on string data type. ZSDB dedicates the largest volume of execution tasks on queries to the server. Therefore, the data owner only needs to encrypt and decrypt data.

Big Data Key Challenges

  • Alotaibi, Sultan
    • International Journal of Computer Science & Network Security
    • /
    • v.22 no.4
    • /
    • pp.340-350
    • /
    • 2022
  • The big data term refers to the great volume of data and complicated data structure with difficulties in collecting, storing, processing, and analyzing these data. Big data analytics refers to the operation of disclosing hidden patterns through big data. This information and data set cloud to be useful and provide advanced services. However, analyzing and processing this information could cause revealing and disclosing some sensitive and personal information when the information is contained in applications that are correlated to users such as location-based services, but concerns are diminished if the applications are correlated to general information such as scientific results. In this work, a survey has been done over security and privacy challenges and approaches in big data. The challenges included here are in each of the following areas: privacy, access control, encryption, and authentication in big data. Likewise, the approaches presented here are privacy-preserving approaches in big data, access control approaches in big data, encryption approaches in big data, and authentication approaches in big data.

Association Rule Mining by Environmental Data Fusion

  • Cho, Kwang-Hyun;Park, Hee-Chang
    • Journal of the Korean Data and Information Science Society
    • /
    • v.18 no.2
    • /
    • pp.279-287
    • /
    • 2007
  • Data fusion is the process of combining multiple data in order to produce information of tactical value to the user. Data fusion is generally defined as the use of techniques that combine data from multiple sources and gather that information in order to achieve inferences. Data fusion is also called data combination or data matching. Data fusion is divided in five branch types which are exact matching, judgemental matching, probability matching, statistical matching, and data linking. In this paper, we develop was macro program for statistical matching which is one of five branch types for data fusion. And then we apply data fusion and association rule techniques to environmental data.

  • PDF

A Study on Policies to Revitalize the Public Big Data in Seoul (서울시 공공빅데이터 활성화 방안 연구)

  • Choi, Bong;Yun, Jongjin;Um, Taehyee
    • Knowledge Management Research
    • /
    • v.20 no.3
    • /
    • pp.73-89
    • /
    • 2019
  • The purpose of this study is to investigate the current state of public Big Data in Seoul and suggest policy directions for the revitalization of Seoul's public Big Data. Big Data is perceived as innovation resources under the era of 4th Industrial revolution and Data economy. Especially, public Big Data serves a significant role in terms of universal access for citizens, startup, and enterprise compared with the private sector. Seoul reorganized a substructure of government's focus on Big Data and established organizations such as Big Data Campus and Urban Data Science Lab. Although the number of public open Data has increased in Seoul, there exists not much Data with characteristics similar to Big Data, such as volume, velocity, and value. In order to present the direction of Big Data policy in Seoul, we investigate the current status of Big Data Campus and Urban Data Science Lab operated by Seoul City. Considering the results of this study, we have proposed several directions that Seoul can use in establishing big data related strategies.

A Big Data-Driven Business Data Analysis System: Applications of Artificial Intelligence Techniques in Problem Solving

  • Donggeun Kim;Sangjin Kim;Juyong Ko;Jai Woo Lee
    • The Journal of Bigdata
    • /
    • v.8 no.1
    • /
    • pp.35-47
    • /
    • 2023
  • It is crucial to develop effective and efficient big data analytics methods for problem-solving in the field of business in order to improve the performance of data analytics and reduce costs and risks in the analysis of customer data. In this study, a big data-driven data analysis system using artificial intelligence techniques is designed to increase the accuracy of big data analytics along with the rapid growth of the field of data science. We present a key direction for big data analysis systems through missing value imputation, outlier detection, feature extraction, utilization of explainable artificial intelligence techniques, and exploratory data analysis. Our objective is not only to develop big data analysis techniques with complex structures of business data but also to bridge the gap between the theoretical ideas in artificial intelligence methods and the analysis of real-world data in the field of business.

A Research on Job Model Development for Data Convergent Talent (데이터 융합인재 직무모형 개발 연구)

  • Um, Hye Mi;Yu, Yun Hyeong
    • The Journal of Information Systems
    • /
    • v.33 no.1
    • /
    • pp.207-226
    • /
    • 2024
  • Purpose This study aims to develop a job model for data convergent talents to meet the rapidly changing demands of the data industry. To create a job model, we first define and categorize data convergent talents with balanced competencies in data technology and domain knowledge, and then develop a job model by investigating job areas, scope, activities, and competencies. Design/methodology/approach The research is conducted using the following procedures and methodology. First, we conduct a current status survey on data talent demand, data talent policies, data talent programs, and curricula at home and abroad; second, we collect opinions on the jobs and competencies required for data convergent talents and curricula for talent development through in-depth interview with experts; and third, we present the job areas and job activities of data convergent talents derived from the previous status survey and expert opinions based on the National Competency Standards(NCS). Findings The research findings indicate that there are total of six job roles for data convergent talents, including data scientist, data planner, data architect, data developer, data engineer, and data analyst. It was observed that each of these roles requires the development of common competencies within their respective fields, followed by a need for further specialization into specific competencies within each professional domain.

Reinforcing Financial Data Exchange Security Policy with Information Security Issues of Data Broker (금융데이터거래 정보보호 강화방안: 데이터브로커 보안이슈를 중심으로)

  • Kim, Su-bong;Kwon, Hun-yeong
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.32 no.1
    • /
    • pp.141-154
    • /
    • 2022
  • In the data economy era, various policies are being implemented to create an active data distribution environment. In South Korea, the formation of a big data distribution platform and data trading began with the launch of the Financial Data Exchange under public data governance. In the case of major advanced countries in the data field, they have built a data distribution environment based on the data broker industry for decades and have strengthened national data competitiveness through added values generated from the industry. However, behind the active data distribution through data brokers, there are numerous information security issues, which have resulted in various privacy issues and national security threats. These problems can occur sufficiently in the process of domestic financial data exchange. In our study, we analyzed various information security issues of data trading caused by data brokers and derived information security requirements to be considered when trading data. We verified whether information security requirements are well reflected in the information security policy for each transaction stage of the domestic financial data exchange. Based on the verification, measurements to strengthen information security for financial data exchange are presented in our paper.