• 제목/요약/키워드: Engineering Big Data

검색결과 1,839건 처리시간 0.03초

Advanced Technologies in Blockchain, Machine Learning, and Big Data

  • Park, Ji Su;Park, Jong Hyuk
    • Journal of Information Processing Systems
    • /
    • 제16권2호
    • /
    • pp.239-245
    • /
    • 2020
  • Blockchain, machine learning, and big data are among the key components of the future IT track. These technologies are used in various fields; hence their increasing application. This paper discusses the technologies developed in various research fields, such as data representation, Blockchain application, 3D shape recognition and classification, query method, classification method, and search algorithm, to provide insights into the future paradigm. In this paper, we present a summary of 18 high-quality accepted articles following a rigorous review process in the fields of Blockchain, machine learning, and big data.

Artificial Intelligence for the Fourth Industrial Revolution

  • Jeong, Young-Sik;Park, Jong Hyuk
    • Journal of Information Processing Systems
    • /
    • 제14권6호
    • /
    • pp.1301-1306
    • /
    • 2018
  • Artificial intelligence is one of the key technologies of the Fourth Industrial Revolution. This paper introduces the diverse kinds of approaches to subjects that tackle diverse kinds of research fields such as model-based MS approach, deep neural network model, image edge detection approach, cross-layer optimization model, LSSVM approach, screen design approach, CPU-GPU hybrid approach and so on. The research on Superintelligence and superconnection for IoT and big data is also described such as 'superintelligence-based systems and infrastructures', 'superconnection-based IoT and big data systems', 'analysis of IoT-based data and big data', 'infrastructure design for IoT and big data', 'artificial intelligence applications', and 'superconnection-based IoT devices'.

Evaluation of the Relationship between Meteorological, Agricultural and In-situ Big Data Droughts (기상학적 가뭄, 농업 가뭄 및 빅데이터 현장가뭄간의 상관성 평가)

  • LEE, Ji-Wan;JANG, Sun-Sook;AHN, So-Ra;PARK, Ki-Wook;KIM, Seong-Joon
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • 제19권1호
    • /
    • pp.64-79
    • /
    • 2016
  • The purpose of this study is to find the relationship between precipitation deficit, SPI(standardized precipitation index)-12 month, agricultural reservoir water storage deficit and agricultural drought-related big data, and to evaluate the usefulness of agricultural risk management through big data. For the long term drought (from January 2014 to September 2015), each data was collected and analysed with monthly and Provincial base. The minimum SPI-12 and maximum reservoir water storage deficit compared to normal year were occurred at the same time of July 2014, and August and September 2015. The maximum frequency of big data was occurred at June and July of 2014, and March and June to September of 2015. The maximum big data was occurred 1 month advanced in 2014 and 2 months advanced in 2015 than the maximum reservoir water storage deficit. The occurrence of big data was sensitive to spring drought from March, late Jangma of June, dry Jangma of July and the rainfall deficit of September 2015. The big data was closely related with the meteorological drought and agricultural drought. Because the big data is the in situ feeling drought, it is proved as a useful indicator for agricultural risk management.

Effectiveness of Normalization Pre-Processing of Big Data to the Machine Learning Performance (빅데이터의 정규화 전처리과정이 기계학습의 성능에 미치는 영향)

  • Jo, Jun-Mo
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • 제14권3호
    • /
    • pp.547-552
    • /
    • 2019
  • Recently, the massive growth in the scale of data has been observed as a major issue in the Big Data. Furthermore, the Big Data should be preprocessed for normalization to get a high performance of the Machine learning since the Big Data is also an input of Machine Learning. The performance varies by many factors such as the scope of the columns in a Big Data or the methods of normalization preprocessing. In this paper, the various types of normalization preprocessing methods and the scopes of the Big Data columns will be applied to the SVM(: Support Vector Machine) as a Machine Learning method to get the efficient environment for the normalization preprocessing. The Machine Learning experiment has been programmed in Python and the Jupyter Notebook.

Analysis on Major Factors for Analysis & Application of Big Data in Electrical Commercial System (전자상거래 시스템에서 빅 데이터의 분석 및 결과 활용에 미치는 영향요소 분석)

  • Yang, Hoo-Youl;Na, Cheol-Hun
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 한국정보통신학회 2016년도 춘계학술대회
    • /
    • pp.373-375
    • /
    • 2016
  • Analyze the Big Data become a hot issue because of Smart environment, the amount of data in the world has been exploding. Result of application makes a good use of Analysis and applicate of the big data, is play an important part in application area (finance, circulation, manufacturing, disaster etc.) This paper presents an influence element for data analysis and its practical use based in result of maturity in Business process of Big Data in Electrical Commercial system.

  • PDF

Automatic Generation of Issue Analysis Report Based on Social Big Data Mining (소셜 빅데이터 마이닝 기반 이슈 분석보고서 자동 생성)

  • Heo, Jeong;Lee, Chung Hee;Oh, Hyo Jung;Yoon, Yeo Chan;Kim, Hyun Ki;Jo, Yo Han;Ock, Cheol Young
    • KIPS Transactions on Software and Data Engineering
    • /
    • 제3권12호
    • /
    • pp.553-564
    • /
    • 2014
  • In this paper, we propose the system for automatic generation of issue analysis report based on social big data mining, with the purpose of resolving three problems of the previous technologies in a social media analysis and analytic report generation. Three problems are the isolation of analysis, the subjectivity of experts and the closure of information attributable to a high price. The system is comprised of the natural language query analysis, the issue analysis, the social big data analysis, the social big data correlation analysis and the automatic report generation. For the evaluation of report usefulness, we used a Likert scale and made two experts of big data analysis evaluate. The result shows that the quality of report is comparatively useful and reliable. Because of a low price of the report generation, the correlation analysis of social big data and the objectivity of social big data analysis, the proposed system will lead us to the popularization of social big data analysis.

Changes in Measuring Methods of Walking Behavior and the Potentials of Mobile Big Data in Recent Walkability Researches (보행행태조사방법론의 변화와 모바일 빅데이터의 가능성 진단 연구 - 보행환경 분석연구 최근 사례를 중심으로 -)

  • Kim, Hyunju;Park, So-Hyun;Lee, Sunjae
    • Journal of the Architectural Institute of Korea Planning & Design
    • /
    • 제35권1호
    • /
    • pp.19-28
    • /
    • 2019
  • The purpose of this study is to evaluate the walking behavior analysis methodology used in the previous studies, paying attention to the demand for empirical data collecting for urban and neighborhood planning. The preceding researches are divided into (1)Recording, (2) Surveys, (3)Statistical data, (4)Global positioning system (GPS) devices, and (5)Mobile Big Data analysis. Next, we analyze the precedent research and identify the changes of the walkability research. (1)being required empirical data on the actual walking and moving patterns of people, (2)beginning to be measured micro-walking behaviors such as actual route, walking facilities, detour, walking area. In addition, according to the trend of research, it is analyzed that the use of GPS device and the mobile big data are newly emerged. Finally, we analyze pedestrian data based on mobile big data in terms of 'application' and distinguishing it from existing survey methodology. We present the possibility of mobile big data. (1)Improvement of human, temporal and spatial constraints of data collection, (2)Improvement of inaccuracy of collected data, (3)Improvement of subjective intervention in data collection and preprocessing, (4)Expandability of walking environment research.

Use of big data analysis to investigate the relationship between natural radiation dose rates and cancer incidences in Republic of Korea

  • Joo, Han Young;Kim, Jae Wook;Moon, Joo Hyun
    • Nuclear Engineering and Technology
    • /
    • 제52권8호
    • /
    • pp.1798-1806
    • /
    • 2020
  • In this study, we investigated whether there is a significant relationship between the natural radiation dose rate and the cancer incidences in Korea by using a big data analysis. The natural dose rate data for this analysis were the measurement data obtained from the 171 monitoring posts of the 113 administrative districts in Korea over the 10 years from 2007 to 2016. The relative cancer incidences for this analysis were the difference in the cancer patients per hundred thousand people year-on-year in the administrative districts with the five highest and the five lowest natural gamma dose rates each year over the same period. To analyze the correlation between the two variables, Spearman's rank correlation coefficient between the two rates was derived using R, a well-known big data analysis tool. The analysis showed that Spearman's rank correlation coefficient was more than 0.05 and that the correlation between the two variables was not statistically significant.

Detection of Abnormal Ship Operation using a Big Data Platform based on Hadoop and Spark (하둡 및 스파크 기반 빅데이터 플랫폼을 이용한 선박 운항 효율 이상 상태 분석)

  • Lee, Taehyeon;Yu, Eun-seop;Park, Kaemyoung;Yu, Seongsang;Park, Jinpyo;Mun, Duhwan
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • 제18권6호
    • /
    • pp.82-90
    • /
    • 2019
  • To reduce emissions of marine pollutants, regulations are being tightened around the world. In the shipbuilding and shipping industries, various countermeasures are being put forward. As there are limits to applying countermeasures to ships already in operation, however, it is necessary for these vessels to use energy efficiently. The sensors installed on ships typically gather a very large amount of data, and thus a big data platform is needed to manage and analyze the data. In this paper, we build a big data analysis platform based on Hadoop and Spark, and we present a method to detect abnormal ship operation using the platform. We also utilize real ship operation data to discuss the data analysis experiment.

Learning System for Big Data Analysis based on the Raspberry Pi Board (라즈베리파이 보드 기반의 빅데이터 분석을 위한 학습 시스템)

  • Kim, Young-Geun;Jo, Min-Hui;Kim, Won-Jung
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • 제11권4호
    • /
    • pp.433-440
    • /
    • 2016
  • In order to construct a system for big data processing, one needs to configure the node by using network equipments to connect multiple computers or establish cloud environments through virtual hosts on a single computer. However, there are many restrictions on constructing the big data analysis system including complex system configuration and cost. These constraints are becoming a major obstacle to professional manpower training for big data areas which is emerging as one of the most important national competitiveness. As a result, for professional manpower training of big data areas, this paper proposes a Raspberry Pi Board based educational big data processing system which is capable of practical training at an affordable price.