• Title/Summary/Keyword: big data service

Search Result 1,023, Processing Time 0.026 seconds

Design and Implementation of an Efficient Web Services Data Processing Using Hadoop-Based Big Data Processing Technique (하둡 기반 빅 데이터 기법을 이용한 웹 서비스 데이터 처리 설계 및 구현)

  • Kim, Hyun-Joo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.16 no.1
    • /
    • pp.726-734
    • /
    • 2015
  • Relational databases used by structuralizing data are the most widely used in data management at present. However, in relational databases, service becomes slower as the amount of data increases because of constraints in the reading and writing operations to save or query data. Furthermore, when a new task is added, the database grows and, consequently, requires additional infrastructure, such as parallel configuration of hardware, CPU, memory, and network, to support smooth operation. In this paper, in order to improve the web information services that are slowing down due to increase of data in the relational databases, we implemented a model to extract a large amount of data quickly and safely for users by processing Hadoop Distributed File System (HDFS) files after sending data to HDFSs and unifying and reconstructing the data. We implemented our model in a Web-based civil affairs system that stores image files, which is irregular data processing. Our proposed system's data processing was found to be 0.4 sec faster than that of a relational database system. Thus, we found that it is possible to support Web information services with a Hadoop-based big data processing technique in order to process a large amount of data, as in conventional relational databases. Furthermore, since Hadoop is open source, our model has the advantage of reducing software costs. The proposed system is expected to be used as a model for Web services that provide fast information processing for organizations that require efficient processing of big data because of the increase in the size of conventional relational databases.

Analysis of domestic and foreign future automobile research trends based on topic modeling (토픽모델링 기반의 국내외 미래 자동차 연구동향 비교 분석: CASE 키워드 중심으로)

  • Jeong, Ho Jeong;Kim, Keun-Wook;Kim, Na-Gyeong;Chang, Won-Jun;Jeong, Won-Oong;Park, Dae-Yeong
    • Journal of Digital Convergence
    • /
    • v.20 no.5
    • /
    • pp.463-476
    • /
    • 2022
  • After industrialization in the past, the automobile industry has continued to grow centered on internal combustion engines, but is facing a major change with the recent 4th industrial revolution. Most companies are preparing for the transition to electric vehicles and autonomous driving. Therefore, in this study, topic modeling was performed based on LDA algorithm by collecting 4,002 domestic papers and 68,372 overseas papers that contain keywords related to CASE (Connectivity, Autonomous, Sharing, Electrification), which represent future automobile trends. As a result of the analysis, it was found that domestic research mainly focuses on macroscopic aspects such as traffic infrastructure, urban traffic efficiency, and traffic policy. Through this, the government's technical support for MaaS (Mobility-as-a-Service) is required in the domestic shared car sector, and the need for data opening by means of transportation was presented. It is judged that these analysis results can be used as basic data for the future automobile industry.

A Case Study on the Distribution of Cultural Contents in the Untact Era Using Big Data (빅데이터를 활용한 언택트 시대의 1인 콘텐츠 유통 사례 분석)

  • Wang, Deok-won;Kim, Jeong-hyeon;Son, Hye-ji;Jeon, Min-jun;Choi, Hun
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.05a
    • /
    • pp.301-302
    • /
    • 2021
  • After the Korona 19, "social distancing" was implemented, existing "pop culture" or entertainment programs were unable to communicate in both directions and declined. Since then, "Untact content" has shown its potential to grow due to untouch performances such as BTS' "Bangbangcon" and the rapid growth of Netflix, a global OTT (online video service). In addition, most of the global and Untact content is online and digital, which means a huge amount of big data will be poured out. Therefore, analyzing the big data poured out during the distribution of untact content will help us identify consumers' needs, and the growth expectations will also be high. Therefore, we would like to explore the research cases that have been conducted in existing studies regarding the subject of the study and analyze how big data can affect the distribution of content in the Untact era.

  • PDF

A Study on the Perception of Quality of Care Services by Care Workers using Big Data (빅데이터를 활용한 요양보호사의 서비스질 인식에 관한 연구)

  • Han-A Cho
    • Journal of Korean Dental Hygiene Science
    • /
    • v.6 no.1
    • /
    • pp.13-25
    • /
    • 2023
  • Background: This study was conducted to confirm the service quality management of care workers, who are direct service personnel of long-term care insurance for the elderly, using unstructured big data. Methods: Using a textome, this study collected and analyzed unstructured social data related to care workers' service quality. Frequency, TF-IDF, centrality, semantic network, and CONCOR analyses were conducted on the top 50 keywords collected by crawling the data. Results: As a result of frequency analysis, the top-ranked keywords were 'Long-term care services,' 'Care workers,' 'Quality of care services,' 'Long term care,' 'Long term care facilities,' 'Enhancement,' 'Elderly,' 'Treatment,' 'Improvement,' and 'Necessity.' The results of degree centrality and eigenvector centrality were almost the same as those of the frequency analysis. As a result of the CONCOR analysis, it was found that the improvement in the quality of long-term care services, the operation of the long-term care services, the long-term care services system, and the perception of the psychological aspects of the care workers were of high concern. Conclusion: This study contributes to setting various directions for improving the service quality of care workers by presenting perceptions related to the service quality of care workers as a meaningful group.

Design of Intelligent Big data Convergence Service to Support Non-store Founders based on Non-face-to-face (무점포 창업자 지원을 위한 비대면 기반의 지능형 빅데이터 융합 서비스 설계)

  • Hyun-Mo Koo;Ji-Yun Hong;Cheol-Soo Kang
    • Journal of Advanced Technology Convergence
    • /
    • v.2 no.2
    • /
    • pp.1-8
    • /
    • 2023
  • Due to the recent long-term economic downturn, the number of non-store and mail-order sellers is increasing as prospective entrepreneurs are concentrated due to the phenomenon of non-store start-ups with low start-up costs. In particular, in addition to unemployed young people and housewives who lack funds, many office workers who wish to have a 'two-job' are jumping into the business. Therefore, in this paper, we have moved away from provider-oriented service platforms that are dependent on specific networks, operators, and service types. In addition, we plan to design a business integration support system that can provide B2B services in the promotional material industry that contributes to business support and profit generation of wholesale and retail non-store entrepreneurs through sharing and participation. The proposed system is judged to be a business integrated operation support system applying orchestration and service management technology and enterprise business partner management technology that can provide stable operation management service.

Association Between Persistent Treatment of Alzheimer's Dementia and Osteoporosis Using a Common Data Model

  • Seonhwa Hwang;Yong Gwon Soung;Seong Uk Kang;Donghan Yu;Haeran Baek;Jae-Won Jang
    • Dementia and Neurocognitive Disorders
    • /
    • v.22 no.4
    • /
    • pp.121-129
    • /
    • 2023
  • Background and Purpose: As it becomes an aging society, interest in senile diseases is increasing. Alzheimer's dementia (AD) and osteoporosis are representative senile diseases. Various studies have reported that AD and osteoporosis share many risk factors that affect each other's incidence. This aimed to determine if active medication treatment of AD could affect the development of osteoporosis. Methods: The Health Insurance Review and Assessment Service provided data consisting of diagnosis, demographics, prescription drug, procedures, medical materials, and healthcare resources. In this study, data of all AD patients in South Korea who were registered under the national health insurance system were obtained. The cohort underwent conversion to an Observational Medical Outcomes Partnership-Common Data Model version 5 format. Results: This study included 11,355 individuals in the good persistent group and an equal number of 11,355 individuals in the poor persistent group from the National Health Claims database for AD drug treatment. In primary analysis, the risk of osteoporosis was significantly higher in the poor persistence group than in the good persistence group (hazard ratio, 1.20 [95% confidence interval, 1.09-1.32]; p<0.001). Conclusions: We found that the good persistence group treated with anti-dementia drugs for AD was associated with a significant lower risk of osteoporosis in this nationwide study. Further studies are needed to clarify the pathophysiological link in patients with two chronic diseases.

Analysis of Privacy Violation Possibility of Partially Anonymized Big Data (온라인 상에 공개된 부분 익명화된 빅데이터의 프라이버시 침해 가능성 분석)

  • Jung, Kang-soo;Park, Seog;Choi, Dae-seon
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.28 no.3
    • /
    • pp.665-679
    • /
    • 2018
  • With the development of information and communication technology, especially wireless Internet technology and the spread of smart phones, digital data has increased. As a result, privacy issues which concerns about exposure of personal sensitive information are increasing. In this paper, we analyze the privacy vulnerability of online big data in domestic internet environment, especially focusing on portal service, and propose a measure to evaluate the possibility of privacy violation. For this purpose, we collected about 50 million user posts from the potal service contents and extracted the personal information. we find that potal service user can be identified by the extracted personal information even though the user id is partially anonymized. In addition, we proposed a risk measurement evaluation method that reflects the possibility of personal information linkage between service using partial anonymized ID and personal information exposure level.

Global Manager - A Service Broker In An Integrated Cloud Computing, Edge Computing & IoT Environment

  • Selvaraj, Kailash;Mukherjee, Saswati
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.16 no.6
    • /
    • pp.1913-1934
    • /
    • 2022
  • The emergence of technologies like Big data analytics, Industrial Internet of Things, Internet of Things, and applicability of these technologies in various domains leads to increased demand in the underlying execution environment. The demand may be for compute, storage, and network resources. These demands cannot be effectively catered by the conventional cloud environment, which requires an integrated environment. The task of finding an appropriate service provider is tedious for a service consumer as the number of service providers drastically increases and the services provided are heterogeneous in the specification. A service broker is essential to find the service provider for varying service consumer requests. Also, the service broker should be smart enough to make the service providers best fit for consumer requests, ensuring that both service consumer and provider are mutually beneficial. A service broker in an integrated environment named Global Manager is proposed in the paper, which can find an appropriate service provider for every varying service consumer request. The proposed Global Manager is capable of identification of parameters for service negotiation with the service providers thereby making the providers the best fit to the maximum possible extent for every consumer request. The paper describes the architecture of the proposed Global Manager, workflow through the proposed algorithms followed by the pilot implementation with sample datasets retrieved from literature and synthetic data. The experimental results are presented with a few of the future work to be carried out to make the Manager more sustainable and serviceable.

Study on the Sensor Gateway for Receive the Real-Time Big Data in the IoT Environment (IoT 환경에서 실시간 빅 데이터 수신을 위한 센서 게이트웨이에 관한 연구)

  • Shin, Seung-Hyeok
    • Journal of Advanced Navigation Technology
    • /
    • v.19 no.5
    • /
    • pp.417-422
    • /
    • 2015
  • A service size of the IoT environment is determined by the number of sensors. The number of sensors increase means increases the amount of data generated by the IoT environment. There are studies to reliably operate a network for research and operational dynamic buffer for data when network congestion control congestion in the network environment. There are also studies of the stream data that has been processed in the connectionless network environment. In this study, we propose a sensor gateway for processing big data of the IoT environment. For this, review the RESTful for designing a sensor middleware, and apply the double-buffer algorithm to process the stream data efficiently. Finally, it generates a big data traffic using the MJpeg stream that is based on the HTTP protocol over TCP to evaluate the proposed system, with open source media player VLC using the image received and compare the throughput performance.

User Information Needs Analysis based on Query Log Big Data of the National Archives of Korea (국가기록원 질의로그 빅데이터 기반 이용자 정보요구 유형 분석)

  • Baek, Ji-yeon;Oh, Hyo-Jung
    • Journal of the Korean Society for information Management
    • /
    • v.36 no.4
    • /
    • pp.183-205
    • /
    • 2019
  • Among the various methods for identifying users's information needs, Log analysis methods can realistically reflect the users' actual search behavior and analyze the overall usage of most users. Based on the large quantity of query log big data obtained through the portal service of the National Archives of Korea, this study conducted an analysis by the information type and search result type in order to identify the users' information needs. The Query log used in analysis were based on 1,571,547 query data collected over a total of 141 months from 2007 to December 2018, when the National Archives of Korea provided search services via the web. Furthermore, based on the analysis results, improvement methods were proposed to improve user search satisfaction. The results of this study could actually be used to improve and upgrade the National Archives of Korea search service.