• Title/Summary/Keyword: Big data traffic

Search Result 234, Processing Time 0.031 seconds

A Study on the Compression and Major Pattern Extraction Method of Origin-Destination Data with Principal Component Analysis (주성분분석을 이용한 기종점 데이터의 압축 및 주요 패턴 도출에 관한 연구)

  • Kim, Jeongyun;Tak, Sehyun;Yoon, Jinwon;Yeo, Hwasoo
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.19 no.4
    • /
    • pp.81-99
    • /
    • 2020
  • Origin-destination data have been collected and utilized for demand analysis and service design in various fields such as public transportation and traffic operation. As the utilization of big data becomes important, there are increasing needs to store raw origin-destination data for big data analysis. However, it is not practical to store and analyze the raw data for a long period of time since the size of the data increases by the power of the number of the collection points. To overcome this storage limitation and long-period pattern analysis, this study proposes a methodology for compression and origin-destination data analysis with the compressed data. The proposed methodology is applied to public transit data of Sejong and Seoul. We first measure the reconstruction error and the data size for each truncated matrix. Then, to determine a range of principal components for removing random data, we measure the level of the regularity based on covariance coefficients of the demand data reconstructed with each range of principal components. Based on the distribution of the covariance coefficients, we found the range of principal components that covers the regular demand. The ranges are determined as 1~60 and 1~80 for Sejong and Seoul respectively.

A Study on the Improvement of Collection, Management and Sharing of Maritime Traffic Information (해상교통정보의 수집, 관리 및 공유 개선방안에 관한 연구)

  • Shin, Gil-Ho;Song, Chae-Uk
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.28 no.4
    • /
    • pp.515-524
    • /
    • 2022
  • To effectively collect, manage, and share the maritime traffic information, it is necessary to identify the technology trends concerning this particular information and analyze its current status and problems. Therefore, this study observes the domestic and foreign technology trends involving maritime traffic information while analyzing and summarizing the current status and problems in collecting, managing, and sharing it. According to the data analysis, the problems in the collecting stage are difficulties in collecting visual information from long-distance radars, CCTVs, and cameras in areas outside the LTE network coverage. Notably, this explains the challenges in detecting smuggling ships entering the territorial waters through the exclusive economic zone (EEZ) in the early stage. The problems in the management stage include difficult reductions and expansions of maritime traffic information caused by the lack of flexibility in storage spaces mostly constructed by the maritime transportation system. Additionally, it is challenging to deal with system failure with system redundancy and backup as a countermeasure. Furthermore, the problems in the sharing stage show that it is difficult to share information with external operating organizations since the internal network is mainly used to share maritime transportation information. If at all through the government cloud via platforms such as LRIT and SASS, it often fails to effectively provide various S/W applications that help use maritime big data. Therefore, it is suggested that collecting equipment such as unmanned aerial vehicles and satellites should be constructed to expand collecting areas in the collecting stage. In the management and sharing stages, the introduction and construction of private clouds are suggested, considering the operational administration and information disclosure of each maritime transportation system. Through these efforts, an enhancement of the expertise and security of clouds is expected.

A Study on the GIS Analysis Techniques for Finding an Catchment Area by Public Transport at Railway Stations Using Transport Cards Big Data (교통카드 빅 데이터를 활용한 철도역의 대중교통 연계영향권 설정을 위한 GIS 분석 기법 연구)

  • Jin, Sang Kyu;Kim, Hawng Bae
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.36 no.6
    • /
    • pp.1093-1099
    • /
    • 2016
  • Currently, there are 499 metropolitan subway stations in Korea, but there are not many studies on the influence zone of linkage between railway station and public transport. Existing studies have been studied almost in terms of accessibility.. In addition, the existing research on the influence zone of linkage using survey data and statistics, there is a limit to the theoretical basis and analysis techniques. In this paper, we propose a new method to select on the influence zone of linkage, It is a GIS analysis technique using the spatial data of the railway station user as the large data of the traffic card. We applied the GIS analysis technique for select the influence zone of linkage based on the travel time of the network for each public transportation system. As a result, it was confirmed that the influence of the link of 15 minutes on the local bus, 20 minutes on the city bus and 25 minutes on the intercity bus were clearly distinguished according to the difference in network access time.

Study of Load Balancing Technique Based on Step-By-Step Weight Considering Server Status in SDN Environment (SDN 환경에서 서버 상태를 고려한 단계적 가중치 기반의 부하 분산 기법 연구)

  • Jae-Young Lee;Tae-Wook Kwon
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.18 no.6
    • /
    • pp.1087-1094
    • /
    • 2023
  • Due to the development of technologies, such as big data, cloud, IoT, and AI, The high data throughput is required, and the importance of network flexibility and scalability is increasing. However, existing network systems are dependent on vendors and equipment, and thus have limitations in meeting the foregoing needs. Accordingly, SDN technology that can configure a software-centered flexible network is attracting attention. In particular, a load balancing method based on SDN can efficiently process massive traffic and optimize network performance. In the existing load balancing studies in SDN environment have limitation in that unnecessary traffic occurs between servers and controllers or performing load balancing only after the server reaches an overload state. In order to solve this problem, this paper proposes a method that minimizes unnecessary traffic and appropriate load balancing can be performed before the server becomes overloaded through a method of assigning weights to servers in stages according to server load.

RDP: A storage-tier-aware Robust Data Placement strategy for Hadoop in a Cloud-based Heterogeneous Environment

  • Muhammad Faseeh Qureshi, Nawab;Shin, Dong Ryeol
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.10 no.9
    • /
    • pp.4063-4086
    • /
    • 2016
  • Cloud computing is a robust technology, which facilitate to resolve many parallel distributed computing issues in the modern Big Data environment. Hadoop is an ecosystem, which process large data-sets in distributed computing environment. The HDFS is a filesystem of Hadoop, which process data blocks to the cluster nodes. The data block placement has become a bottleneck to overall performance in a Hadoop cluster. The current placement policy assumes that, all Datanodes have equal computing capacity to process data blocks. This computing capacity includes availability of same storage media and same processing performances of a node. As a result, Hadoop cluster performance gets effected with unbalanced workloads, inefficient storage-tier, network traffic congestion and HDFS integrity issues. This paper proposes a storage-tier-aware Robust Data Placement (RDP) scheme, which systematically resolves unbalanced workloads, reduces network congestion to an optimal state, utilizes storage-tier in a useful manner and minimizes the HDFS integrity issues. The experimental results show that the proposed approach reduced unbalanced workload issue to 72%. Moreover, the presented approach resolve storage-tier compatibility problem to 81% by predicting storage for block jobs and improved overall data block placement by 78% through pre-calculated computing capacity allocations and execution of map files over respective Namenode and Datanodes.

Analysis of User Demand Characteristics of Currently-established Night Bus in Seoul by Using Smart Card Data : Case Study on Gangnam Station (스마트카드 데이터를 이용한 심야버스 이용수요 특성분석 : 강남역을 중심으로)

  • Kim, Min ju;Lee, Young ihn
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.16 no.1
    • /
    • pp.101-116
    • /
    • 2017
  • This Study estimates the actual night traffic using the smart card data used by most of the public transportation users, and compares it with the current night bus routes by KT Telecom based on the night time call volume. In order to compare the current night bus and night trips evaluated by smart card data, we presented indicators related to the degree of matching, and estimated the volume of service currently provided. The unique approach of the study is that we chose subway station instead of bus stop for the unit of the study. Bus stops has their complexity in a way that stops with same name could belong to different administrative area depending on its direction. For this reason, we decided to use subway station and defined its adjacent administrative district as the scope of influence. Since night bus is the primary means of transportation during the late night, it is anticipated that they will be able to provide better service by calculating the actual traffic and selecting the routes.

Changes of Time-Distance Accessibility by Year and Day in the Integrated Seoul Metropolitan Public Transportation Network (서울 대도시권 통합 대중 교통망에서 연도별 및 요일별 시간거리 접근도 변화)

  • Park, Jong Soo;Lee, Keumsook
    • Journal of the Economic Geographical Society of Korea
    • /
    • v.21 no.4
    • /
    • pp.335-349
    • /
    • 2018
  • This study analyzes the effect of the changes in traffic environments such as transportation speeds on the time-distance accessibility for the public transportation passengers. To do this, we use passenger transaction databases of the Seoul metropolitan public transportation system: one week for each of the three years (2011, 2013, and 2015). These big data contain the information about time and space on the traffic trajectories of every passenger. In this study, the time-distances of links between subway stations and bus stops of the public transportation system at each time are calculated based on the actual travel time extracted from the traffic-card transaction database. The changes in the time-distance accessibility of the integrated transportation network from the experimental results can be summarized in two aspects. First, the accessibility tends to decline as the year goes by. This is because the transportation network becomes more complicated and then the average moving speed of the vehicles is lowered. Second, the accessibility tends to increase on the weekend in the analysis of accessibility changes by day. This tendency is because the bus speeds on bus routes on the weekend are faster than other days. In order to analyze the accessibility changes, we illustrate graphs of the vehicle speeds and the numbers of passengers by year and day.

Analysis of Effects on Adoption of a Safety e-Reporting System (안전신고 제도(안전신문고) 도입에 따른 효과 분석)

  • Lee, Jun;Cho, Sangmyeong;Park, Eunmi;Lee, Sanghwa
    • Journal of Korean Society of Disaster and Security
    • /
    • v.12 no.4
    • /
    • pp.27-41
    • /
    • 2019
  • To analyze the effectiveness of the safety e-reporting system, the present study carried out analysis of safety e-reporting data reported between September 2014 and July 2019, and selected items for measuring the effectiveness of safety e-reporting. Using these items, the effects of adopting the reporting system for the four major parking violations was analyzed, alongside an analysis of effects in terms of traffic accidents using the unit model. When we count the securement of the tax revenue through measures such as charging fines as the beneficial factor per case, the estimation of the benefit is around 62,000 KRW per case. Summing the two factors up, the total value of citizen's reports pertaining to the big four parking violations is about 275,000 KRW per case. Most of the reports made through the Safety e-Report system are about traffic and facilities. When we calculate the total annual benefit with the representative reporting value defined with traffic and facilities, the system received a total of 1,164,439 cases from 2014 to 2019, while citizens reported 52,721 cases for the big four parking violations from April to July 2019. As the value of a safety report is around the net benefit for last five years is around 27,340,000,000 KRW.

Detecting Vehicles That Are Illegally Driving on Road Shoulders Using Faster R-CNN (Faster R-CNN을 이용한 갓길 차로 위반 차량 검출)

  • Go, MyungJin;Park, Minju;Yeo, Jiho
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.21 no.1
    • /
    • pp.105-122
    • /
    • 2022
  • According to the statistics about the fatal crashes that have occurred on the expressways for the last 5 years, those who died on the shoulders of the road has been as 3 times high as the others who died on the expressways. It suggests that the crashes on the shoulders of the road should be fatal, and that it would be important to prevent the traffic crashes by cracking down on the vehicles intruding the shoulders of the road. Therefore, this study proposed a method to detect a vehicle that violates the shoulder lane by using the Faster R-CNN. The vehicle was detected based on the Faster R-CNN, and an additional reading module was configured to determine whether there was a shoulder violation. For experiments and evaluations, GTAV, a simulation game that can reproduce situations similar to the real world, was used. 1,800 images of training data and 800 evaluation data were processed and generated, and the performance according to the change of the threshold value was measured in ZFNet and VGG16. As a result, the detection rate of ZFNet was 99.2% based on Threshold 0.8 and VGG16 93.9% based on Threshold 0.7, and the average detection speed for each model was 0.0468 seconds for ZFNet and 0.16 seconds for VGG16, so the detection rate of ZFNet was about 7% higher. The speed was also confirmed to be about 3.4 times faster. These results show that even in a relatively uncomplicated network, it is possible to detect a vehicle that violates the shoulder lane at a high speed without pre-processing the input image. It suggests that this algorithm can be used to detect violations of designated lanes if sufficient training datasets based on actual video data are obtained.

Arrival Time Estimation for Bus Information System Using Hidden Markov Model (은닉 마르코프 모델을 이용한 버스 정보 시스템의 도착 시간 예측)

  • Park, Chul Young;Kim, Hong Geun;Shin, Chang Sun;Cho, Yong Yun;Park, Jang Woo
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.6 no.4
    • /
    • pp.189-196
    • /
    • 2017
  • BIS(Bus Information System) provides the different information related to buses including predictions of arriving times at stations. BIS have been deployed almost all cities in our country and played active roles to improve the convenience of public transportation systems. Moving average filters, Kalman filter and regression models have been representative in forecasting the arriving times of buses in current BIS. The accuracy in prediction of arriving times depends largely on the forecasting algorithms and traffic conditions considered when forecasting in BIS. In present BIS, the simple prediction algorithms are used only considering the passage times and distances between stations. The forecasting of arrivals, however, have been influenced by the traffic conditions such as traffic signals, traffic accidents and pedestrians ets., and missing data. To improve the accuracy of bus arriving estimates, there are big troubles in building models including the above problems. Hidden Markov Models have been effective algorithms considering various restrictions above. So, we have built the HMM forecasting models for bus arriving times in the current BIS. When building models, the data collected from Sunchean City at 2015 have been utilized. There are about 2298 stations and 217 routes in Suncheon city. The models are developed differently week days and weekend. And then the models are conformed with the data from different districts and times. We find that our HMM models can provide more accurate forecasting than other existing methods like moving average filters, Kalmam filters, or regression models. In this paper, we propose Hidden Markov Model to obtain more precise and accurate model better than Moving Average Filter, Kalman Filter and regression model. With the help of Hidden Markov Model, two different sections were used to find the pattern and verified using Bootstrap process.