• Title/Summary/Keyword: Stream analysis

Search Result 2,629, Processing Time 0.029 seconds

An Analysis of IT Trends Using Tweet Data (트윗 데이터를 활용한 IT 트렌드 분석)

  • Yi, Jin Baek;Lee, Choong Kwon;Cha, Kyung Jin
    • Journal of Intelligence and Information Systems
    • /
    • v.21 no.1
    • /
    • pp.143-159
    • /
    • 2015
  • Predicting IT trends has been a long and important subject for information systems research. IT trend prediction makes it possible to acknowledge emerging eras of innovation and allocate budgets to prepare against rapidly changing technological trends. Towards the end of each year, various domestic and global organizations predict and announce IT trends for the following year. For example, Gartner Predicts 10 top IT trend during the next year, and these predictions affect IT and industry leaders and organization's basic assumptions about technology and the future of IT, but the accuracy of these reports are difficult to verify. Social media data can be useful tool to verify the accuracy. As social media services have gained in popularity, it is used in a variety of ways, from posting about personal daily life to keeping up to date with news and trends. In the recent years, rates of social media activity in Korea have reached unprecedented levels. Hundreds of millions of users now participate in online social networks and communicate with colleague and friends their opinions and thoughts. In particular, Twitter is currently the major micro blog service, it has an important function named 'tweets' which is to report their current thoughts and actions, comments on news and engage in discussions. For an analysis on IT trends, we chose Tweet data because not only it produces massive unstructured textual data in real time but also it serves as an influential channel for opinion leading on technology. Previous studies found that the tweet data provides useful information and detects the trend of society effectively, these studies also identifies that Twitter can track the issue faster than the other media, newspapers. Therefore, this study investigates how frequently the predicted IT trends for the following year announced by public organizations are mentioned on social network services like Twitter. IT trend predictions for 2013, announced near the end of 2012 from two domestic organizations, the National IT Industry Promotion Agency (NIPA) and the National Information Society Agency (NIA), were used as a basis for this research. The present study analyzes the Twitter data generated from Seoul (Korea) compared with the predictions of the two organizations to analyze the differences. Thus, Twitter data analysis requires various natural language processing techniques, including the removal of stop words, and noun extraction for processing various unrefined forms of unstructured data. To overcome these challenges, we used SAS IRS (Information Retrieval Studio) developed by SAS to capture the trend in real-time processing big stream datasets of Twitter. The system offers a framework for crawling, normalizing, analyzing, indexing and searching tweet data. As a result, we have crawled the entire Twitter sphere in Seoul area and obtained 21,589 tweets in 2013 to review how frequently the IT trend topics announced by the two organizations were mentioned by the people in Seoul. The results shows that most IT trend predicted by NIPA and NIA were all frequently mentioned in Twitter except some topics such as 'new types of security threat', 'green IT', 'next generation semiconductor' since these topics non generalized compound words so they can be mentioned in Twitter with other words. To answer whether the IT trend tweets from Korea is related to the following year's IT trends in real world, we compared Twitter's trending topics with those in Nara Market, Korea's online e-Procurement system which is a nationwide web-based procurement system, dealing with whole procurement process of all public organizations in Korea. The correlation analysis show that Tweet frequencies on IT trending topics predicted by NIPA and NIA are significantly correlated with frequencies on IT topics mentioned in project announcements by Nara market in 2012 and 2013. The main contribution of our research can be found in the following aspects: i) the IT topic predictions announced by NIPA and NIA can provide an effective guideline to IT professionals and researchers in Korea who are looking for verified IT topic trends in the following topic, ii) researchers can use Twitter to get some useful ideas to detect and predict dynamic trends of technological and social issues.

A study on the rainfall management target considering inter-event time definition (IETD) (무강우 지속시간(IETD)을 고려한 빗물관리 목표량 설정 방안 연구)

  • Baek, Jongseok;Kim, Jaemoon;Park, Jaerock;Lim, Kyoungmo;Shin, Hyunsuk
    • Journal of Korea Water Resources Association
    • /
    • v.55 no.8
    • /
    • pp.603-611
    • /
    • 2022
  • In urban areas, the impermeable area continues to increase due to urbanization, which interferes with the surface penetrating and infiltrating of rainwater, causing most rainwater runoff to the surface, deepening the distortion of water circulation. Distortion of water circulation affects not only flood disasters caused by rainfall and runoff, but also various aspects such as dry stream phenomenon, deterioration of water quality, and destruction of ecosystem balance, and the Ministry of Environment strongly recommends the use of Low Impact development (LID) techniques. In order to apply the LID technique, it is necessary to set a rainwater management target to handle the increase in outflow after the development of the target site, and the current standard sets the rainwater management target using the 10-year daily rainfall. In this study, the difference from the current standards was analyzed through statistical analysis and classification of independent rainfall ideas using inter-event time definition (IETD) in setting the target amount of rainwater management to improve water circulation. Using 30-year rainfall data from 1991 to 2020, methods such as autocorrelation coefficient (AC) analysis, variation coefficient (VC) analysis, and annual average number of rainfall event (NRE) analysis were applied, and IETD was selected according to the target rainfall period. The more samples the population had, the more IETD tended to increase. In addition, by analyzing the duration and time distribution of independent rainfall according to the IETD, a plan was proposed to calculate the standard design rainfall according to the rainwater management target amount. Therefore, it is expected that it will be possible to set an improved rainwater management target amount if sufficient samples of independent rainfall ideas are used through the selection of IETD as in this study.

Biodiversity Changes and Community Characteristics of Benthic Macroinvertebrates in Weir Section of the Nakdong River, South Korea (낙동강 보 구간 저서성 대형무척추동물의 생물다양성 변화와 군집 특성)

  • Jung, Sang Woo;Kim, Yoon-Ho;Lee, Jae-Ha;Kim, Dong-Gun;Kim, Min-Kyung;Kim, Hyun-Mac
    • Korean Journal of Environment and Ecology
    • /
    • v.36 no.2
    • /
    • pp.150-164
    • /
    • 2022
  • The objective of this study is to analyze the biodiversity changes and characteristics of the benthic macroinvertebrate community in the Nakdong River with eight weirs, which was constructed as one of the Four Major River Restoration Projects from May to October 2020. The study also includes the analysis of changes in the major groups of benthic macroinvertebrates for about ten years, from 2010 to 2020. The surveys collected 97 species of benthic macroinvertebrates belonging to 83 genera, 52 families, 18 orders, five classes, three phyla, and 128.1 individuals/m2. Chironomidae sp. and Tubificidae spp., which are pollutant indicators, dominated throughout the sections. The community analysis result shows the average dominant index and the diversity index of 0.62±0.20 and 1.87±0.63, respectively, and indicated the most stability of the freshwater ecosystem in the upper stream of the Nakdong River. The survey showed dominance by Chironomidae sp. at the center of the Nakdong River weir and the most unstable community in Chilgok and Gangjeong Goryeong weirs. The results of the community stability analysis showed a high distribution of the characteristic group I with high resilience and resistance and small distribution of characteristic group III with low resistance and resilience, indicating a very unstable condition of communities in the Nakdong River weir section. Predators were relatively abundant among the functional feeding groups (FFGs), whereas shredders, gathering-collectors, and filtering-collectors were relatively lower. Among the habitat orientation groups (HOGs), burrowers and climbers were dominant, indicating a wide distribution of groups in ecosystems with low dissolved oxygen. An endangered species level II of Macromia daimoji was found in Sangju and Nakdan weirs. The analysis results for 10 years from 2010 showed that the number of species and populations increased immediately after the dam construction but plummeted in 2016 and are now stabilizing. Chironomidae spp. has been dominant in all sections over the past 10 years, and they are currently maintained at a rate of about 50%. The EPT groups have decreased significantly since 2011, and the Plecoptera and Trichoptera of the group have not yet been restored. The population of Tubificidae spp. showed an increase after construction was completed in 2012 and drastically increased in 2015 and 2020. The species of Cristaria plicata, designated as endangered species level I, has not been observed since 2011 in Hapcheon Changnyeong weir. Moreover, Macromia daimoji was rarely observed in seven weirs until 2015, and it has been confirmed that the current distribution habitat has decreased rapidly.

Target candidate fish species selection method based on ecological survey for hazardous chemical substance analysis (유해화학물질 분석을 위한 생태조사 기반의 타깃 후보어종 선정법)

  • Ji Yoon Kim;Sang-Hyeon Jin;Min Jae Cho;Hyeji Choi;Kwang-Guk An
    • Korean Journal of Environmental Biology
    • /
    • v.41 no.2
    • /
    • pp.109-125
    • /
    • 2023
  • This study was conducted to select target fish species as baseline research for accumulation analysis of major hazardous chemicals entering the aquatic ecosystem in Korea and to analyze the impact on fish community. The test bed was selected from a sewage treatment plant, which could directly confirm the impact of the inflow of harmful chemicals, and the Geum River estuary where harmful chemicals introduced into the water system were concentrated. A multivariable metric model was developed to select target candidate fish species for hazardous chemical analysis. Details consisted of seven metrics: (1) commercially useful metric, (2) top-carnivorous species metric, (3) pollution fish indicator metric, (4) tolerance fish metric, (5) common abundant metric, (6) sampling availability (collectability) metric, and (7) widely distributed fish metric. Based on seven metric models for candidate fish species, eight species were selected as target candidates. The co-occurring dominant fish with target candidates was tolerant (50%), indicating that the highest abundance of tolerant species could be used as a water pollution indicator. A multi-metric fish-based model analysis for aquatic ecosystem health evaluation showed that the ecosystem health was diagnosed as "bad conditions". Physicochemical water quality variables also influenced fish feeding and tolerance guild in the testbed. Eight water quality parameters appeared high at the T1 site, indicating a large impact of discharging water from the sewage treatment plant. T2 site showed massive algal bloom, with chlorophyll concentration about 15 times higher compared to the reference site.

Evaluation of Economic-Environmental Impact of Heat Exchanger Network in Naphtha Cracking Center (납사분해 공정 내 열 교환 네트워크 경제적-환경영향 평가)

  • Hyojin Jung;Subin Jung;Yuchan Ahn
    • Korean Chemical Engineering Research
    • /
    • v.61 no.3
    • /
    • pp.378-387
    • /
    • 2023
  • Petrochemical is an energy consuming industry that consumes about 30% of total industrial energy consumption and is a representative carbon dioxide (CO2) emission source. Among them, the Naphtha Cracking Center (NCC), which produces ethylene, propylene, propane and mixed C4, consumes large amounts of energy and emits significant amounts of CO2. For this reason, an integrated techno economic- environmental impact assessment aimed at reducing energy consumption and environmental impact factors is necessary to ensure efficiency in terms of economics and environment. This study aims to analyze the efficiency of the heat exchanger network used in the existing NCC base on the pinch analysis and select an improvement plan that can reduced energy consumption. In order to reduces the utility consumption in the process, an optimal heat exchanger network considering the high-temperature and low-temperature stream was derived, and the economic evaluation was conducted by considering the trade-off between the reduction in utility consumption and the increase in heat exchanger installation cost. In addition, an environmental impact assessment was conducted on the reduced CO2 emission in consideration of the environmental aspect, and the economic environmental impact assessment used the payback period to recover the invested funds to come up with an energy saving plan that can be applied based on the actual process. As a result of considering the economic-environmental impact assessment, when the environmental impact assessment was not considered, it was 4.29 months, 3.21 months, and 3.39 months for each case, and when considering the environmental impact assessment, it was 4.24 months, 3.17 months, and 3.35 months for each case. These results appeared equally both when the environmental impact assessment was not include and when it was include. In addition, a sensitivity analysis was conducted for each case to determine how important factors affect the payback period. As a result of the sensitivity analysis, the cost of the heat exchanger was identified as a major factor influencing the overall cost.

An Analysis of Big Video Data with Cloud Computing in Ubiquitous City (클라우드 컴퓨팅을 이용한 유시티 비디오 빅데이터 분석)

  • Lee, Hak Geon;Yun, Chang Ho;Park, Jong Won;Lee, Yong Woo
    • Journal of Internet Computing and Services
    • /
    • v.15 no.3
    • /
    • pp.45-52
    • /
    • 2014
  • The Ubiquitous-City (U-City) is a smart or intelligent city to satisfy human beings' desire to enjoy IT services with any device, anytime, anywhere. It is a future city model based on Internet of everything or things (IoE or IoT). It includes a lot of video cameras which are networked together. The networked video cameras support a lot of U-City services as one of the main input data together with sensors. They generate huge amount of video information, real big data for the U-City all the time. It is usually required that the U-City manipulates the big data in real-time. And it is not easy at all. Also, many times, it is required that the accumulated video data are analyzed to detect an event or find a figure among them. It requires a lot of computational power and usually takes a lot of time. Currently we can find researches which try to reduce the processing time of the big video data. Cloud computing can be a good solution to address this matter. There are many cloud computing methodologies which can be used to address the matter. MapReduce is an interesting and attractive methodology for it. It has many advantages and is getting popularity in many areas. Video cameras evolve day by day so that the resolution improves sharply. It leads to the exponential growth of the produced data by the networked video cameras. We are coping with real big data when we have to deal with video image data which are produced by the good quality video cameras. A video surveillance system was not useful until we find the cloud computing. But it is now being widely spread in U-Cities since we find some useful methodologies. Video data are unstructured data thus it is not easy to find a good research result of analyzing the data with MapReduce. This paper presents an analyzing system for the video surveillance system, which is a cloud-computing based video data management system. It is easy to deploy, flexible and reliable. It consists of the video manager, the video monitors, the storage for the video images, the storage client and streaming IN component. The "video monitor" for the video images consists of "video translater" and "protocol manager". The "storage" contains MapReduce analyzer. All components were designed according to the functional requirement of video surveillance system. The "streaming IN" component receives the video data from the networked video cameras and delivers them to the "storage client". It also manages the bottleneck of the network to smooth the data stream. The "storage client" receives the video data from the "streaming IN" component and stores them to the storage. It also helps other components to access the storage. The "video monitor" component transfers the video data by smoothly streaming and manages the protocol. The "video translator" sub-component enables users to manage the resolution, the codec and the frame rate of the video image. The "protocol" sub-component manages the Real Time Streaming Protocol (RTSP) and Real Time Messaging Protocol (RTMP). We use Hadoop Distributed File System(HDFS) for the storage of cloud computing. Hadoop stores the data in HDFS and provides the platform that can process data with simple MapReduce programming model. We suggest our own methodology to analyze the video images using MapReduce in this paper. That is, the workflow of video analysis is presented and detailed explanation is given in this paper. The performance evaluation was experiment and we found that our proposed system worked well. The performance evaluation results are presented in this paper with analysis. With our cluster system, we used compressed $1920{\times}1080(FHD)$ resolution video data, H.264 codec and HDFS as video storage. We measured the processing time according to the number of frame per mapper. Tracing the optimal splitting size of input data and the processing time according to the number of node, we found the linearity of the system performance.

Spatial Distribution of Soft Bottom Macrobenthos of Yeoja Bay in Summer Season, South Coast of Korea (여자만 연성저질의 여름철 대형저서동물 공간분포)

  • Lim, Hyun-Sig
    • The Sea:JOURNAL OF THE KOREAN SOCIETY OF OCEANOGRAPHY
    • /
    • v.20 no.2
    • /
    • pp.78-91
    • /
    • 2015
  • Macrobenthic community was studied at 87 stations including intertidal and subtidal area in Yoja Bay, south coast of Korea in summer season of July 2001. Duplicate sediment samples were taken using a van Veen grab ($0.1m^2$) in each station. Mud facies of the sediments were widly distributed in the bay. And relatively high content of sand was shown in the Bulgyo-cheon stream estuary. A total of 274 species was occurred with a mean density of $2,346ind./m^2$ and a mean biomass of $78.2g/m^2$. The polychaetes were species- and density-dominant faunal group with a total of 122 species (44.5% of the total number of species), and mean density of $1,543ind./m^2$ (65.8% of the mean density). Meanwhile, molluscs were biomass-dominant faunal group with $44.4g/m^2$. Bio-Env. analysis showed that the combination of bottom salinity and sand content of the surface sediments was highly correlated to the major macrobenthic communities. The macrobenthic species number, decreasing toward inner bay from mouth of the bay, was significantly correlated to the sediment environmental variables and bottom water salinity. The spatial distribution of abundance showed significant correlation to the sand and mud contents and mean grain size of the surface sediments. Major dominant species were Minuspio japonica (polychaete) with a mean density of $1,167ind./m^2$ at upper part of the bay where salinity was low and Eriopisella sechellensis (amphipod) with $152ind./m^2$ in central part of the bay. Species diversity (H') was $3.0{\leq}$ in the mouth part of the bay and ranged 2.0-3.0 in the inner part of the bay, which showed a significant positive correlation to bottom salinity. Total number of species also showed significant correlations to the sediment composition and bottom salinity. Based on the cluster analysis the macrobenthic community of the bay was classified into five station groups from the bay mouth toward the inner part of the bay depending on the species composition. From the SIMPER analysis Minuspio japonica, Eriopisella sechellensis and Sternaspis scutata mainly contributed to the classification of station group. These results suggested that the macrobenthic communities of the bay were mainly influenced by bottom salinity together with sediment composition, and that the studies of spatial distributions of major dominant species and benthic communities should be conducted continuously to monitor the Yeoja Bay benthic environment.

Livestock Manure Nutrients Flow Analysis of Integrated Crop-Livestock Farming Model Reflecting the Regional Characteristics (지역특성을 고려한 경축순환농업 모형의 가축분뇨 양분 흐름분석)

  • Lee, Joon Hee;Choi, Hong Lim
    • Journal of the Korea Organic Resources Recycling Association
    • /
    • v.23 no.2
    • /
    • pp.36-46
    • /
    • 2015
  • Integration of crop-livestock farming has been a problem-solving mode for abatement of environmental pollution and recovery of resources in recent years. The objectives of this study were 1) to suggest the customized integration of crop-livestock farming model reflecting the regional characteristics through in-depth analysis of case study and 2) to analyze the livestock nutrients flow in terms of three primary elements as nitrogen(N), phosphorous(P), and potassium(K). The personal interview and survey were carried out in 2012 for a total of 161 farms from four different regions(NS, NW, JJ, YC) in South Korea. The mass balance analysis was used to suggest and evaluate the models for two sites(JJ and YC). The results showed that NS and NW sites produced relatively more livestock manure than the sites of YC and JJ because of the regional differences in livestock numbers and urbanization. The models were suggested for the site JJ and site YC, and 'two track model(energy and resource recovery)' and 'dispersal type model' were assigned respectively. For the nutrient flows, the releasing P and K with new models had increased up to 7%, while N release had decreased down to 15% in both YC and JJ sites compared to the present treatment system. Estimated value showed that there was oversupply of N (719 ton/yr) and $P_2O_5$ (1,269 ton/yr) in YC and deficiency of N (671 ton/yr) and excessive $P_2O_5$ (32 ton/yr) in JJ respectively. Therefore, P runoff has to be considered an eutrophication occurs in rural small stream when an integration of crop-livestock farm system is applied into both sites.

Yongdam Dam Watershed Flood Simulation Using GPM Satellite Data and KIMSTORM2 Distributed Storm Runoff Model (GPM위성 강우자료와 KIMSTORM2 분포형 유출모형을 이용한 용담댐 유역 홍수모의)

  • KIM, Se-Hoon;KIM, Jin-Uk;CHUNG, Jee-Hun;KIM, Seong-Joon
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.22 no.4
    • /
    • pp.39-58
    • /
    • 2019
  • This study performed the dam watershed storm runoff modeling using GPM(Global Precipitation Measurement) satellite rain and KIMSTORM2(KIneMatic wave STOrm Runoff Model 2) distributed model. For YongdamDam watershed(930㎢), three heavy rain events of 25th August 2014, 11th September 2017, and 26th June 2018 were selected and tested for 4 cases of spatial rainfalls such as (a) Kriging interpolated data using ground observed data at 7 stations, (b) original GPM data, (c) GPM corrected by CM(Conditional Merging), and GPM corrected by GDA(Geographical Differential Analysis). For the 4 kinds of data(Kriging, GPM, CM-GPM, and GDA-GPM), the KIMSTORM2 was calibrated respectively using the observed flood discharges at 3 water level gauge stations(Cheoncheon, Donghyang, and Yongdam) with parameters of initial soil moisture contents, stream Manning's roughness coefficient, and effective hydraulic conductivity. The total average Nash-Sutcliffe efficiency(NSE) for the 3 events and 3 stations was 0.94, 0.90, 0.94, and 0.94, determination coefficient(R2) was 0.96, 0.92, 0.97 and 0.96, the volume conservation index(VCI) was 1.03, 1.01, 1.03 and 1.02 for Kriging, GPM, CM-GPM, and GDA-GPM applications respectively. The CM-GPM and GDA-GPM showed better results than the original GPM application for peak runoff and runoff volume simulations, and they improved NSE, R2, and VCI results.

High-Resolution of Paleoenvironmental Reconstruction and Sea-Level History in Delaware Bay, the East Coast of U.S.A. (미국동부 델라웨어만의 고정밀도 해수면 역사와 고환경 복원)

  • YI, HI-IL;WEHMILLER, JOHN F.
    • 한국해양학회지
    • /
    • v.30 no.4
    • /
    • pp.320-331
    • /
    • 1995
  • The closely spaced cores were analyzed to find detailed reconstruction of paleoenvironments and sealable changes along the Delaware Bay coast. Three areas, Kitts Hummock Beach mars, the St. Jones River marsh, and Bowers marsh near the St. Jones River's mouth, were chosen because these areas are compose of their own geomorphic characteristics and sea-level history. since significance of the stratigraphic correlations was to determine sedimentary fancies and paleoenvironments, multidisciplinary methods such as lithological description, grain-size analysis, organic/inorganic content, water content, mineral composition, botanical analysis, micropaleontological analysis, and /SUP 14/C datings were performed. Five major divisions of marsh environments were recognized in the stratigraphic sections: freshwater marsh, initialfreshwater marsh, slightly brackish marsh, brackish marsh, and salt marsh. Most of the lower part in the stratigraphic sections show freshwater marsh. On the top of this, either brackish marsh or tidal flat/tidal stream was recorded. The pro-Holocene sediments consist of sand, mud, and sandy mud, The pre-Holocene configuration played an important role for developing the Holocene Paleoenvironmental changes. The irregular configuration of the pre-Holocene sediments consist of sand, mud, and sandy mud. The pre-Holocene configuration played an important role for developing the Holocene Paleoenvironmental changes. The irregular configuration of the pre-Holocene surface within short distances permitted the concurrent development of variable environments such as freshwater marsh, brackish marsh or salt marsh at similar elevations. The freshwater marsh in this case was formed in the areas of isolation, so saline-water cannot encroach upon these areas. This complex development of paleoenvironments leads to a difficulty in stratigraphic correlation and interpretation of local relative sea-level changes. The deposition of subsurface sediments was affected by sediment supply, compaction, fluvial activity, biological competition, local tectonics and isostacy, climate and local relative sea-level changes. It was interpreted that the positions in the changes from freshwater environments to brackish environments or ice versa are the turning points of transgressions and regressions. Therefore, multiple transgressions and regressions were identified in the stratigraphic sections of the study area.

  • PDF