• Title/Summary/Keyword: Crawl

Search Result 55, Processing Time 0.02 seconds

A Computer Simulation on the Efficiency of Energy Consumption for Quadruped Walking Robot (4족 보행로봇의 소비에너지 효율에 관한 시뮬레이션)

  • Ahn Byong-Won;Bae Cherl-o;Eom Han-Sung
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.9 no.6
    • /
    • pp.1247-1252
    • /
    • 2005
  • Though a legged robot has a high terrain adaptability as compared with a wheeled robot, its moving speed is considerably low in general. For attaining a high moving speed with a logged robot, a dynamically stable walking is a promising solution. However, the energy efficiency of a dynamically stable walking is generally lower than the efficiency of a stable gait such as a crawl gait. In this paper, energy consumption of two walking patterns for a trot gait is simulated through modeling a quadruped walking robot named TITAN-VIII.

Distribute Parallel Crawler Design and Implementation (분산형 병렬 크롤러 설계 및 구현)

  • Jang, Hyun Ho;jeon, kyung-sik;Lee, HooKi
    • Convergence Security Journal
    • /
    • v.19 no.3
    • /
    • pp.21-28
    • /
    • 2019
  • As the number of websites managed by organizations or organizations increases, so does the number of web application servers and containers. In checking the status of the web service of the web application server and the container, it is very difficult for the person to check the status of the web service after accessing the physical server at the remote site through the terminal or using other accessible software It. Previous research on crawler-related research is hard to find any reference to the processing of data from crawling. Data loss occurs when the crawler accesses the database and stores the data. In this paper, we propose a method to store the inspection data according to crawl - based web application server management without losing data.

A Study on the Preemptive Measure for Fake News Eradication Using Data Mining Algorithms : Focused on the M Online Community Postings (데이터 마이닝을 활용한 가짜뉴스의 선제적 대응을 위한 연구 : M 온라인 커뮤니티 게시물을 중심으로)

  • Lim, Munyeong;Park, Sungbum
    • Journal of Information Technology Services
    • /
    • v.18 no.1
    • /
    • pp.219-234
    • /
    • 2019
  • Fake news threaten democratic elections and causes social conflicts, resulting in major damage. However, the concept of fake news is hard to define, as there is a saying, "News is not fake, fake is not news." Fake news, however, has irreversible characteristics that can not be recovered or reversed completely through post-punishment of economic and political benefits. It is also rapidly spreading in the early days. Therefore, it is very important to preemptively detect these types of articles and prevent their blind proliferation. The existing countermeasures are focused on reporting fake news, raising the level of punishment, and the media & academia to determine the authenticity of the news. Researchers are also trying to determine the authenticity by analyzing its contents. Apart from the contents of fake news, determining the behavioral characteristics of the promoters and its qualities can help identify the possibility of having fake news in advance. The online community has a fake news interception and response tradition through its long-standing community-based activities. As a result, I attempted to model the fake news by analyzing the affirmation-denial analysis and posting behavior by securing the web board crawl of the 'M community' bulletin board during the 2017 Korean presidential election period. Random forest algorithm deemed significant. The results of this research will help counteract fake news and focus on preemptive blocking through behavioral analysis rather than post-judgment after semantic analysis.

Sentiment analysis of Korean movie reviews using XLM-R

  • Shin, Noo Ri;Kim, TaeHyeon;Yun, Dai Yeol;Moon, Seok-Jae;Hwang, Chi-gon
    • International Journal of Advanced Culture Technology
    • /
    • v.9 no.2
    • /
    • pp.86-90
    • /
    • 2021
  • Sentiment refers to a person's thoughts, opinions, and feelings toward an object. Sentiment analysis is a process of collecting opinions on a specific target and classifying them according to their emotions, and applies to opinion mining that analyzes product reviews and reviews on the web. Companies and users can grasp the opinions of public opinion and come up with a way to do so. Recently, natural language processing models using the Transformer structure have appeared, and Google's BERT is a representative example. Afterwards, various models came out by remodeling the BERT. Among them, the Facebook AI team unveiled the XLM-R (XLM-RoBERTa), an upgraded XLM model. XLM-R solved the data limitation and the curse of multilinguality by training XLM with 2TB or more refined CC (CommonCrawl), not Wikipedia data. This model showed that the multilingual model has similar performance to the single language model when it is trained by adjusting the size of the model and the data required for training. Therefore, in this paper, we study the improvement of Korean sentiment analysis performed using a pre-trained XLM-R model that solved curse of multilinguality and improved performance.

Field distribution factors and dynamic load allowance for simply supported double-tee girder bridges

  • Kidd, Brian;Rimal, Sandip;Seo, Junwon;Tazarv, Mostafa;Wehbe, Nadim
    • Structural Engineering and Mechanics
    • /
    • v.82 no.1
    • /
    • pp.69-79
    • /
    • 2022
  • This paper discusses the field testing of two single-span double-tee girder (DTG) bridges in South Dakota to determine live load distribution factors (LLDFs) and the dynamic load allowance (IM). One bridge had seven girders and another had eight girders. The longitudinal girder-to-girder joints of both bridges were deteriorated in a way that water could penetrate and the joint steel members were corroded. A truck traveled across each of the two bridges at five transverse paths. The paths were tested twice with a crawl speed load test and twice with a dynamic load. The LLDFs and IM were determined using strain data measured during the field tests. These results were compared with those determined according to the AASHTO Standard and the AASHTO LRFD specifications. Nearly all the measured LLDFs were below the AASHTO LRFD design LLDFs, with the exception of two instances: 1) An exterior DTG on the seven-girder bridge and 2) An interior DTG on the eight-girder bridge. The LLDFs specified in the AASHTO Standard were conservative compared with the measured LLDFs. It was also found that both AASHTO LRFD and AASHTO Standard specifications were conservative when estimating IM, compared to the field test results for both bridges.

Asynchronous Web Crawling Algorithm (링크 분석을 통한 비동기 웹 페이지 크롤링 알고리즘)

  • Won, Dong-Hyun;Park, Hyuk-Gyu;Kang, Yun-Jeong;Lee, Min-Hye
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2022.10a
    • /
    • pp.364-366
    • /
    • 2022
  • The web uses an asynchronous web method to provide various information having different processing speeds together. The asynchronous method has the advantage of being able to respond to other events even before the task is completed, but a typical crawler has difficulty collecting information provided asynchronously by collecting point-of-visit information on a web page. In addition, asynchronous web pages often do not change their web address even if the page content is changed, making it difficult to crawl. In this paper, we propose a web crawling algorithm considering asynchronous page movement by analyzing links in the web. With the proposed algorithm, it was possible to collect dictionary information on TTA terms that provide information asynchronously.

  • PDF

An Analysis of the Positive and Negative Factors Affecting Job Satisfaction Using Topic Modeling

  • Changjae Lee;Byunghyun Lee;Ilyoung Choi;Jaekyeong Kim
    • Asia pacific journal of information systems
    • /
    • v.34 no.1
    • /
    • pp.321-350
    • /
    • 2024
  • When a competent employee leaves an organization, the technical skills and know-how possessed by that employee also disappear, which may lead to various problems, such as a decrease in organizational morale and technology leakage. To address such problems, it is important to increase employees' job satisfaction. Due to the advancement of both information and communication technology and social media, many former and current employees share information regarding companies in which they have worked or for which they currently work via job portal websites. In this study, a web crawl was used to collect reviews and job satisfaction ratings written by all and incumbent employees working in nine industries from Job Planet, a Korean job portal site. According to this analysis, regardless of the industry in question, organizational culture, welfare support, work system, growth capability and relationships had significant positive effects on job satisfaction, while time and attendance management, performance management, and organizational flexibility had significant negative effects on job satisfaction. With respect to the path difference between former and current employees, time and attendance management and organizational flexibility have greater negative effects on job satisfaction for current employees than for former employees. On the other hand, organizational culture, work system, and relationships had greater positive effects for current employees than for former employees.

State Information Based Recommendation Algorithm for Minimizing the Malicious User's Influence (상태 정보를 활용하여 악의적 사용자의 영향력을 최소화 하는 추천 알고리즘)

  • Noh, Taewan;Oh, Hayoung;Noh, Giseop;Kim, Chong-Kwon
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.25 no.6
    • /
    • pp.1353-1360
    • /
    • 2015
  • With the extreme development of Internet, recently most users refer the sites with the various Recommendation Systems (RSs) when they want to buy some stuff, movie and music. However, the possibilities of the Sybils with the malicious behaviors may exists in these RSs sites in which Sybils intentionally increase or decrease the rating values. The RSs cannot play an accurate role of the proper recommendations to the general normal users. In this paper, we divide the given rating values into the stable or unstable states and propose a system information based recommendation algorithm that minimizes the malicious user's influence. To evaluate the performance of the proposed scheme, we directly crawl the real trace data from the famous movie site and analyze the performance. After that, we showed proposed scheme performs well compared to existing algorithms.

Distribution and Strandings of Endangered Sea Turtles in Korean Waters (한국 연안의 멸종위기 바다거북의 분포 및 좌초 현황)

  • Moon, Dae-Yeon;Jung, Min-Min;An, Yong-Rock;Choi, Seok-Gwan;Oh, Bong-Se;Kim, Zang-Geun;Lee, Chu;Kim, Moon-Jin;Kim, Sam-Yeon
    • Korean Journal of Fisheries and Aquatic Sciences
    • /
    • v.42 no.6
    • /
    • pp.657-663
    • /
    • 2009
  • This paper reports the strandings of sea turtles on Korean shores monitored for the first time in 2008. A total of 19 sea turtles, consisting of 12 greens and 7 loggerheads, were recorded as stranded from the east coast to the south including Jeju Island. Reported strandings reached a peak in July and dominant area was Jeju Island. The curved carapace length of loggerhead sea turtles ranged 65-84.2cm and that of green sea turtles ranged 39.2-90cm, indicating most of them were immature to sub-adult. Out of 19 turtles, 11 were found dead with unknown reasons. Possible causes of death may include drawning by fishing gear, swallowing of marine debris, boat collision, and diseases. An immature green sea turtle tagged with a satellite transmitter spent winter near Jeju Island where it was released, suggesting that the Island provide immature greens a feeding ground. Considering thousands of sea turtles crawl on Japanese shores for nesting every year, the number of sea turtles reported in Korean waters was relatively small. Therefore, it is suggested that an appropriate monitoring system be necessary to protect and conserve endangered sea turtle species in Korean waters.

Effects of First Harvest Methods on Growth and Yield in Saururus chinensis Baill (1차 수확정도가 삼백초의 생육 및 수량에 미치는 영향)

  • Nam, Sang-Young;Kim, In-Jae;Kim, Min-Ja;Yun, Tae;Lee, Cheol-Hee
    • Korean Journal of Plant Resources
    • /
    • v.20 no.2
    • /
    • pp.125-128
    • /
    • 2007
  • Plan stability production investigating 1st harvesting degree for maximum leaf quantity enlargement, is as following it summarize result that test for 3 years since 2002 allowing 4 processing such as trunk lower column department harvesting, Foliar and rhizoma growth were tendency that give protective care 1 st harvesting height is short, but there were many the number of tillering crawl, Distribution of rhizome about diameter 5mm low 58%, large rhizome's ratio was high tendency harvesting height is short. Because foliar amount is much harvesting height is short in ground department, 15% rose in soil surface harvesting since 292kg provision per 5cm harvesting 10a, The time of refining the harvest of stems and leaves before drying has reduced when the height of the harvest is low, and the 5cm harvest has decreased 30% compared to the soil surface harvest.