• Title/Summary/Keyword: Benchmark Test Collection

Search Result 3, Processing Time 0.018 seconds

HKIB-20000 & HKIB-40075: Hangul Benchmark Collections for Text Categorization Research

  • Kim, Jin-Suk;Choe, Ho-Seop;You, Beom-Jong;Seo, Jeong-Hyun;Lee, Suk-Hoon;Ra, Dong-Yul
    • Journal of Computing Science and Engineering
    • /
    • v.3 no.3
    • /
    • pp.165-180
    • /
    • 2009
  • The HKIB, or Hankookilbo, test collections are two archives of Korean newswire stories manually categorized with semi-hierarchical or hierarchical category taxonomies. The base newswire stories were made available by the Hankook Ilbo (The Korea Daily) for research purposes. At first, Chungnam National University and KISTI collaborated to manually tag 40,075 news stories with categories by semi-hierarchical and balanced three-level classification scheme, where each news story has only one level-3 category (single-labeling). We refer to this original data set as HKIB-40075 test collection. And then Yonsei University and KISTI collaborated to select 20,000 newswire stories from the HKIB-40075 test collection, to rearrange the classification scheme to be fully hierarchical but unbalanced, and to assign one or more categories to each news story (multi-labeling). We refer to this modified data set as HKIB-20000 test collection. We benchmark a k-NN categorization algorithm both on HKIB-20000 and on HKIB-40075, illustrating properties of the collections, providing baseline results for future studies, and suggesting new directions for further research on Korean text categorization problem.

WebSHArk 1.0: A Benchmark Collection for Malicious Web Shell Detection

  • Kim, Jinsuk;Yoo, Dong-Hoon;Jang, Heejin;Jeong, Kimoon
    • Journal of Information Processing Systems
    • /
    • v.11 no.2
    • /
    • pp.229-238
    • /
    • 2015
  • Web shells are programs that are written for a specific purpose in Web scripting languages, such as PHP, ASP, ASP.NET, JSP, PERL-CGI, etc. Web shells provide a means to communicate with the server's operating system via the interpreter of the web scripting languages. Hence, web shells can execute OS specific commands over HTTP. Usually, web attacks by malicious users are made by uploading one of these web shells to compromise the target web servers. Though there have been several approaches to detect such malicious web shells, no standard dataset has been built to compare various web shell detection techniques. In this paper, we present a collection of web shell files, WebSHArk 1.0, as a standard dataset for current and future studies in malicious web shell detection. To provide baseline results for future studies and for the improvement of current tools, we also present some benchmark results by scanning the WebSHArk dataset directory with three web shell scanning tools that are publicly available on the Internet. The WebSHArk 1.0 dataset is only available upon request via email to one of the authors, due to security and legal issues.

The Study of Usability Evaluation in the GUI of Mobile Computing - Based on Benchmark Testing in the interface design of WIPI (Mobile Computing의 GUI 개발에 있어 사용성 평가 연구 - WIPI 인터페이스 디자인을 위한 Benchmark Testing을 중심으로 -)

  • 정봉금;송연승
    • Archives of design research
    • /
    • v.17 no.1
    • /
    • pp.49-62
    • /
    • 2004
  • Due to the recent surge of wireless Internet and concurrent development of the end user terminal devices having standardized graphical user interface(GUI) and unified operation mechanism for better interactivity in information representation and ease of use, various efforts on the improvement of GUI is widely recognized as one of the key factors that will usher in the next stages of the wireless Internet for the users. Especially, improved usability along with unique visual effect are considered to be the key elements for GUI considering the rapid improvement of the resolution and color on the end user handset devices; thus, the study and research on the subject of GUI is expected to increase along with the wireless Internet using smart phones. User interface of the wires Internet end user handsets will have a definite and significant effect on the user interaction as well as productivity. Domestically, wireless Internet service providers and GUI design companies are making various efforts in producing a common GUI models for standardized operation scheme and improved graphical display capabilities of the hand phones, PDAs and smart phones. In the study, Nokia 3650 model and Microsoft Orange SPV model were chosen as test devices for usability comparison and data collection to collect directional benchmark data in developing next generation smart phone user interface integrating PDAs and phones. The mail purpose of this study is to achieve the most efficient user accessibility to WAP menu through intensive focus on developing WIPI WAP menu having most effective usability for the users in their twenties and thirties. The result of this study can also be used as the base research materials for WAP service development, VM browser development and PDA browser development. The result of this study along with the evaluation model is expected to provide effective analysis materials on the subject of user interface to the developers of the wireless Internet user devices, GUI designers and service planners while short listing key factors to consider in developing smart phones therefore serving as the GUI guideline of WIPI phones.

  • PDF