• 제목/요약/키워드: techniques: data archiving system

검색결과 2건 처리시간 0.018초

NVST DATA ARCHIVING SYSTEM BASED ON FASTBIT NOSQL DATABASE

  • Liu, Ying-Bo;Wang, Feng;Ji, Kai-Fan;Deng, Hui;Dai, Wei;Liang, Bo
    • 천문학회지
    • /
    • 제47권3호
    • /
    • pp.115-122
    • /
    • 2014
  • The New Vacuum Solar Telescope (NVST) is a 1-meter vacuum solar telescope that aims to observe the fine structures of active regions on the Sun. The main tasks of the NVST are high resolution imaging and spectral observations, including the measurements of the solar magnetic field. The NVST has been collecting more than 20 million FITS files since it began routine observations in 2012 and produces maximum observational records of 120 thousand files in a day. Given the large amount of files, the effective archiving and retrieval of files becomes a critical and urgent problem. In this study, we implement a new data archiving system for the NVST based on the Fastbit Not Only Structured Query Language (NoSQL) database. Comparing to the relational database (i.e., MySQL; My Structured Query Language), the Fastbit database manifests distinctive advantages on indexing and querying performance. In a large scale database of 40 million records, the multi-field combined query response time of Fastbit database is about 15 times faster and fully meets the requirements of the NVST. Our slestudy brings a new idea for massive astronomical data archiving and would contribute to the design of data management systems for other astronomical telescopes.

Development of High Speed Satellite Data Acquisition System

  • Choi, Wook-Hyun;Park, Sang-Jin;Seo, In-Seok;Park, Won-Kyu
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2003년도 Proceedings of ACRS 2003 ISRS
    • /
    • pp.280-282
    • /
    • 2003
  • The downlink data rates of the space-born payloads such as high-resolution optical cameras, synthetic aperture radars (SAR) and hyper-spectral sensors are being rapidly increased. For example, the image transmission rates of KOMPSAT-2 MSC(Multi-Spectral Camera) is 320Mbps even if on-board image compression scheme is used.[1] In the near future, the data rates are expected to be a level 500${\sim}$600Mbps because the required resolution will be higher and the swath width will be increased. This paper describes many techniques they enable 500Mbps data receiving and archiving system.

  • PDF