Electronics and Telecommunications Trends (전자통신동향분석)

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

A Survey on Feature Store

Feature 저장소 기술 동향

  • Published : 2021.04.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we discussed the necessity and importance of introducing feature stores to establish a collaborative environment between data engineering work and data science work. We examined the technology trends of feature stores by analyzing the status of some major feature stores. Moreover, by introducing a feature store, we can reduce the cost of performing artificial intelligence (AI) projects and improve the performance and reliability of AI models and the convenience of model operation. The future task is to establish technical requirements for establishing a collaborative environment between data engineering work and data science work and develop a solution for providing a collaborative environment based on this.

Keywords

References

  1. M. Taifi, "ML feature stores: A casual tour 1/3," Apr. 13, 2020, https://medium.com/@farmi/ml-feature-stores-a-casualtour-fc45a25b446a
  2. G. Osin, "Feature store as a foundation for machine learning," Dec. 10, 2020, https://towardsdatascience.com/feature-storeas-a-foundation-for-machine-learning-d010fc6eb2f3
  3. J. Dowling, "MLOps with a feature store," Mar. 5, 2020, https://towardsdatascience.com/mlops-with-a-feature-store816cfa5966e9
  4. AltexSoft, "What is data engineering: Explaining the data pipeline, data warehouse, and data engineer role," June 2019, https://www.altexsoft.com/blog/datascience/what-is-dataengineering-explaining-data-pipeline-data-warehouse-anddata-engineer-role/
  5. 정창헌, "Data warehouse vs. data lake," 2017. 7. 12. https://blog.b2en.com/253
  6. J. Dowling, "Feature store vs data warehouse," Oct. 10, 2020, https://medium.com/data-for-ai/feature-store-vs-datawarehouse-306d1567c100
  7. J. K. Park and H. S. Hwang, "Feature store란?," Sept. 24, 2020, https://medium.com/daria-blog/feature-store-%EB%9E%80-4c53d18c1149
  8. http://featurestore.org/
  9. A. Holler and M. Mui, "Evolving michelangelo model representation for flexibility at scale," Oct. 16, 2019, https://eng.uber.com/michelangelo-machine-learning-modelrepresentation/
  10. J. Hermann and M. Del Balso, "Meet michelangelo: Uber's machine learning platform," Sept. 5, 2017, https://eng.uber.com/michelangelo/
  11. M. Del Balso, "Tecton: The data platform for machine learning" Apr. 28, 2020, https://www.tecton.ai/blog/data-platform-ml/
  12. https://github.com/logicalclocks/hopsworks
  13. A. A. Ormenis et al., "Horizontally scalable ml pipelines with a feature store," Mar. 20, 2019, https://mlsys.org/Conferences/2019/doc/2019/demo_7.pdf
  14. https://hopsworks.readthedocs.io/en/latest/featurestore/guides/featurestore.html
  15. https://github.com/feast-dev/feast
  16. Feast, "What is feast," https://docs.feast.dev/