Loading…
July 17-19 | Tokyo, Japan
View More Details  & Register Here
Wednesday, July 17 • 13:30 - 14:10
Building Telemetry and Anomaly Detection Models for Cloud Native Storage - Xing Yang, Futurewei & Seiya Takei, Yahoo Japan Corporation

Sign up or log in to save this to your schedule and see who's attending!

Feedback form is now closed.
Integrating with heterogeneous storage in the Cloud Native environment has always been a challenge. How to detect problems and fix them in a timely fashion is important for mission critical workloads.

In this session, Takei-san and Xing will describe a common volume metrics model designed to retrieve data from heterogeneous storage in the Cloud Native environment. They will also illustrate a ML module that analyzes the data to detect anomaly, and discuss how it helps Yahoo Japan identify problems early to keep the storage systems healthy.

Volume metrics such as IOPs, bandwidth, latency, and capacity are generated from storage backends serving workloads running on Kubernetes, and collected by the Prometheus server. Data is also piped through Kafka, parsed and saved in MongoDB. The ML module retrieves data to train the models, chooses the best model to detect anomalous data points.

Speakers
ST

Seiya Takei

Storage Engineer, Yahoo Japan Corporation
Seiya Takei is in charge of private cloud compute and storage at Yahoo Japan. Yahoo Japan has been participated in the End-User Advisory Committee of OpenSDS, an open source project under Linux Foundation, since July 2017. Seiya Takei has speaking experiences at local conferences... Read More →
avatar for Xing Yang

Xing Yang

Lead Architect, OpenSDS
Xing Yang is the Lead Architect of OpenSDS, an open source project under Linux Foundation. Xing is a contributor in Kubernetes and Container Storage Interface (CSI), co-lead of Volume Snapshot project in Kubernetes SIG-Storage, co-author of CNCF Storage Landscape white paper, and... Read More →



Wednesday July 17, 2019 13:30 - 14:10
Hall B (3) (Floor 4F)
  • Experience Level Any