Performance of Apache Ozone on NVMe Wei-Chiu Chuang (jojochuang) Ritesh Shukla (kerneltime) Agenda • Overview of how Ozone and how it scales • Why NVME is important for Ozone for scaling • Benefits Benefits of using NVME • Impala performance results from NVME clusters • Write path improvements results from NVME clusters • Summary • Questions Ozone Architecture Why does Ozone Scale? Separation of restart) Slow startup based on size High Availability Active - Active Active - Standby Protocol Support Hadoop / S3 API Hadoop API Small objects are welcome Max performance reached at object size around

#IstioCon Performance tuning and best practices in a Knative based, large-scale serverless platform with Istio 张龚, Gong Zhang, IBM China Development Lab 庄宇, Yu Zhuang, IBM China Development Lab #IstioCon Cloud. #IstioCon ● Knative and Istio ● How Istio is leveraged in a Knative based platform ● Performance bottleneck analysis and tuning ○ Istio scalability optimization during Knative Service provisioning mesh enabled (based on https://github.com/knative/serving) #IstioCon Performance bottleneck analysis and tuning • Performance Criteria: the platform has multiple shard k8s clusters, each cluster should

Kalavri
 vkalavri@bu.edu Spring 2020 3/17: High availability, recovery semantics, and guarantees Vasiliki Kalavri | Boston University 2020 Today’s topics • High-availability and fault-tolerance in distributed Kalavri | Boston University 2020 Fault-tolerance trade-offs 12 Steady-state overhead • How is performance affected by the fault-tolerance mechanism under normal, failure- free operation? • How much state consists of • input queues • operator state • output queues • Short recovery time • High runtime overhead • The checkpoint interval determines the trade-off 14 Ni primary secondary

ADMIN GUIDE 1 Multi-tenancy 3 2 Ease of Use 5 3 Run Anywhere 7 4 High Performance 9 5 Authentication & Authorization 11 6 High Availability 13 6.1 Quick Start . . . . . . . . . . . . . . . . . . cluster managers. 7 Kyuubi, Release 1.6.1-incubating 8 Chapter 3. Run Anywhere CHAPTER FOUR HIGH PERFORMANCE Kyuubi is built on the Apache Spark, a lightning-fast unified analytics engine. • Concurrent fully supports Spark SQL Catalyst Optimizer, 9 Kyuubi, Release 1.6.1-incubating 10 Chapter 4. High Performance CHAPTER FIVE AUTHENTICATION & AUTHORIZATION With strong authentication and fine-grained

ADMIN GUIDE 1 Multi-tenancy 3 2 Ease of Use 5 3 Run Anywhere 7 4 High Performance 9 5 Authentication & Authorization 11 6 High Availability 13 6.1 Quick Start . . . . . . . . . . . . . . . . . . cluster managers. 7 Kyuubi, Release 1.6.0-incubating 8 Chapter 3. Run Anywhere CHAPTER FOUR HIGH PERFORMANCE Kyuubi is built on the Apache Spark, a lightning-fast unified analytics engine. • Concurrent fully supports Spark SQL Catalyst Optimizer, 9 Kyuubi, Release 1.6.0-incubating 10 Chapter 4. High Performance CHAPTER FIVE AUTHENTICATION & AUTHORIZATION With strong authentication and fine-grained

USAGE GUIDE 1 Multi-tenancy 3 2 Ease of Use 5 3 Run Anywhere 7 4 High Performance 9 5 Authentication & Authorization 11 6 High Availability 13 6.1 Quick Start . . . . . . . . . . . . . . . . . . different cluster managers. 7 Kyuubi, Release 1.3.0 8 Chapter 3. Run Anywhere CHAPTER FOUR HIGH PERFORMANCE Kyuubi is built on the Apache Spark, a lightning-fast unified analytics engine. • Concurrent plan: fully supports Spark SQL Catalyst Optimizer, 9 Kyuubi, Release 1.3.0 10 Chapter 4. High Performance CHAPTER FIVE AUTHENTICATION & AUTHORIZATION With strong authentication and fine-grained

USAGE GUIDE 1 Multi-tenancy 3 2 Ease of Use 5 3 Run Anywhere 7 4 High Performance 9 5 Authentication & Authorization 11 6 High Availability 13 6.1 Quick Start . . . . . . . . . . . . . . . . . . different cluster managers. 7 Kyuubi, Release 1.3.0 8 Chapter 3. Run Anywhere CHAPTER FOUR HIGH PERFORMANCE Kyuubi is built on the Apache Spark, a lightning-fast unified analytics engine. • Concurrent plan: fully supports Spark SQL Catalyst Optimizer, 9 Kyuubi, Release 1.3.0 10 Chapter 4. High Performance CHAPTER FIVE AUTHENTICATION & AUTHORIZATION With strong authentication and fine-grained

USAGE GUIDE 1 Multi-tenancy 3 2 Ease of Use 5 3 Run Anywhere 7 4 High Performance 9 5 Authentication & Authorization 11 6 High Availability 13 6.1 Quick Start . . . . . . . . . . . . . . . . . . cluster managers. 7 Kyuubi, Release 1.5.0-incubating 8 Chapter 3. Run Anywhere CHAPTER FOUR HIGH PERFORMANCE Kyuubi is built on the Apache Spark, a lightning-fast unified analytics engine. • Concurrent fully supports Spark SQL Catalyst Optimizer, 9 Kyuubi, Release 1.5.0-incubating 10 Chapter 4. High Performance CHAPTER FIVE AUTHENTICATION & AUTHORIZATION With strong authentication and fine-grained

USAGE GUIDE 1 Multi-tenancy 3 2 Ease of Use 5 3 Run Anywhere 7 4 High Performance 9 5 Authentication & Authorization 11 6 High Availability 13 6.1 Quick Start . . . . . . . . . . . . . . . . . . cluster managers. 7 Kyuubi, Release 1.5.1-incubating 8 Chapter 3. Run Anywhere CHAPTER FOUR HIGH PERFORMANCE Kyuubi is built on the Apache Spark, a lightning-fast unified analytics engine. • Concurrent fully supports Spark SQL Catalyst Optimizer, 9 Kyuubi, Release 1.5.1-incubating 10 Chapter 4. High Performance CHAPTER FIVE AUTHENTICATION & AUTHORIZATION With strong authentication and fine-grained

USAGE GUIDE 1 Multi-tenancy 3 2 Ease of Use 5 3 Run Anywhere 7 4 High Performance 9 5 Authentication & Authorization 11 6 High Availability 13 6.1 Quick Start . . . . . . . . . . . . . . . . . . cluster managers. 7 Kyuubi, Release 1.5.2-incubating 8 Chapter 3. Run Anywhere CHAPTER FOUR HIGH PERFORMANCE Kyuubi is built on the Apache Spark, a lightning-fast unified analytics engine. • Concurrent fully supports Spark SQL Catalyst Optimizer, 9 Kyuubi, Release 1.5.2-incubating 10 Chapter 4. High Performance CHAPTER FIVE AUTHENTICATION & AUTHORIZATION With strong authentication and fine-grained