pod, deployment, statefulset, etc. - But it does not know how to operate a TiDB cluster... Kubernetes Pattern - Declarative Model PingCAP.com - Kubernetes has pod, deployment, statefulset, etc. - But it It’s ok to upgrade a High Availability system like TiDB directly. But, to avoid spikes we use StatefulSet partition to perform a phased roll out. - Upgrade PD - Upgrade TiKV - Upgrade TiDB PingCAP successfully, scale in the StatefulSet Scaling In - PD PingCAP.com - Delete the TiKV store via PD API first - Wait for the store to be tombstoned - Scale the statefulset Scaling In - TiKV PingCAP

特别关注硬盘相关的写入指标 Kubernetes 资源对象 的监控 Kubernetes资源对象的监控 kube-state-metrics • 所谓的资源对象，就是指Deployment、StatefulSet、Secret等，比 如针对Deployment，我们希望知道有多少Deployment，调度了多 少副本，可用的副本有多少，多少个Pod是running、stopped、 terminated状态，等等 ReplicaSet Metrics • ReplicationController Metrics • ResourceQuota Metrics • Service Metrics • StatefulSet Metrics • Namespace Metrics • Horizontal Pod Autoscaler Metrics • Endpoint Metrics • Secret Metrics

+ Sidecar ● https://github.com/improbable-eng/thanos/tree/master/ kube/manifests ● Run as statefulset in a kubernetes cluster. ● Sidecar and prometheus run as two separate containers in the same

…… Pod Upgrade 机房A – 单元A • 精准分组，自定义拓扑 • IP不变，无损升级 • 可适配多种工作负载 • InPlaceSet • ReplicaSet • StatefulSet 可灰度： • 应用发布进程可控，允许灰度、 分组和 Beta 验证； 可回滚： • 随时暂停、回滚，任何变更有 据可查； 可监控： • 接入监控告警体系，全程保证 可观测性 partition:3

one ● Operator’s fundamental ● Built-in controller examples: ○ ReplicaSert ○ Deployment ○ StatefulSet ○ JobOperators ● Concept was introduced in 2016 by the CoreOS ● Operators are software extensions

容 器 云 资源池 区域 可用区 虚拟化 宿主机 虚拟机 云服务 RDS Redis 容器 容器集群 容器节点 命名空间 容器服务 Ingress Deployment StatefulSet ReplicaSet POD 应用 业务 资源组 服务名 方法名 API EP 网络 VPC 子网 路由器 CIDR IP地址 安全组 NAT网关 SLB 资源、服务知识图谱 TKE