A Day in the Life of a Data Scientist Conquer Machine Learning Lifecycle on Kubernetes Brian Redmond • Cloud Architect @ Microsoft (18 years) • Azure Global Black Belt Team • Live in Pittsburgh, PA idle • Parallel training instead of sequential: huge time saver for large trainings Kubeflow • Machine Learning Toolkit for Kubernetes • To make ML workflows on Kubernetes simple, portable, and scalable

Communication Management Container Orchestration Data Processing Pipelines Data Flow Graphs for Machine Intelligence Kubernetes Contributors opensource.google.com A strong community with corporate latest Kubernetes releases that have been validated and tested by Google ● Access to Container services on GCP such as Cloud Build, Container Registry, Audit Logging, and more. ● Integration with Istio on-prem containers just like GKE in the cloud Consistent operating model with access to GCP services across hybrid environments Single-pane-of-glass for multiple Kubernetes clusters, no matter

I have many Pod replicas Service I want to proxy my Pod replicas Ingress I want to expose my Services DaemonSet I run as daemon StatefulSet I am stateful Job I only run for once CronJob I run kubelet SyncLoop kubelet SyncLoop proxy proxy 4.1 Detected bind operation 4.2 Start Pod on this machine etcd scheduler api-server Pattern 1: Controller • Control everything by Controller • Level I have many Pod replicas Service I want to proxy my Pod replicas Ingress I want to expose my Services DaemonSet I run as daemon StatefulSet I am stateful Job I only run for once CronJob I run

networking.istio.io annotations: alias: traffic spec: appliesTo: - apps.k8s.io conflictsWith: - services.k8s.io definition: virtualservices.networking.istio.io 应用管理引擎 能力注册 $ kubectl get traits NAME APPLIES TO CONFLICTS WITH traffic virtualservices.networking.istio.io apps.k8s.io services.k8s.io route route.core.oam.dev apps.k8s.io tls tls.core.oam.dev apps.k8s.io Workload 与 Trait Applications: - 100,000 deploys/day - 500~1000 replicas/app Function Job Container Virtual Machine Gateway Route Traffic Alert Monitor Service Binding Rollout Ingress interpretability Infra

sudo chown -R $(whoami) /usr/local/lib/pkgconfig ## VM 驱动程序 VirtualBox brew install docker-machine-driver-hyperkit ~/.kube/config ⽂件中查看所有可⽤的环境 启动 # 可添加参数 # --vm-driver=hyperkit minikube start deployment hello-node --type=LoadBalancer --port 8080 # 输出：service/hello-node exposed kubectl get services # NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE # hello-node

kubectl proxy 02-安装单机版Kubernetes 8 访问： http://localhost:8001/api/v1/namespaces/kube-system/services/https:kubernetes-dashboard:/proxy/#!/overview? namespace=default 参考： https://kubernetes.io/d $ kubectl get pods -l 'environment,environment notin (frontend)' 在API对象中设置引⽤ ⼀些Kubernetes对象（如 services 和 replicationcontrollers ）也可使⽤Label选择器来指定其他资源（例如 pods ）。 Service 和 ReplicationController 使⽤Label选择器定义 authentication and/or authorization 来保护kubelet API。 12-Master与Node的通信 34 apiserver -> nodes, pods, and services 从apiserver到Node、Pod或Service的连接默认为纯HTTP连接，因此不会被认证或加密。可通过将 https: 前缀添加到 到API URL中的Node、Pod、Ser

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential AWS 中国（宁夏）区域由西云数据运营 AWS 中国（北京）区域由光环新网运营 周琦，AWS 解决方案架构师 Amazon Elastic Kubernetes Service (EKS) 初探秘 © 2019 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential AWS 容器服务概览 镜像仓库 容器镜像保存地址 Amazon Elastic Container Registry 管理 容器化应用的部署，调度，扩 展和管理 Amazon Elastic Container Amazon EC2 AWS Fargate 服务注册发现 云端服务的黄页 AWS Cloud Map 服务网格 服务间通信的基础设施层 © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Amazon EKS于2018年6月正式发 布，已经度过了1岁生日

offline Nodes through posting Machine CRs. • Node-Operator: difference Machine and Node state, manage Node softwares and configure files. • Machine: the instance of Machine CRD with node basic information

instructions ! I have only a local machine You need an easy way ! Local-machine Solutions local-up-cluster kubeadm Minikube microk8s kubeadm-dind-cluster Local-machine Solutions https://github.com/kubernetes/minikube https://microk8s.io/ local-up-cluster Minikube Kubeadm kubeadm-dind-cluster microk8s My machine can't run Kubernetes... Oops ! Online playgrounds ! https://labs.play-with-k8s.com/ Online playgrounds

metadata: name: traefik-ingress-controller rules: - apiGroups: [""] resources: ["services","endpoints","secrets"] verbs: ["get","list","watch"] - apiGroups: ["extensions"] - web routes: - match: Host(`traefik-dashboard.xxx.com`) kind: Rule services: - name: traefik port: 8080 kubectl apply -f 6-dashboard.yaml Step7: - websecure routes: - match: Host(`k8s-dashboard.xxx.com`) kind: Rule services: - name: kubernetes-dashboard port: 443 tls: secretName: k8s-dashboard-tls