GPU Resource Management On JDOS 梁永清 liangyongqing1@jd.com 提供的服务 1. 用于实验的 GPU 容器 2.基于 Kubeflow 的机器学习训练服务 3.模型管理和模型 Serving 服务 Experiment Training Serving 均基于容器，不对业务方直接提供 GPU 物理机 GPU 实验 JDOS 常规的容器服务

Helm Chart Support • Helm Chart repository • Same mechanism and user experiences with image management Multi Deployments • Docker Compose • BOSH/Pivotal Tile • Helm Chart Label • Label in project Service Harbor components 3rd party components SQL Database Key/Value Storage Persistence components Local or Remote Storage (block, file, object) Users (GUI/API) Container Schedulers/Runtimes features harbor should provide? Q2: How does the Harbor architecture evolve? Q3: How to converge management of image and chart? Q4: Is it reasonable to involve day0 operation in Harbor? Website ： https://github

language • Secure: Minimal hardware emulation • Flexible: Easy to customize to fit various network, storage and OS environments • High-performance: Leverage KVM capability Advantage of Rust-VMM • Google correctness and performance • Compiled to native code offering performance similar to C • Memory management without garbage collection • Designed for systems programming Rust is a multi-paradigm programming image: nginx EOT Rust- VMM Demo Future Works • Extend Rust-VMM to support networking and storage • Security policy integration • Develop a new fully Rust-based runtime for edge computing • Support

n" metadata: name: "demo-01" spec: configuration: clusters: - name: "demo" Здесь нет storage Еще вернемся к этому kubectl – наше всё 1. NAMESPACE $ kubectl create namespace demo namespace/demo Persistent Storage apiVersion: "clickhouse.altinity.com/v1" kind: "ClickHouseInstallation" metadata: name: "storage" spec: defaults: templates: volumeClaimTemplate: storage-vc-template name: storage-vc-template persistentVolumeClaim: spec: accessModes: - ReadWriteOnce resources: requests: storage: 2Gi

in Software Engineering Mike Ballou“There is no single development, in either technology or management technique, which by itself promises even one order-of- magnitude improvement within a decade abstract away its complexity often abstract away its essence • Not only technical problems but management problems as well comes from the complexity • It creates the tremendous learning and understanding I can help them I need…” • to Containerize the software, but to run that I need… • a Container Management Platform, but to network it I need… • a Service Mesh, but to secure it I need… • an automated Certificate

LiveSync, Debugging, Starter Kits o Plugins Management o Visual Studio Integration Coming o Public Beta Now! WHY: Easier bootstrapping, no SDK management, Easy debugging WHO: Windows developers, Visua

boundary.Memory model https://gchandbook.org/ Garbage collection is really “automatic memory management”. - Reference counted - C++ – std::shared_ptr - Python - Objective-C (manual or automatic - COM – AddRef()/Release() - Non-Reference counted - .NET - JVM - JavaScript Manual memory management is rarely advocated for anymore.Memory model – Manual Memory is allocated and deallocated directly

互联网企业的发展模式 Web3? So-called Web3 ？ Where is the Next Stage ★ Blockchain ★ Decentralized Ledger Storage: MPT (Merkle Patricia Tree) ★ K-V database ★ Smart Contract ★ Serverless The Weapons Web3 Utilizes stage of Internet? Or just a gimmick by cloud platform ➔ Wants to extend the financial computation/storage model to general cases • Limites of On-chain VM computation • Limites of MPT • Limites of K-V

下一次 Handle Await Tree 的实现 Await Tree 的设计原理与实现 • 一棵树代表一个 Task 的执行状态 • Task 单线程执行 • 在 Task-Local Storage 中无竞争维护 • 使用 Arena Tree 简化实现 • 无 Unsafe 代码 Await Tree 的实现 Await Tree 的设计原理与实现 • Future Adapter risingwave.com • GitHub 4.5k Stars • “Materialized View” • 计算：分布式流计算任务，实时增量维护 • 存储： S3 上的 Shared-storage 存储状态和数据 Await Tree 在 RisingWave 中的应用 • 技术挑战 • 计算任务需长期执行，稳定性要求高 • 算子逻辑复杂，计算与存储读写穿插，强依赖 Async •

索性把坐标和值打包成 tuple ，存储在 vector 按行压缩（ Compressed Row Storage ） http://www.netlib.org/linalg/html_templates/node91.html 按行压缩（ Compressed Row Storage ） http://www.netlib.org/linalg/html_templates/node91