Remote Execution Caching Compiler (RECC) CppCon 2024 September 19, 2024 Shivam Bairoliya Software Engineer© 2024 Bloomberg Finance L.P. All rights reserved. What is RECC? ● Remote Execution Caching source build tool that wraps compiler commands and optionally forwards them to a remote build execution service ○ Encompasses the capabilities of both ccache and distcc ○ Supports remote linking and CC) ○ Supports multiple operating systems (Linux, macOS, Solaris) ● Compatible with any remote execution API server supported by Bazel ○ Single Host Server/Proxy: BuildBox-CASD ○ Distributed Server:

rights reserved. Presenter: Haichen Shen, Yao Wang Amazon SageMaker Neo, Deep Engine Science Dynamic Model in TVM AWS AI© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Models with models© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Support dynamic model in TVM ● Support Any-dim in typing ● Use shape function to compute the type at runtime ● Virtual input_name = "data" input_shape = [tvm.relay.Any(), 3, 224, 224] dtype = "float32" block = get_model('resnet50_v1', pretrained=True) mod, params = relay.frontend.from_mxnet(block, shape={input_name:

Model and Operate Datacenter by Kubernetes at eBay 辛肖刚, Cloud Engineering Manager, ebay 梅岑恺, Senior Operation Manager, ebay Agenda About ebay Our fleet Kubernetes makes magic at ebay Model + Controller Controller How we model our datacenter Operation in large scale Q&A About ebay 177M Active buyers worldwide $22.7B Amount of eBay Inc. GMV $2.6B Reported revenue 62% International revenue 1.1B Kubernetes Onboard Provision Configuration Kubernetes You need onboard something from nothing! Let’s model a datacenter running Kubernetes Onboard Provision Configuration Kubernetes After you define your

manually split up data amongst GPUs / nodes - High-level mechanisms for data distribution / execution necessary. CPU NIC GPU GPU GPU GPU Xe LinkMulti-GPU Systems - NUMA regions: - 4+ GPUs distributed algorithms - Achieve high performance for both multi-GPU, NUMA, and multi-node execution float dot_product(vector& x, vector& y) { auto z = views::zip(x Operate on and modify data using namespace std; using namespace std::ranges; using namespace std::execution; template auto dot_product(R&& x, R&& y) { using T = range_value_t; auto z =

The Future of Cloud Native Applications with Open Application Model (OAM) and Dapr @markrussinovich Application models Describes the topology of your application and its components The way developers services and data stores Programming models Distributed Application Runtime (Dapr) Open Application Model (OAM) https://oam.dev State of Cloud Native Application Platforms Kubernetes for applications of concerns Application focused Application focused Container infrastructure Open Application Model Service Job Namespace Secret Volume Endpoint ConfigMap VolumeAttach CronJob Deployment

Memory Model C++11 – C++23About Me: alex.dathskovsky@speedata.io www.linkedin.com/in/alexdathskovsky https://www.cppnext.comAlex Dathskovsky | alex.dathskovsky@speedata.io | www.linkedin.com/in/a ExecutionAlex Dathskovsky | alex.dathskovsky@speedata.io | www.linkedin.com/in/alexdathskovsky INO Execution • instruction fetch • if operands available execute it if not fetch them • The instruction is ExecutionAlex Dathskovsky | alex.dathskovsky@speedata.io | www.linkedin.com/in/alexdathskovsky OOO Execution Source:: https://www.semanticscholar.org/paper/RISC-V-Reward:-Building-Out-of-Order-Processo

Efficient Mixture-of-Experts Language Model DeepSeek-AI research@deepseek.com Abstract We present DeepSeek-V2, a strong Mixture-of-Experts (MoE) language model characterized by economical training and DeepSeek-V2 and its chat versions still achieve top-tier performance among open-source models. The model checkpoints are available at h t t p s : / / g i t h u b . c o m / d e e p s e e k - a i / D e e p Work 21 A Contributions and Acknowledgments 27 B DeepSeek-V2-Lite: A 16B Model Equipped with MLA and DeepSeekMoE 29 2 B.1 Model Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Advantages of the Spring Framework’s transaction support model Global transactions Local transactions Spring Framework’s consistent programming model Understanding the Spring Framework transaction abstraction @ModelAttribute on a method Using @ModelAttribute on a method argument Using @SessionAttributes to store model attributes in the HTTP session between requests Using @SessionAttribute to access pre-existing global Security Convention over configuration support The Controller ControllerClassNameHandlerMapping The Model ModelMap (ModelAndView) Default view name HTTP caching support Cache-Control HTTP header HTTP caching

Advantages of the Spring Framework’s transaction support model Global transactions Local transactions Spring Framework’s consistent programming model Understanding the Spring Framework transaction abstraction @ModelAttribute on a method Using @ModelAttribute on a method argument Using @SessionAttributes to store model attributes in the HTTP session between requests Using @SessionAttribute to access pre-existing global Security Convention over configuration support The Controller ControllerClassNameHandlerMapping The Model ModelMap (ModelAndView) The View - RequestToViewNameTranslator HTTP caching support Cache-Control

method parameters with @RequestParam .............. 350 13.11.6. Providing a link to data from the model with @ModelAttribute ......................... 351 13.11.7. Specifying attributes to store in a Session method parameters with @RequestParam ............... 415 16.9.6. Providing a link to data from the model with @ModelAttribute ........................... 415 16.9.7. Specifying attributes to store in a Session package provides a Model-View-Controller (MVC) implementation for web-applications. Spring's MVC framework is not just any old implementation; it provides a clean separation between domain model code and web