semantics, and guarantees Vasiliki Kalavri | Boston University 2020 Today’s topics • High-availability and fault-tolerance in distributed stream processing • Recovery semantics and guarantees • Exactly-once of the primary and O’ the output produced by the secondary after recovery. • Precise recovery guarantees Of + O’ = Oe • Rollback recovery allows duplicate tuples downstream: • repeating: duplicate Kalavri | Boston University 2020 Processing guarantees and result semantics 11 sum 4 3 2 1 0 … Vasiliki Kalavri | Boston University 2020 Processing guarantees and result semantics 11 sum 4 3 2 1 …

clients more uses are legal strict rules for clients more uses are bugs postcondition fewer guarantees to clients more implementer flexibility© 2023 Adobe. All Rights Reserved. What's in a “strong strict rules for clients more uses are bugs postcondition fewer guarantees to clients more implementer flexibility more guarantees to clients less implementer flexibility© 2023 Adobe. All Rights Reserved strict rules for clients more uses are bugs postcondition fewer guarantees to clients more implementer flexibility more guarantees to clients less implementer flexibility© 2023 Adobe. All Rights Reserved

Exception Handling When to Use Exceptions (And When Not) How to Use Exceptions The Exception Safety Guarantees How to Write Exception-Safe Code How to Refactor Non-Exception-Safe CodeContent 4 The Exception Exception Handling When to Use Exceptions (And When Not) How to Use Exceptions The Exception Safety Guarantees How to Write Exception-Safe Code How to Refactor Non-Exception-Safe CodeWhy Another Talk on Exception Exception Handling When to Use Exceptions (And When Not) How to Use Exceptions The Exception Safety Guarantees How to Write Exception-Safe Code How to Refactor Non-Exception-Safe CodeHow Do Exceptions Work

(Is all about “Guarantees”) • System/Subsystem Design (Defines API boundaries and behavior) • Implementation details (e.g., “lock-free” and “wait-free” algorithms provide guarantees for system-wide (Is all about “Guarantees”) • System/Subsystem Design (Defines API boundaries and behavior) • Implementation details (e.g., “lock-free” and “wait-free” algorithms provide guarantees for system-wide (Is all about “Guarantees”) • System/Subsystem Design (Defines API boundaries and behavior) • Implementation details (e.g., “lock-free” and “wait-free” algorithms provide guarantees for system-wide

of the component space • Semantically based interoperability guarantees • Efficient • No penalty for generality • Complexity guarantees at the interface level • Natural • C/C++ machine model and programming of the component space • Semantically based interoperability guarantees • Efficient • No penalty for generality • Complexity guarantees at the interface level • Natural • C/C++ machine model and programming Basics: Classic STL Copyright © 2021 Bob Steagall Complexity and Interfaces • STL makes complexity guarantees by specifying interfaces and requirements • Containers provide support for • Adding / removing

Isolation Detecting Broker Issues (Critical Analysis) Resource Manager Configuration Flow Control Guarantees of sends and commits 1 1.28 1.29 1.30 1.31 1.32 1.33 1.34 1.35 1.36 1.37 1.38 1.39 messaging system ensures that a copy of each news message is delivered to each subscription. Delivery guarantees A key feature of most messaging systems is reliable messaging. With reliable messaging the server Messaging Concepts 10 same stock. The messaging system allows you to configure which delivery guarantees you require. Transactions Messaging systems typically support the sending and acknowledgement

Detecting Slow Consumers Avoiding Network Isolation Resource Manager Configuration Flow Control Guarantees of sends and commits Message Redelivery and Undelivered Messages 1 1.28 1.29 1.30 1.31 1 messaging system ensures that a copy of each news message is delivered to each subscription. Delivery guarantees A key feature of most messaging systems is reliable messaging. With reliable messaging the server Messaging Concepts 10 same stock. The messaging system allows you to configure which delivery guarantees you require. Transactions Messaging systems typically support the sending and acknowledgement

Detecting Slow Consumers Avoiding Network Isolation Resource Manager Configuration Flow Control Guarantees of sends and commits Message Redelivery and Undelivered Messages 1 1.28 1.29 1.30 1.31 1 messaging system ensures that a copy of each news message is delivered to each subscription. Delivery guarantees A key feature of most messaging systems is reliable messaging. With reliable messaging the server Messaging Concepts 10 same stock. The messaging system allows you to configure which delivery guarantees you require. Transactions Messaging systems typically support the sending and acknowledgement

Connections 19. Detecting Slow Consumers 20. Resource Manager Configuration 21. Flow Control 22. Guarantees of sends and commits 23. Message Redelivery and Undelivered Messages 24. Message Expiry 25. the next update on the same stock. The messaging system allows you to configure which delivery guarantees you require. Messaging systems typically support the sending and acknowledgement of multiple global transaction - using the Java mapping of XA: JTA. The Publish-Subscribe Pattern Delivery guarantees Transactions ActiveMQ Artemis Documentation 8 Messaging Concepts Messages are either durable

Isolation Detecting Broker Issues (Critical Analysis) Resource Manager Configuration Flow Control Guarantees of sends and commits Message Redelivery and Undelivered Messages Message Expiry Large Messages messaging system ensures that a copy of each news message is delivered to each subscription. Delivery guarantees A key feature of most messaging systems is reliable messaging. With reliable messaging the server the next update on the same stock. The messaging system allows you to configure which delivery guarantees you require. Transactions Messaging systems typically support the sending and acknowledgement