Fault-tolerance demo & reconfiguration - CS 591 K1: Data Stream Processing and Analytics Spring 2020
keyed state are scaled by repartitioning keys • Operators with operator list state are scaled by redistributing the list entries. • Operators with operator broadcast state are scaled up by copying the The number of key groups limits the maximum number of parallel tasks to which keyed state can be scaled. • Trade-off between flexibility in rescaling and the maximum overhead involved in indexing and0 码力 | 41 页 | 4.09 MB | 1 年前3Flow control and load shedding - CS 591 K1: Data Stream Processing and Analytics Spring 2020
throughput matches the data input rate • In the case of known aggregation functions, results can be scaled using approximate query processing techniques, where accuracy is measured in terms of relative error0 码力 | 43 页 | 2.42 MB | 1 年前3Elasticity and state migration: Part I - CS 591 K1: Data Stream Processing and Analytics Spring 2020
restart • only temporarily block the affected dataflow subgraph • usually the operator to be scaled and upstream channels • All-at-once • move state to be migrated in one operation • high latency0 码力 | 93 页 | 2.42 MB | 1 年前3
共 3 条
- 1