Producers can generate events in a higher rate than the rate consumers can process events. 2 ??? Vasiliki Kalavri | Boston University 2020 Keeping up with the producers • Producers can generate events in 2 ??? Vasiliki Kalavri | Boston University 2020 Keeping up with the producers • Producers can generate events in a higher rate than the rate consumers can process events. • What happens if consumers 2 ??? Vasiliki Kalavri | Boston University 2020 Keeping up with the producers • Producers can generate events in a higher rate than the rate consumers can process events. • What happens if consumers

onment.getExecutionEnvironment env.setStreamTimeCharacteristic(TimeCharacteristic.EventTime) // generate watermarks every 5 seconds env.getConfig.setAutoWatermarkInterval(5000) Watermarks in Flink 18 stream val readings: DataStream[Reading] = env.addSource(new SensorSource) // assign timestamps and generate watermarks .assignTimestampsAndWatermarks(new MyAssigner()) Using a watermark assigner 21 Vasiliki

arrives: • if the user is sampled: add the query to S • if we haven’t seen the user before: generate a random integer ru between 0 and 9 and add the user to the sample if ru = 0. ??? Vasiliki Kalavri arrives: • if the user is sampled: add the query to S • if we haven’t seen the user before: generate a random integer ru between 0 and 9 and add the user to the sample if ru = 0. Do we need to keep

deployed in different locations inside a forest. The sensors monitor temperature and smoke levels and generate a measurement every 5 seconds. Write a program that every 1 minute emits the average temperature