What happens to messages when a stream analytics job is stopped and start again after some time.
What are the decisions that impact this. Here are few options that are necessary to consider.
Refer to diagram below.
1. Now - when this option is chosen, it will pickup messages that are ingested now on wards. All messages which got ingested into system when job was stopped will not be picked up.
2. Custom - You can specify the time from which you want to pick messages. Let's say job was stopped for 4 hours, so you want to select messages during that time, in case you can choose this option.
3. When last stopped - This option will enable the job to pick up messages which were ingested even when job was stopped, From last run of the job, it keeps are checkpoint and hence pick up messages post that checkpoint.
Usual recommendation option is "When last stopped", But your choice may vary as per your requirement.
What are the decisions that impact this. Here are few options that are necessary to consider.
Refer to diagram below.
2. Custom - You can specify the time from which you want to pick messages. Let's say job was stopped for 4 hours, so you want to select messages during that time, in case you can choose this option.
3. When last stopped - This option will enable the job to pick up messages which were ingested even when job was stopped, From last run of the job, it keeps are checkpoint and hence pick up messages post that checkpoint.
Usual recommendation option is "When last stopped", But your choice may vary as per your requirement.
No comments:
Post a Comment