when does dataflow streaming auto-scaling start?

Regarding the autoscaling chart.

  • Current workers – Number of workers currently used by the pipeline
  • Target workers – Number of workers suggested by the Dataflow autoscaling algorithm. Could be an upscale or a downscale. Pipeline is trying to achieve this.

Regarding time for scaling decision, I don’t think there’s an exact guarantee provided by the Dataflow service here. Please refer to the Streaming Autoscaling related documentation here. If you think if there’s an issue related to autoscaling, please contact Dataflow support so that that they can look into your specific pipeline.

CLICK HERE to find out more related problems solutions.

Leave a Comment

Your email address will not be published.

Scroll to Top