Apache Beam 2.19.0 Not Running On Cloud Dataflow Anymore Due To Could Not Find A Version That Satisfies The Requirement Setuptools>=40.8

October 03, 2023 Post a Comment

Since a few days our python dataflow jobs result in an error on worker startup: 'ERROR: Could not find a version that satisfies the requirement setuptools>=40.8.0 (from version

Solution 1:

I had the same issue than yours. To fix it, I added setuptools in the requirements.txt and make sure it is ordered before apache-beam.

Solution 2:

The Deprecated package changed from Deprecated-1.2.7 to Deprecated-1.2.8, which caused the error. Dataflow workers run with setuptools 45.1.0 for python 3.5.9, so installing another version through the updated Deprecated package resulted in an error.

Baca Juga

Google Cloud Dataflow Write To Csv From Dictionary
Dataflow/apache Beam: Manage Custom Module Dependencies
How To Trigger A Dataflow With A Cloud Function? (python Sdk)

Introduction to Python Course

Apache Beam 2.19.0 Not Running On Cloud Dataflow Anymore Due To Could Not Find A Version That Satisfies The Requirement Setuptools>=40.8

Solution 1:

Solution 2:

Post a Comment for "Apache Beam 2.19.0 Not Running On Cloud Dataflow Anymore Due To Could Not Find A Version That Satisfies The Requirement Setuptools>=40.8"