Support major version bump of google-cloud-vision and google-cloud-pubsub

[damccorm]

In our project, we want to use apache-beam, but cannot due to having these dependencies:

 

google-cloud-pubsub==2.5.0

google-cloud-vision==2.0.0

Seems like the breaking change was due to "microgenerator"

https://github.com/googleapis/python-pubsub/releases

https://github.com/googleapis/python-vision/releases

(also dropping support for older versions of python)

 

What do we need to do to increase the version support defined here: 

beam/sdks/python/setup.py

Line 199 in cd2117b

'google-cloud-vision>=0.38.0,<2',

Imported from Jira BEAM-12498. Original Jira may contain additional context.
Reported by: sangm.

[tvalentyn]

google-cloud-videointellingence also has breaking changes (#17615 ).

Things to do:

1. increase upper bound (<3), increase (lower bound>=2)
2. regenerate container dependencies
3. run postcommit integration tests that exercise these deps
4. fix any api incompatibilities.
5. run tests again
6. commit changes.

Assuming #4 doesn't require drastic changes, this shouldn't be too difficult, happy to provide further pointers if someone is interested to pick it up.

[AnandInguva]

FYi, goolge-cloud-vision was updated and other GCP libraries will be updated as part of #24599