Discovery GCE Pagination Lack

[cdmbr]

Elasticsearch Version

All

Installed Plugins

discovery-gce

Java Version

bundled

OS Version

any

Problem Description

Currently, discovery-gce plugin tries to obtain all instances for a given project/zone in one shot.
Recently I've faced in my company (that had ~ 700 instances running at the time) a weird behavior of this plugin. The google api that this plugin uses paginates results in chunks of 500 items. The current implementation is ignoring if there's a next page available.

Steps to Reproduce

• run the node discovery process in zones that have more than 500 instances

Logs (if relevant)

No response

[elasticmachine]

Pinging @elastic/es-distributed (Team:Distributed)