Functionbeat 7.9.0 deploy failure on GCP

[aschifman]

Deploying functionbeat 7.9.0 fails after the following command:

./functionbeat -v -e -d "*" deploy storage

Error output:

Function: storage, could not deploy, error: error while creating function (code: 3):
Build failed: src/storage/storage.go:11:2: cannot find package "github.com/elastic/beats/v7/libbeat/beat" in any of:
        /usr/local/go/src/github.com/elastic/beats/v7/libbeat/beat (from $GOROOT)
        /workspace/src/github.com/elastic/beats/v7/libbeat/beat (from $GOPATH)"

Many additional lines similar to above and finishes with...

Fail to deploy 1 function(s)"

For confirmed bugs, please report:

• Version: functionbeat-7.9.0-linux-x86_64
• Operating System: CentOS-6-1
• Discuss Forum URL: spoke with Noémi Ványi through slack #beats
• Steps to Reproduce: I can see same results with MacOS laptop and GCP provisioned CentOS VM. Previous 7.8.1 version using the same credentials file and functionbeat.yml file succeeded with following output:

2020-08-27T14:43:11.850Z        DEBUG   [gcp.executor]  executor/executor.go:68 All operations successful
2020-08-27T14:43:11.850Z        DEBUG   [gcp]   gcp/cli_manager.go:50   Successfully created function 'storage'
2020-08-27T14:43:11.850Z        DEBUG   [gcp]   gcp/cli_manager.go:51   Deploy finish for function 'storage'
Function: storage, deploy successful
2020-08-27T14:43:11.850Z        DEBUG   [cli-handler]   cmd/cli_handler.go:64   Deploy execution ended"  

[elasticmachine]

Pinging @elastic/integrations-services (Team:Services)

[rayward]

I'm getting a whole bunch of package missing errors as well (though trying to deploy for pubsub).

Is this because of the cut over to go modules @kvch?

Should ./functionbeat be generating a go.mod file to be bundled into the package?

I tried

go mod init github.com/elastic/beats/v7
go mod tidy

but the deploy command won't include go.mod and go.sum

[kvch]

@rayward Yes, the issue exists because of go modules. However, we need to go back to vendoring because the Beats framework supports only Golang 1.14. This seems to be incompatible with the Go 1.13 environment on GCP.

[rayward]

@aschifman I was able to deploy with 7.7.1 of functionbeat

edit: though i now just get Exiting: error loading config file: open functionbeat.yml: no such file or directory :(

[rayward]

@kvch I thought 1.13 supported go modules, and GCP supports this - https://cloud.google.com/functions/docs/writing/specifying-dependencies-go

[aschifman]

Thanks @rayward. Please try with 7.8.1 if you can, it had worked for me.