coding example of tasks

[emailtowalter]

Hi... running batch using CF diego task is a interesting use case to us. There are few things that we need to kick-start:

1. a sample app. Even google does not show any example on how to code a task.

2. Scale batch process. For a big job, a typical pattern is to split into multiple processes to handle part of it. It is kind of master/slaves pattern. Not sure how to do so using the task.

3)There are other capabilities required to run the batch , e.g, scheduler, notification, workflow. Do we see that is a platform capability offered by CF in future? AWS, Azure, google all have something like this.

Not sure if it is the right place to talk this. Feel free to point me to the right place.

Thanks,

[cf-gitbot]

We have created an issue in Pivotal Tracker to manage this:

https://www.pivotaltracker.com/story/show/139693955

The labels on this github issue will be updated when the story is started.

[anoop2811]

Hi @emailtowalter

We don't know of any sample apps that encode their workload as a task. You can ask in the Cloud Foundry general Slack channel to see if anyone's put one together, though.

The Cloud Controller v3 API, supports running tasks, you can find more information here

With regard to scaling the batch process, that seems more like an app concern. If the goal is simply to scale up the number of processes, you can do that internally within your task, although you're still subject to resource limits. Is your goal just to scale the number of processes, or to scale the number of tasks?

Thanks,
@anoop2811 & @bdshroyer
CF Diego engineering team

[emailtowalter]

So far, I put the executable as part of the Web package. I am using. Net core build pack. Otherwise, cf push failed. Hope to see just a sample just deploy the batch bits. for the multi processes, I agree it is app concern. But the pattern is quite standard and hope there is a framework level solution to simply the code. Does it make sense?Walter Sent from my BlackBerry 10 smartphone on the Rogers network. From: Anoop GopalakrishnanSent: Friday, February 17, 2017 5:32 PMTo: cloudfoundry/diego-releaseReply To: cloudfoundry/diego-releaseCc: emailtowalter; MentionSubject: Re: [cloudfoundry/diego-release] coding example of tasks (#272)Hi @emailtowalter We don't know of any sample apps that encode their workload as a task. You can ask in the Cloud Foundry general Slack channel to see if anyone's put one together, though. The Cloud Controller v3 API, supports running tasks, you can find more information here With regard to scaling the batch process, that seems more like an app concern. If the goal is simply to scale up the number of processes, you can do that internally within your task, although you're still subject to resource limits. Is your goal just to scale the number of processes, or to scale the number of tasks? Thanks, @anoop2811 & @bdshroyer CF Diego engineering team —You are receiving this because you were mentioned.Reply to this email directly, view it on GitHub, or mute the thread. {"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/cloudfoundry/diego-release","title":"cloudfoundry/diego-release","subtitle":"GitHub repository","main_image_url":"https://cloud.githubusercontent.com/assets/143418/17495839/a5054eac-5d88-11e6-95fc-7290892c7bb5.png","avatar_image_url":"https://cloud.githubusercontent.com/assets/143418/15842166/7c72db34-2c0b-11e6-9aed-b52498112777.png","action":{"name":"Open in GitHub","url":"https://github.com/cloudfoundry/diego-release"}},"updates":{"snippets":[{"icon":"PERSON","message":"@anoop2811 in #272: Hi @emailtowalter \r\n\r\nWe don't know of any sample apps that encode their workload as a task. You can ask in the Cloud Foundry [general Slack channel](https://cloudfoundry.slack.com/messages/general/) to see if anyone's put one together, though.\r\n\r\nThe Cloud Controller v3 API, supports running tasks, you can find more information [here](https://docs.cloudfoundry.org/devguide/using-tasks.html) \r\n\r\nWith regard to scaling the batch process, that seems more like an app concern. If the goal is simply to scale up the number of processes, you can do that internally within your task, although you're still subject to resource limits. Is your goal just to scale the number of processes, or to scale the number of tasks?\r\n\r\nThanks,\r\n@anoop2811 \u0026 @bdshroyer \r\nCF Diego engineering team\r\n"}],"action":{"name":"View Issue","url":"#272 (comment)"}}}

[emalm]

Hi, @emailtowalter,

Are you interested in submitting tasks directly to the Diego BBS API, or via the recent support for tasks in the Cloud Controller API? If you mean the BBS API, then some of the BBS API docs may be of interest to you. If you mean the CC API, you should instead check out the v3 CC API docs.

Individual Diego tasks support setting a completion-callback URL to send a notification on task completion, but to my knowledge there's no analogous mechanism for that notification in the CC API. I'm also not aware of any CF component or project that will manage more sophisticated task workflows based on these one-off units of work: for the time being, you need to arrange that scheduling client-side.

Thanks,
Eric, CF Diego PM

[emalm]

Closing due to inactivity.