file_processing

AWS Flow Framework for Ruby: FileProcessing Sample Application

The FileProcessing sample demonstrates a media processing use case. The workflow downloads a file from an Amazon S3 bucket, creates a .zip file and then uploads the file back to Amazon S3. The task routing feature in Amazon SWF is illustrated in this sample.

Downloading the Sample Code

To view or download the code for all of the AWS Flow Framework for Ruby recipes and samples, go to:

• https://github.com/awslabs/aws-flow-ruby-samples

Prerequisites for Running the Samples

The AWS Flow Framework for Ruby is required, which can be obtained and installed using the information here:

• https://aws.amazon.com/swf/flow/

If you already have Ruby and RubyGems installed, you can install the framework and all of the gems required by the samples by opening a terminal window, changing to the directory where you've cloned or downloaded the samples, and typing:

bundle install

This will install all of the requirements that are listed in the Gemfile in the repository's base directory.

For more information about setting up the AWS Flow Framework for Ruby, see Installing the AWS Flow Framework for Ruby in the AWS Flow Framework for Ruby Developer Guide.

Note: For the FileProcessing sample, you will also need to modify the file file_processing_utils.rb, changing the value of TARGET_BUCKET to an Amazon S3 bucket name that is owned by your account.

Run the Sample

To run the FileProcessing sample:

1. Open four separate terminal windows and, in each one, change to the lib directory in the location where you cloned or unarchived the sample code. For example:

   cd ~/Downloads/aws-flow-ruby-samples/samples/file_processing/lib
   

2. In each command-line (terminal) window, execute the following commands, substituting your AWS Access keys for the example values.

   On Linux, OS X or Unix:

   export AWS_ACCESS_KEY_ID='your-access-key'
   export AWS_SECRET_ACCESS_KEY='your-secret-key'
   export AWS_REGION='your-aws-region'
   

   On Windows:

   set AWS_ACCESS_KEY_ID=your-access-key
   set AWS_SECRET_ACCESS_KEY=your-secret-key
   set AWS_REGION=your-aws-region
   

3. Execute the following commands, one in each of the terminal windows:

   ruby host_specific_worker.rb
   
   ruby common_tasklist_worker.rb
   
   ruby file_processing_workflow.rb
   
   ruby file_processing_workflow_starter.rb
   

For More Information

For more information about the Amazon Simple Workflow service and the Amazon Flow Framework for Ruby, consult the following resources:

• AWS Flow Framework for Ruby Developer Guide
• AWS Flow Framework for Ruby API Reference
• AWS Flow Framework
• Amazon Simple Workflow Service