The current FunctionCallingStepwisePlanner uses LLM "function calling" to generate a plan for an "ask" and then execute this plan. When generating the plan the FunctionCallingStepwisePlanner includes a function manual which lists the functions that the LLM can use when generating the plan. Then during the subsequent plan execution the same functions are presented to the LLM tobe used for "function calling".

We have received a lot of requests to enhance the FunctionCallingStepwisePlanner by allow changes in behaviour, customisation, use of filters to control function execution, caching of plans for reuse, ...

To address these requests our plan is to develop a sample which shows how to use "function calling" directly and recommend developers build on this sample to create their own custom function calling stepwise planner.

Sample must demonstrate the following:

• How to create a "plan" using an LLM call which includes a function manual and can be executed using automatic function calling.
• How to execute a generated "plan".
• How to analyse the telemetry for plan generation and execution. In particular be able to diagnose plans that take a long time to execute.
• How to use Filters to control the execution of functions while a plan is being executed.
• How to cache a plan so that it can be reused.