Support for Retrieving Streamed Output from Any Model Node in Dify's Workflow API

[EmiyaredA]

Self Checks

• I have searched for existing issues search for existing issues, including closed ones.
• I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
• Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

I would like to suggest that Dify's workflow API support retrieving the streamed output of any model node in the workflow during execution in streaming mode.
Currently, the only way to get the streamed output of a specific model is to add the model node's output variable to the final end node of the workflow.
The reason I’m raising this issue is that, in one of my use cases, I was using conditional nodes to split the workflow into different branches. Each branch called a model, and eventually, all outputs were merged at an aggregation node. In this situation, it became very difficult to access the streamed output of each model node in real time.

2. Additional context or comments

Having the ability to directly retrieve the streamed output from any model node would make the workflow API more flexible and easier to use in cases involving conditional branches or aggregation of multiple streams. This would save developers from needing to add extra steps or workarounds just to collect streamed outputs.

3. Can you help us with this feature?

• I am interested in contributing to this feature.

[dosubot]

Hi, @EmiyaredA. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

• Enhancement proposal for Dify's workflow API.
• Aim: Enable retrieval of streamed output from any model node during execution in streaming mode.
• Current workaround involves adding the model node's output to the final end node.
• No further comments or activity since the issue was opened.

Next Steps:

• Is this issue still relevant to the latest version of the Dify repository? If so, please comment to keep the discussion open.
• If no further activity occurs, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

[toddheslin]

I can confirm this is still a limitation of the workflow API. A workflow that looks like this is not streamed as I expect:

I do receive a response with text/event-stream and the different workflow events stream out, but the majority of the time is waiting for the LLM prompt to generate. The whole workflow step is sent to the event consumer after it's completed, not as it's being generated.

This differs from running the workflow inside Dify where the LLM stream shows on the screen word by word.

[dosubot]

@takatost, the user has confirmed that the limitation of the workflow API is still relevant, as they are experiencing issues with streaming output during execution. Could you please assist them with this matter?