Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Factor analysis step caching into separate package #12

Closed
ghing opened this issue Nov 23, 2015 · 2 comments
Closed

Factor analysis step caching into separate package #12

ghing opened this issue Nov 23, 2015 · 2 comments

Comments

@ghing
Copy link

ghing commented Nov 23, 2015

I like the idea behind proof, but find the step chaining cumbersome in some cases. I know this isn't very constructive feedback and I'm still working out exactly which cases these are. Rather than feature requesting and making the tool more opinionated about workflow, I'm wondering if the caching logic/API could be factored out into a separate package, allowing the persisting of data and passing it between steps to work using a different task runner, such as invoke.

Factoring this out into a separate package could also parameterize this operation, one day allowing power users to address #11 by serializing to a different format assuming their data is easily serialized as JSON (or something else).

@onyxfish
Copy link
Collaborator

Hmm, I don't have a clear idea of what you have in mind here. I have also sometimes found the chaining to be cumbersome, though my gut says that is going to be true of any procedural workflow. A declarative syntax like flo uses is somewhat tidier, though at the cost of being more verbose for simple workflows.

I'd rather not over-specify proof if there isn't a particular goal in mind. I think it's niche is the quick-and-dirty one-file workflows. There are a lot of task runners out there for doing more elaborate processing. Happy to hear dissenting opinions, of course, but don't want to split it up unless a compelling case has been documented.

@jpmckinney
Copy link
Member

jpmckinney commented Oct 23, 2023

Not sure that there's a specific request, so closing.

I also can't tell the difference between this and #14.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants