WIP Add higher order functions

[nvander1]

Based on changes in here apache/spark#24232.

Not ready for merge, I think there are some bugs not caught by the test yet. Need to investigate later.

Also need to test for < spark 2.4, but it should be work since we vendor spark's implementations under org.apache.spark.sql.catalyst.expressions.daria instead of referencing the ones spark provides under org.apache.spark.sql.catalyst.expressions in spark >= 2.4

cc: @manuzhang

[manuzhang]

@nvander1 It might not be worth it if we need to copy the Spark implementations for < 2.4 Spark versions and keep syncing with upstream. It's good enough to have your changes in apache/spark#24232 if they don't end up there.

[nvander1]

Yeah that’s kind of what I’m thinking. I think a good middle ground is to make just the scala API wrapper for those functions and have hen point to spark’s implementations of the functions Le mer. 22 mai 2019 à 05:00, Manu Zhang <notifications@github.com> a écrit :

…

@nvander1 <https://github.com/nvander1> It might not be worth it if we need to copy the Spark implementations for < 2.4 Spark versions and keep syncing with upstream. It's good enough to have your changes in apache/spark#24232 <apache/spark#24232> if they don't end up there. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#92>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ACXK4VZXPOUOPLVWKINPN6TPWUDUXANCNFSM4HOPYRMA> .