Apache Spark Connect Client for JavaScript

An experimental client for Spark Connect for Apache Spark written in TypeScript.

Roadmaps

• For minor changes or some features associated with certern classes, SEARCH 'TODO'
• Support Retry / Reattachable execution
• Support Checkpoint for DataFrame
• Support DataFrameNaFunctions
• Support DataFrame Join
• Support UserDefinedType
  • UserDefinedType declaration
  • UserDefinedType & Proto bidi-converions
  • UserDefinedType & Arrow bidi-converions
• Maybe Optimize the Logging or it's framework