Skip to content

[Feat] Implement GraphAr Spark Writer for writing Spark DataFrame into GAR format files #28

@acezen

Description

@acezen

Is your feature request related to a problem? Please describe.
Implement writer of Spark tool to provide functions to generate GraphAr format files from hive table.

Describe the solution you'd like
It's better to read hive table as a spark DataFrame and use operators of DataFrame to generate the files.
The writer should include VertexWriter and EdgeWriter.

  • VertexWriter provide functions to generate chunk files of property group base on the vertex info user defined
  • EdgeWriter provide function to generate chunk files of adj list/offset/property group base on the edge info that user defined

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions