[WIP] Implement newer APIs for shuffle read and write#1

mccheah wants to merge 2 commits into

mastermccheah/ignite-shuffle-service:masterfrom

use-new-spark-apismccheah/ignite-shuffle-service:use-new-spark-apisCopy head branch name to clipboard