Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support MapR security in skein #234

Open
pkvprakash opened this issue Aug 31, 2021 · 1 comment · May be fixed by #235
Open

Support MapR security in skein #234

pkvprakash opened this issue Aug 31, 2021 · 1 comment · May be fixed by #235

Comments

@pkvprakash
Copy link

Kerberos ticket verification fails in MapR distribution of hadoop. We need to handle this case separately in Driver.java such that skein can work on MapR distribution of hadoop as well. This will open up lot of other tools like Ray, Dask also to work in distributed mode with yarn.

Related issues: dask/dask-yarn#70
@pkvprakash
Copy link
Author

I am working on a fix if this is something that can be included in the codebase.

pkvprakash pushed a commit to pkvprakash/skein that referenced this issue Aug 31, 2021
feat(mapr): support mapr security
ef38cfc 
This commit is to support running skein in mapr secure cluster.
The version suported is mapr data fabric 6.1.0

This commit introduces a check in Driver class for MapR distribution.
Then use ClientSecurity class to check if the user has a valid
MapR ticket available for job submission.

Fixes jcrist#234
@pkvprakash pkvprakash linked a pull request Aug 31, 2021 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat(mapr): support mapr security pkvprakash/skein
1 participant
@pkvprakash