This repository was archived by the owner on Jan 9, 2020. It is now read-only.

Prep for alpha release#177

Merged

ash211 merged 81 commits intobranch-2.1-kubernetesfrom

prep-for-alpha-release

Mar 16, 2017

Commits on Mar 8, 2017

[SPARK-18278] Minimal support for submitting to Kubernetes.

mccheah
authored and
ash211
committed
Fix style

mccheah
authored and
ash211
committed
Make naming more consistent

mccheah
authored and
ash211
committed
Fix building assembly with Kubernetes.

mccheah
authored and
ash211
committed
Service account support, use constants from fabric8 library.

mccheah
authored and
ash211
committed
Some small changes

mccheah
authored and
ash211
committed
Use k8s:// formatted URL instead of separate setting.

mccheah
authored and
ash211
committed
Reindent comment to conforn to JavaDoc style

foxish
authored and
ash211
committed
Move kubernetes under resource-managers folder.

mccheah
authored and
ash211
committed
Use tar and gzip to compress+archive shipped jars (#2)

mccheah
authored and
ash211
committed
Use alpine and java 8 for docker images. (#10)

mccheah
authored and
ash211
committed
Copy the Dockerfiles from docker-minimal-bundle into the distribution. (#12)

mccheah
authored and
ash211
committed
inherit IO (#13)

foxish
authored and
ash211
committed
Error messages when the driver container fails to start. (#11)

mccheah
authored and
ash211
committed
Fix linter error to make CI happy (#18)

foxish
authored and
ash211
committed
Documentation for the current state of the world (#16)

mccheah
authored and
ash211
committed
Development workflow documentation for the current state of the world. (#20)

mccheah
authored and
ash211
committed
Added service name as prefix to executor pods (#14)

foxish
authored and
ash211
committed
Add kubernetes profile to travis CI yml file (#21)

kimoonkim
authored and
ash211
committed
Improved the example commands in running-on-k8s document. (#25)

lins05
authored and
ash211
committed
Fix spacing for command highlighting (#31)

foxish
authored and
ash211
committed
Support custom labels on the driver pod. (#27)

mccheah
authored and
ash211
committed
Make pod name unique using the submission timestamp (#32)

foxish
authored and
ash211
committed
A number of small tweaks to the MVP. (#23)

mccheah
authored and
ash211
committed
Correct hadoop profile: hadoop2.7 -> hadoop-2.7 (#41)
ash211
committed
Support setting the driver pod launching timeout. (#36)

lins05
authored and
ash211
committed
Sanitize kubernetesAppId for use in secret, service, and pod names (#45)
ash211
committed
Support spark.driver.extraJavaOptions (#48)

kimoonkim
authored and
ash211
committed
Use "extraScalaTestArgs" to pass extra options to scalatest. (#52)

lins05
authored and
ash211
committed
Use OpenJDK8's official Alpine image. (#51)

mccheah
authored and
ash211
committed
Remove unused driver extra classpath upload code (#54)

mccheah
authored and
ash211
committed
Fix k8s integration tests (#44)

lins05
authored and
ash211
committed
Added GC to components (#56)

foxish
authored and
ash211
committed
Create README to better describe project purpose (#50)
ash211
committed
Access the Driver Launcher Server over NodePort for app launch + submit jars (#30)

mccheah
authored and
ash211
committed
Extract constants and config into separate file. Launch => Submit. (#65)

mccheah
authored and
ash211
committed
Retry the submit-application request to multiple nodes (#69)

mccheah
authored and
ash211
committed
Allow adding arbitrary files (#71)

mccheah
authored and
ash211
committed
Fix NPE around unschedulable pod specs (#79)
ash211
committed
Introduce blocking submit to kubernetes by default (#53)
ash211
committed
Do not wait for pod finishing in integration tests. (#84)

lins05
authored and
ash211
committed
Check for user jars/files existence before creating the driver pod. (#86)

lins05
authored and
ash211
committed
Use readiness probe instead of client-side ping. (#75)

mccheah
authored and
ash211
committed
Note integration tests require Java 8 (#99)
ash211
committed
Bumping up kubernetes-client version to fix GKE and local proxy (#105)

foxish
authored and
ash211
committed
Truncate k8s hostnames to be no longer than 63 characters (#102)
ash211
committed
Fixed loading the executors page through the kubectl proxy. (#95)

lins05
authored and
ash211
committed
Filter nodes to only try and send files to external IPs (#106)

foxish
authored and
ash211
committed
Parse results of minikube status more rigorously (#97)
ash211
committed
Adding legacyHostIP to the list of IPs we look at (#114)

foxish
authored and
ash211
committed
Add -DskipTests to dev docs (#115)
ash211
committed
Shutdown the thread scheduler in LoggingPodStatusWatcher on receiving job finish event notifications (#121)

varunkatta
authored and
ash211
committed
Trigger scalatest plugin in the integration-test phase (#93)

kimoonkim
authored and
ash211
committed
Fix issue with DNS resolution (#118)

foxish
authored and
ash211
committed
Change the API contract for uploading local files (#107)

mccheah
authored and
ash211
committed
Optionally expose the driver UI port as NodePort (#131)

kimoonkim
authored and
ash211
committed
Set the REST service's exit code to the exit code of its driver subprocess (#138)
ash211
committed
Pass the actual iterable from the option to get files (#139)

mccheah
authored and
ash211
committed
Use a separate class to track components that need to be cleaned up (#122)

mccheah
authored and
ash211
committed
Enable unit tests in Travis CI build (#132)

kimoonkim
authored and
ash211
committed
Change driver pod's restart policy from OnFailure to Never (#145)
ash211
committed
Extract SSL configuration handling to a separate class (#123)

mccheah
authored and
ash211
committed
Exclude known flaky tests (#156)

kimoonkim
authored and
ash211
committed
Richer logging and better error handling in driver pod watch (#154)

foxish
authored and
ash211
committed
Document blocking submit calls (#152)
ash211
committed
Allow custom annotations on the driver pod. (#163)

mccheah
authored and
ash211
committed
Update client version & minikube version (#142)

foxish
authored and
ash211
committed
Allow customizing external URI provision + External URI can be set via annotations (#147)

mccheah
authored and
ash211
committed
Remove okhttp from top-level pom (#166)

foxish
authored and
ash211
committed
Allow setting memory on the driver submission server. (#161)

mccheah
authored and
ash211
committed
Add a section for prerequisites (#171)

foxish
authored and
ash211
committed
Add instructions to find master URL (#169)

foxish
authored and
ash211
committed
Propagate exceptions (#172)

mccheah
authored and
ash211
committed
Logging for resource deletion (#170)
ash211
committed

Commits on Mar 14, 2017

Fix pom versions (#178)
foxish
authored

Commits on Mar 15, 2017

Exclude flaky ExternalShuffleServiceSuite from Travis (#185)

kimoonkim
authored and
ash211
committed

Commits on Mar 16, 2017

Fix lint-check failures and javadoc8 break (#187)

ash211
authored and
foxish
committed
Docs improvements (#176)

foxish
authored and
ash211
committed
Add Apache license to a few files (#175)
ash211
committed
Adding clarification pre-alpha (#181)

foxish
authored and
ash211
committed
Allow providing an OAuth token for authenticating against k8s (#180)

mccheah
authored and
ash211
committed