[Minor][SS][DOCS] Minor doc change for kafka integration#18550
[Minor][SS][DOCS] Minor doc change for kafka integration#18550viirya wants to merge 1 commit intoapache:masterfrom
Conversation
|
cc @ithjz This may help for your question. |
|
cc @tdas |
viirya
changed the title
|
Test build #79270 has finished for PR 18550 at commit
|
|
|
||
| ./bin/spark-submit --packages org.apache.spark:spark-sql-kafka-0-10_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION_SHORT}} ... | ||
|
|
||
| For experimenting on `spark-shell`, you can also use `--packages` to add `spark-sql-kafka-0-10_{{site.SCALA_BINARY_VERSION}}` and its dependencies directly, |
There was a problem hiding this comment.
Hi, @viirya
For spark-shell, is you need to use better than you can also use because there is no other way?
There was a problem hiding this comment.
oh. the you can also use is relative to spark-submit. Above this, spark-submit uses --packages to add library, so here it says you can also use this option to add library.
There was a problem hiding this comment.
I see. In the Linking section, there is a warning need to add. So, I think we had better to be more clear here.
For experimenting on `spark-shell`, you need to add this above library and its dependencies too when invoking `spark-shell`. Also see the [Deploying](#deploying) subsection below.
For the Deploy section, it looks like that as you said.
|
ping @tdas Please take a look for this simple doc change. Thanks. |
|
Merged to master |
4 participants
What changes were proposed in this pull request?
Minor change to kafka integration document for structured streaming.
How was this patch tested?
N/A, doc change only.