Skip to content

destroy injector when module is destroyed#498

Merged
GulajavaMinistudio merged 1 commit intoGulajavaMinistudio:masterfrom
apache:master
Jan 16, 2019
Merged

destroy injector when module is destroyed#498
GulajavaMinistudio merged 1 commit intoGulajavaMinistudio:masterfrom
apache:master

Conversation

@GulajavaMinistudio
Copy link
Copy Markdown
Owner

What changes were proposed in this pull request?

Now in TransportRequestHandler.processStreamRequest, when a stream request is processed, the stream id is not registered with the current channel in stream manager. It should do that so in case of that the channel gets terminated we can remove associated streams of stream requests too.

This also cleans up channel registration in StreamManager. Since StreamManager doesn't register channel but only OneForOneStreamManager does it, this removes registerChannel from StreamManager. When OneForOneStreamManager goes to register stream, it will also register channel for the stream.

How was this patch tested?

Existing tests.

Closes apache#23521 from viirya/SPARK-26604.

Authored-by: Liang-Chi Hsieh viirya@gmail.com
Signed-off-by: Wenchen Fan wenchen@databricks.com

What changes were proposed in this pull request?

(Please fill in changes proposed in this fix)

How was this patch tested?

(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

Please review http://spark.apache.org/contributing.html before opening a pull request.

## What changes were proposed in this pull request?

Now in `TransportRequestHandler.processStreamRequest`, when a stream request is processed, the stream id is not registered with the current channel in stream manager. It should do that so in case of that the channel gets terminated we can remove associated streams of stream requests too.

This also cleans up channel registration in `StreamManager`. Since `StreamManager` doesn't register channel but only `OneForOneStreamManager` does it, this removes `registerChannel` from `StreamManager`. When `OneForOneStreamManager` goes to register stream, it will also register channel for the stream.

## How was this patch tested?

Existing tests.

Closes #23521 from viirya/SPARK-26604.

Authored-by: Liang-Chi Hsieh <viirya@gmail.com>
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
@GulajavaMinistudio GulajavaMinistudio merged commit 8da852f into GulajavaMinistudio:master Jan 16, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants