Skip to content

Conversation

@vectorijk
Copy link
Contributor

use try-with-resource clause to close ParquetFileReader explicitly to prevent TCP leaking issue

Make sure you have checked all steps below.

Jira

Tests

  • My PR adds the following unit tests OR does not need testing for this extremely good reason:

Commits

  • My commits all reference Jira issues in their subject lines. In addition, my commits follow the guidelines from "How to write a good git commit message":
    1. Subject is separated from body by a blank line
    2. Subject is limited to 50 characters (not including Jira issue reference)
    3. Subject does not end with a period
    4. Subject uses the imperative mood ("add", not "adding")
    5. Body wraps at 72 characters
    6. Body explains "what" and "why", not "how"

Documentation

  • In case of new functionality, my PR adds documentation that describes how to use it.
    • All the public functions and the classes in the PR contain Javadoc that explain what it does

@gszadovszky gszadovszky changed the title [PARQUET-2054] fix TCP leaking when calling ParquetFileWriter.appendFile PARQUET-2054: fix TCP leaking when calling ParquetFileWriter.appendFile Jun 7, 2021
@shangxinli
Copy link
Contributor

Thanks, Kai for working on this! Can you check if there are other places having a similar issues?

@vectorijk
Copy link
Contributor Author

Thanks, Xinli and Gabor! I will search it globally to see if any other places having this similar issue.

@gszadovszky
Copy link
Contributor

@vectorijk, any updates on this? Do you plan to search similar issues under this PR or we can consider it complete?

@vectorijk
Copy link
Contributor Author

vectorijk commented Jun 15, 2021

Hi @gszadovszky , Xinli, could you help to have another look when you have time? I search globally for the similar issue (not closed ParquetFileReader). It mainly happens in parquet-cli commands and ParquetFileWriter unit tests. I updated the fix in this PR

Copy link
Contributor

@gszadovszky gszadovszky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks a lot, @vectorijk for you efforts!

@gszadovszky gszadovszky merged commit bab3d53 into apache:master Jun 22, 2021
shangxinli pushed a commit to shangxinli/parquet-mr that referenced this pull request Sep 9, 2021
…le (apache#913)

* use try-with-resource statement for ParquetFileReader to call close explicitly
shangxinli pushed a commit that referenced this pull request Sep 9, 2021
…le (#913)

* use try-with-resource statement for ParquetFileReader to call close explicitly
sunchao pushed a commit to sunchao/parquet-mr that referenced this pull request Mar 3, 2022
…le (apache#913)

* use try-with-resource statement for ParquetFileReader to call close explicitly

(cherry picked from commit 387e138)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants