Skip to content

HADOOP-19178: [WASB Deprecation] Updating Documentation on Upcoming Plans for Hadoop-Azure#6862

Merged
steveloughran merged 2 commits intoapache:trunkfrom
ABFSDriver:HADOOP-19178_wasbDep
Jun 7, 2024
Merged

HADOOP-19178: [WASB Deprecation] Updating Documentation on Upcoming Plans for Hadoop-Azure#6862
steveloughran merged 2 commits intoapache:trunkfrom
ABFSDriver:HADOOP-19178_wasbDep

Conversation

@anujmodi2021
Copy link
Copy Markdown
Contributor

Description of PR

This PR is to update the Hadoop Azure documentation on upcoming plans related to ABFS and legacy Wasb driver.
We are working to enable easier migration of Wasb users to ABFS Driver without much efforts and need to upgrade storage account.

Once ABFS Driver is ready to support FNS Accounts over Blob Endpoint, Wasb Driver will be removed from Hadoop repo.

For code changes:

  • Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
  • Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
  • If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

@anujmodi2021 anujmodi2021 changed the title HADOOP-19178: [WASB Deprecation] Updating Documentation on Upcoming Plans HADOOP-19178: [WASB Deprecation] Updating Documentation on Upcoming Plans for Hadoop-Azure Jun 4, 2024
@hadoop-yetus
Copy link
Copy Markdown

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 1m 25s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 markdownlint 0m 0s markdownlint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
_ trunk Compile Tests _
+1 💚 mvninstall 49m 52s trunk passed
+1 💚 mvnsite 0m 40s trunk passed
+1 💚 shadedclient 88m 15s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 0m 29s the patch passed
-1 ❌ blanks 0m 0s /blanks-eol.txt The patch has 1 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
+1 💚 mvnsite 0m 29s the patch passed
+1 💚 shadedclient 39m 55s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 asflicense 0m 35s The patch does not generate ASF License warnings.
135m 52s
Subsystem Report/Notes
Docker ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6862/1/artifact/out/Dockerfile
GITHUB PR #6862
Optional Tests dupname asflicense mvnsite codespell detsecrets markdownlint
uname Linux 9d1b0cba199a 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 6ce8e29
Max. process+thread count 537 (vs. ulimit of 5500)
modules C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6862/1/console
versions git=2.25.1 maven=3.6.3
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link
Copy Markdown

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 59s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 markdownlint 0m 0s markdownlint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
_ trunk Compile Tests _
+1 💚 mvninstall 49m 27s trunk passed
+1 💚 mvnsite 0m 39s trunk passed
+1 💚 shadedclient 88m 10s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 0m 29s the patch passed
+1 💚 blanks 0m 1s The patch has no blanks issues.
+1 💚 mvnsite 0m 29s the patch passed
+1 💚 shadedclient 38m 26s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 asflicense 0m 34s The patch does not generate ASF License warnings.
133m 50s
Subsystem Report/Notes
Docker ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6862/2/artifact/out/Dockerfile
GITHUB PR #6862
Optional Tests dupname asflicense mvnsite codespell detsecrets markdownlint
uname Linux 5c697d97c1bc 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 3bf2283
Max. process+thread count 549 (vs. ulimit of 5500)
modules C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6862/2/console
versions git=2.25.1 maven=3.6.3
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@anujmodi2021 anujmodi2021 marked this pull request as ready for review June 7, 2024 04:30
@anujmodi2021
Copy link
Copy Markdown
Contributor Author

Hi @steveloughran
Please review this WASB Deprecation Announcement PR and let me know if we need to do anything else.

Do we need to mark AzureNativeFileSystem as @deprecated as well in trunk or any release branches??
Thanks

Copy link
Copy Markdown
Contributor

@steveloughran steveloughran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM
+1

@steveloughran steveloughran merged commit bbb17e7 into apache:trunk Jun 7, 2024
steveloughran pushed a commit that referenced this pull request Jun 7, 2024
…lans for Hadoop-Azure (#6862)

Contributed by Anuj Modi
@steveloughran
Copy link
Copy Markdown
Contributor

merged all the way back to branch-3.3

asfgit pushed a commit that referenced this pull request Jun 7, 2024
…lans for Hadoop-Azure (#6862)

Contributed by Anuj Modi
KeeProMise pushed a commit to KeeProMise/hadoop that referenced this pull request Sep 9, 2024
Hexiaoqiao pushed a commit to Hexiaoqiao/hadoop that referenced this pull request Sep 12, 2024
@anujmodi2021 anujmodi2021 deleted the HADOOP-19178_wasbDep branch April 10, 2025 06:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants