Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update mxnet requirement from ~=1.2.0 to ~=1.9.1 in /tools/mo #15018

Closed

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Jan 10, 2023

Updates the requirements on mxnet to permit the latest version.

Release notes

Sourced from mxnet's releases.

Apache MXNet (incubating) 1.9.1 patch release

Apache MXNet (incubating) 1.9.1 is a maintenance release incorporating important bug fixes and performance improvements. All users of Apache MXNet (incubating) 1.9.0 are advised to upgrade. You can install Apache MXNet (incubating) 1.9.1 at the usual place. Please review these Release Notes to learn the bug fixes.

Bug-fixes

  • Upgrade numpy to <1.20.0 to avoid security vulnerabilities affecting numpy<1.19.1 (#20940)

  • quantized elemwise mul changed out type to float (#20926)

  • Avoid modifying loaded library map while iterating in lib_close() (#20941) (#20944)

  • Fixed issue with batchnorm on even number of channels (#20927)

  • Assign attributes of transformer operators (#20902)

  • Fix reuse of primitives for MKLDNN-AArch64. Fixes #20265. (#20482) (#20921)

  • identity fuse (#20884)

  • Fix the regular expression in RTC code (#20810) (#20840)

  • Port changes from master to make CPP package properly build when large tensor support is enabled. (#20768) (#20841)

  • Port #20759 from v1.x (#20815)

  • Port BRGEMM (#20910)

  • Port #20889 from v1.x (#20923)

Submodule

  • Upgrade oneDNN to the top of rls-v2.4 branch (#20994)

CI/CD

  • Fix aarch64 cd pipeline (#20783)
  • Fix CD for pypi wheel version (#20782)
  • Port #20903 from master. (#20918) (#20920)
  • Fix pip installation in containers (#20864)
  • Update libcudnn and libnccl to the same version used in NVidia's docker container for cuda 10.2 and 11.2, and update repo where we pull the packages from. (#20808)

Website

  • Fix css for Apache links, add to Python docs. (#20995)
  • Update website footer to include required Apache links (#20993)
  • Move trusted-by section from main page to a new page (#20788) (#20798)
  • Fix broken download link, reformat download page to make links more clear. (#20794)
  • Fix static website build (#19906) (#20791)
  • Fix broken website for master version (#19945) (#20789)
  • Update website for v1.9.x branch. (#20786)

Perl

  • Updates mapping between PDL and MX types (#20852)
Changelog

Sourced from mxnet's changelog.

MXNet Change Log

... (truncated)

Commits

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Updates the requirements on [mxnet](https://github.com/apache/incubator-mxnet) to permit the latest version.
- [Release notes](https://github.com/apache/incubator-mxnet/releases)
- [Changelog](https://github.com/apache/mxnet/blob/master/NEWS.md)
- [Commits](apache/mxnet@1.2.0...1.9.1)

---
updated-dependencies:
- dependency-name: mxnet
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot requested a review from a team as a code owner January 10, 2023 05:06
@dependabot dependabot bot added category: dependency_changes Pull requests that update a dependency file python Pull requests that update Python code labels Jan 10, 2023
@dependabot dependabot bot requested review from eaidova and artanokhov and removed request for a team January 10, 2023 05:06
@github-actions github-actions bot added the category: MO Model Optimizer label Jan 10, 2023
@ilya-lavrenov ilya-lavrenov added this to the 2023.0 milestone Jan 24, 2023
@rkazants
Copy link
Contributor

@ilya-lavrenov, could you please rebase PR? something wrong happens with CI:(

@ilya-lavrenov ilya-lavrenov modified the milestones: 2023.0, 2023.1 Apr 24, 2023
@ilya-lavrenov ilya-lavrenov requested a review from slyalin May 4, 2023 21:38
@ilya-lavrenov ilya-lavrenov requested a review from a team as a code owner May 19, 2023 09:49
@github-actions github-actions bot added category: tools OpenVINO C++ / Python tools and removed category: MO Model Optimizer category: dependency_changes Pull requests that update a dependency file labels May 19, 2023
@ilya-lavrenov
Copy link
Contributor

@ilya-lavrenov, could you please rebase PR? something wrong happens with CI:(

done, please, check once again.

@ilya-lavrenov
Copy link
Contributor

@p-wysocki we have pip-conflicts here. Could you please resolve?

@p-wysocki
Copy link
Contributor

p-wysocki commented May 22, 2023

The pip-conflicts logs look a bit weird, it looks like a lot of packages are being downloaded and py311_constraints.txt file we added when dealing with timeouts is not present. Additionally, the error comes from package build for an old datasets version, which should not be taken into consideration with py311_constraints.txt present.

Can we merge master again, just in case? IMO it looks like test infra commit hasn't been updated in this PR.

@ilya-lavrenov
Copy link
Contributor

Looks like we still have pip conflicts on Windows.

Copy link

@jiwaszki jiwaszki left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As mxnet have upper bound on numpy:

67467f8 [v1.9.x] [BUGFIX] Upgrade numpy to <1.20.0 to avoid security vulnerabilities ...

and this results in building from source (which fails only for Python 3.11):

setup.py:67: RuntimeWarning: NumPy 1.19.4 may not yet support Python 3.11.
ERROR: Task 'install 3.11_pip_23.0.1 py reqs and check conflicts'

Two resolutions:

  • bump/fix mxnet (which seems impossible due to 1.9.1 being the latest version)
  • find solution and adjust pipelines to build numpy correctly on specific platforms

@p-wysocki what do you think?

PS what worries me on Win-based platforms:

Using cached mxnet-1.7.0.post2-py2.py3-none-win_amd64.whl (33.1 MB)

@p-wysocki
Copy link
Contributor

On linux mxnet==1.9.1 is being installed, which is the highest available version, and linux is passing.

As @jiwaszki mentioned, on failing Windows:

Using cached mxnet-1.7.0.post2-py2.py3-none-win_amd64.whl (33.1 MB)

I think that we should try removing pip cache on Windows platforms and see what happens then. mxnet==1.7.0 has issues with Python 3.11. cc @wkobielx

@ilya-lavrenov
Copy link
Contributor

I think that we should try removing pip cache on Windows platforms and see what happens then

If we look at pypi, we don't see mxnet for Windows for latest versions.

@p-wysocki
Copy link
Contributor

p-wysocki commented May 26, 2023

It seems mxnet is no longer supported for Windows and newer numpy. Sources:

It hasn't had a release in over a year (https://github.com/apache/mxnet/releases) and overall seems unmaintained. I think that we in order to merge to PR, if it's even possible, we'd have to do some major hacks.

I'm in favor of closing it and starting some discussions on supporting mxnet at all.

@ilya-lavrenov
Copy link
Contributor

I'm in favor of closing it and starting some discussions on supporting mxnet at all.

We already have agreed to remove mxnet support (as well as Kaldi and Caffe) in 2024.0

@p-wysocki
Copy link
Contributor

p-wysocki commented May 26, 2023

We already have agreed to remove mxnet support (as well as Kaldi and Caffe) in 2024.0

That's great, I didn't know. I'm closing this PR because according to the links there's no support for Windows in newer packages, so it has to stay that way until deprecation. Please reopen if needed.

@p-wysocki p-wysocki closed this May 26, 2023
@dependabot @github
Copy link
Contributor Author

dependabot bot commented on behalf of github May 26, 2023

OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting @dependabot ignore this major version or @dependabot ignore this minor version. You can also ignore all major, minor, or patch releases for a dependency by adding an ignore condition with the desired update_types to your config file.

If you change your mind, just re-open this PR and I'll resolve any conflicts on it.

@ilya-lavrenov ilya-lavrenov deleted the dependabot/pip/tools/mo/mxnet-approx-eq-1.9.1 branch May 27, 2023 07:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: tools OpenVINO C++ / Python tools python Pull requests that update Python code
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants