Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

AST parser for setup.py files doesn't map comparisons or BoolOps #207

Closed
techalchemy opened this issue Mar 8, 2020 · 0 comments · Fixed by #209
Closed

AST parser for setup.py files doesn't map comparisons or BoolOps #207

techalchemy opened this issue Mar 8, 2020 · 0 comments · Fixed by #209
Labels
bug Something isn't working

Comments

@techalchemy
Copy link
Member

The AST parser fails to perform comparisons or boolean operations due to a lack of any mapping from the ast to equivalent functions, which can lead to half-parsed lists for install_requires as in, for instance, azure-storage==0.36.0, which contains the following:

    install_requires=[
        'azure-common>=1.1.5',
        'cryptography',
        'python-dateutil',
        'requests',
    ] + (['futures'] if sys.version_info < (3,0) else []),

The conditional expression fails to parse, yielding an unusable result
@techalchemy techalchemy added the bug Something isn't working label Mar 8, 2020
techalchemy added a commit that referenced this issue Mar 11, 2020
@techalchemy
Fix binary operator mapping in setup.py ast parser
d262489 
- Fix handling of `ast.binOp` nodes during unmapping of `setup.py`
  files when parsing -- add mapping for all binary operators and
  execute translated functions using the unparsed left and right hand
  sides of the binary operator
- Add equivalent handling for `ast.Compare` types
- Add `importlib.import_module` attempts to `ast.Compare` evaluations
  when encountering `ast.Attribute` types on either side of the
  comparison
- Add handling for `ast.IfExp` type to evaluate truth values of the
  expression and return `node.body` if the expression is `True`,
  otherwise `node.orelse`
- Add equivalence mapping for `ast.Ellipsis` type which becomes
  `ast.Constant` in python `>= 3.8`
- Fixes #204
- Fixes #206
- Fixes #207

Signed-off-by: Dan Ryan <[email protected]>
@techalchemy techalchemy mentioned this issue Mar 11, 2020
Merged
techalchemy added a commit that referenced this issue Mar 11, 2020
@techalchemy
Fix binary operator mapping in setup.py ast parser
7a6cd44 
- Fix handling of `ast.binOp` nodes during unmapping of `setup.py`
  files when parsing -- add mapping for all binary operators and
  execute translated functions using the unparsed left and right hand
  sides of the binary operator
- Add equivalent handling for `ast.Compare` types
- Add `importlib.import_module` attempts to `ast.Compare` evaluations
  when encountering `ast.Attribute` types on either side of the
  comparison
- Add handling for `ast.IfExp` type to evaluate truth values of the
  expression and return `node.body` if the expression is `True`,
  otherwise `node.orelse`
- Add equivalence mapping for `ast.Ellipsis` type which becomes
  `ast.Constant` in python `>= 3.8`
- Fixes #204
- Fixes #206
- Fixes #207

Signed-off-by: Dan Ryan <[email protected]>
techalchemy added a commit that referenced this issue Mar 31, 2020
@techalchemy
Fix binary operator mapping in setup.py ast parser
65c70fa 
- Fix handling of `ast.binOp` nodes during unmapping of `setup.py`
  files when parsing -- add mapping for all binary operators and
  execute translated functions using the unparsed left and right hand
  sides of the binary operator
- Add equivalent handling for `ast.Compare` types
- Add `importlib.import_module` attempts to `ast.Compare` evaluations
  when encountering `ast.Attribute` types on either side of the
  comparison
- Add handling for `ast.IfExp` type to evaluate truth values of the
  expression and return `node.body` if the expression is `True`,
  otherwise `node.orelse`
- Add equivalence mapping for `ast.Ellipsis` type which becomes
  `ast.Constant` in python `>= 3.8`
- Fixes #204
- Fixes #206
- Fixes #207

Signed-off-by: Dan Ryan <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix binary operator mapping in setup.py ast parser sarugaku/requirementslib
1 participant
@techalchemy