Airflow fails to initdb with cattrs 1.1.0 #11965

tdbabas · 2020-10-30T09:48:15Z

Apache Airflow version:

1.10.12

Kubernetes version (if you are using kubernetes) (use kubectl version):

N/A

Environment:

Cloud provider or hardware configuration:
OS (e.g. from /etc/os-release): Centos 7
Kernel (e.g. uname -a): 3.10.0-229.el7.x86_64
Install tools: pip 9.0.3 from /usr/lib/python3.6/site-packages (python 3.6)
Others:

What happened:

Following the instructions here, I encountered an issue at the airflow initdb stage:

[xxx@xxx ~]# airflow initdb
Traceback (most recent call last):
  File "/usr/local/bin/airflow", line 26, in <module>
    from airflow.bin.cli import CLIFactory
  File "/usr/local/lib/python3.6/site-packages/airflow/bin/cli.py", line 94, in <module>
    api_module = import_module(conf.get('cli', 'api_client'))  # type: Any
  File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "/usr/local/lib/python3.6/site-packages/airflow/api/client/local_client.py", line 24, in <module>
    from airflow.api.common.experimental import delete_dag
  File "/usr/local/lib/python3.6/site-packages/airflow/api/common/experimental/delete_dag.py", line 26, in <module>
    from airflow.models.serialized_dag import SerializedDagModel
  File "/usr/local/lib/python3.6/site-packages/airflow/models/serialized_dag.py", line 35, in <module>
    from airflow.serialization.serialized_objects import SerializedDAG
  File "/usr/local/lib/python3.6/site-packages/airflow/serialization/serialized_objects.py", line 28, in <module>
    import cattr
  File "/usr/local/lib/python3.6/site-packages/cattr/__init__.py", line 1, in <module>
    from .converters import Converter, GenConverter, UnstructureStrategy
  File "/usr/local/lib/python3.6/site-packages/cattr/converters.py", line 16, in <module>
    from attr import fields, resolve_types
ImportError: cannot import name 'resolve_types'

What you expected to happen:

I expected the Airflow DB to be initialised as per the instructions.

How to reproduce it:

On a fresh installation, follow the Quick Start guide until the apache initdb stage.

Anything else we need to know:

Investigation suggests that this was caused by a Python dependency; specifically cattrs==1.1.0, which was released yesterday (2020-10-29). Downgrading cattrs manually to 1.0.0 does fix the issue and allows the Airflow database to be initialised:

[xxx@xxx ~]# pip3 install cattrs==1.0.0
Collecting cattrs==1.0.0
  Downloading https://files.pythonhosted.org/packages/17/5b/6afbdaeb066ecf8ca28d85851048103ac80bb169491a54a14bd39823c422/cattrs-1.0.0-py2.py3-none-any.whl
Requirement already satisfied: attrs>=17.3 in /usr/local/lib/python3.6/site-packages (from cattrs==1.0.0)
Installing collected packages: cattrs
  Found existing installation: cattrs 1.1.0
    Uninstalling cattrs-1.1.0:
      Successfully uninstalled cattrs-1.1.0
Successfully installed cattrs-1.0.0
[xxx@xxx ~]# airflow initdb            
DB: sqlite:////path/to/airflow.db
[2020-10-30 09:36:05,431] {db.py:378} INFO - Creating tables
INFO  [alembic.runtime.migration] Context impl SQLiteImpl.
INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
INFO  [alembic.runtime.migration] Running upgrade  -> e3a246e0dc1, current schema
INFO  [alembic.runtime.migration] Running upgrade e3a246e0dc1 -> 1507a7289a2f, create is_encrypted
/usr/local/lib/python3.6/site-packages/alembic/ddl/sqlite.py:44: UserWarning: Skipping unsupported ALTER for creation of implicit constraintPlease refer to the batch mode feature which allows for SQLite migrations using a copy-and-move strategy.
...
Done.

The text was updated successfully, but these errors were encountered:

boring-cyborg · 2020-10-30T09:48:16Z

Thanks for opening your first issue here! Be sure to follow the issue template!

cgddrd · 2020-10-30T10:29:16Z

Can confirm we're experiencing this as part of our production stack (auto scaling actions are now failing when trying to install 1.10.12) - a hotfix would be greatly appreciated.

kaxil · 2020-10-30T11:04:50Z

You can use the following for now, this will be fixed in 1.10.13

pip install apache-airflow==1.10.12 \
 --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-1.10.12/constraints-3.7.txt"

cgddrd · 2020-10-30T11:37:07Z

Many thanks @kaxil

`cattrs` now depends on `attrs >= 20.1.0`, because of `attr.resolve_types`. Source: https://github.com/Tinche/cattrs/blob/master/HISTORY.rst#110-2020-10-29 closes apache#11965

kaxil · 2020-10-30T13:27:23Z

#11969 -- This PR will be included in 1.10.13 and should fix this issue too

`cattrs` now depends on `attrs >= 20.1.0`, because of `attr.resolve_types`. Source: https://github.com/Tinche/cattrs/blob/master/HISTORY.rst#110-2020-10-29 closes #11965

Signed-off-by: Julien Le Dem <[email protected]>

`cattrs` now depends on `attrs >= 20.1.0`, because of `attr.resolve_types`. Source: https://github.com/Tinche/cattrs/blob/master/HISTORY.rst#110-2020-10-29 closes apache#11965

jodmoreira · 2020-11-02T00:14:37Z

You can use the following for now, this will be fixed in 1.10.13
pip install apache-airflow==1.10.12 \
 --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-1.10.12/constraints-3.7.txt"

It worked! Thanks!

zachliu · 2020-11-03T15:13:54Z

@jodmoreira oh how i envy you, the constraint file constraints-3.8.txt doesn't work for my 1.10.12 😿 #8467 (comment)

kaxil · 2020-11-03T15:26:53Z

@jodmoreira oh how i envy you, the constraint file constraints-3.8.txt doesn't work for my 1.10.12 😿 #8467 (comment)

Just update both attrs and cattrs that too should work.

or just downgrade cattrs

potiuk · 2020-11-04T07:55:43Z

Yeah. Constraints file does not work if you already have higher version installed.

zachliu · 2020-11-04T17:52:24Z

@kaxil @potiuk ah, i'm sorry i didn't describe it clearly 😅
the constraint file constraints-3.8.txt did solve the attr and/or cattrs issue, but in order to use it i had to do the following changes due to #8467 (comment):

original:

oauthlib==3.1.0
requests-oauthlib==1.3.0

my updates:

oauthlib==2.1.0
requests-oauthlib==1.1.0

dark-spark2 · 2020-11-05T12:21:44Z

@kaxil can I change attrs to higher version( attrs==20.1.0 ) for airflow 1.10.12?

`cattrs` now depends on `attrs >= 20.1.0`, because of `attr.resolve_types`. Source: https://github.com/Tinche/cattrs/blob/master/HISTORY.rst#110-2020-10-29 closes apache#11965

0xCakin · 2020-11-07T03:49:15Z

You can use the following for now, this will be fixed in 1.10.13
pip install apache-airflow==1.10.12 \
 --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-1.10.12/constraints-3.7.txt"

Thanks a lot!

mmgithub123 · 2020-11-09T07:44:32Z

great!
I have the some question，
when i use pip3 install cattrs==1.0.0.
fix my problem

gaj995 · 2020-11-11T18:47:21Z

You can use the following for now, this will be fixed in 1.10.13
pip install apache-airflow==1.10.12 \
 --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-1.10.12/constraints-3.7.txt"

Didn't work for me :(

potiuk · 2020-11-11T19:23:34Z

Didn't work for me :(

What do you mean by 'didn't work"? Can you please provide some specifics on what you tried and how it did not work @gaj995 ?

noelmcloughlin · 2020-12-06T01:30:34Z

when i use pip3 install cattrs==1.0.0.

Beware of cattrs 1.n.n hell with Python 3.9 (i.e. archlinux).

"ImportError: cannot import name '_Union' from 'typing'"
ImportError: cannot import name 'resolve_types' from 'attr'

potiuk · 2020-12-06T16:38:53Z

I'd recommend Airflow adopts the same policy because this philosophy works great for me.

Unfortunately, It is beyond of our control when it comes to our users. We have no physical capacity to force our users to use our preferred installation method. So we better try it ourselves and . We have to assume our users installed latest PIP (which the cannot for now as stated in #12838 which is currently. And in many toolchains where Airflow is installed people build Airflow Images automatically and running the PyPI pip. Including our image which is currently pinned to 20.2.4.

Beware of cattrs 1.n.n hell with Python 3.9 (i.e. archlinux).

Yep. This is one of the reasons why Python 3.9 is not officially supported yet by Airflow

sephethus · 2020-12-07T15:42:39Z

Nothing works in this entire thread, nothing. I'm using docker-compose up to create a local instance and it all fails. 1.10.13, adding cattrs and attrs and upping the version of oauthlib and requests-oauthlib, nothing works, period. What now?

There is a known bug with the latest PiP that was released two days ago. You probably hit the problem described here: pypa/pip#9203

The new version of PIP has MANY problems and broke a lot of other projects. For now the best course of action is to downgrade Pip to 20.2.4 version (this is what we did in official docker images and this is what is recommended in 1.10.14 documentation (release candidate will be there shortly soon).

According to my pip3 --version I'm on 20.0.2 so that can't be the issue.

potiuk · 2020-12-10T13:44:43Z

Are you trying to develop Airflow or run it for "production" on MacOS? We do not support MacOS as "execution" environment" - only Linux systems are supported for 'running' Airflow', MacOS in our case is only supported as development environment.

It looks like a Mac-only thing, so if you are using MacOS to develop airflow and you can use dockerised development environment instead, while we manage to pin-point it? (.

On MacOS we also have Breeze that provides a fully-featured docker-based dev environment that works flawlessly with MacOS as well. We fully support it and there is plenty of documentation and movies on how to use Breeze for development purpose including 'start-airflow' command that automatically spins of running airflow scheduler + webserver + command line from your local sources.

BTW. If you have migrated to BigSur, this might be the root cause of the problem. Usually the "POSIX" development environment has lots of problems with the new releases of MacOS. It usually takes couple of months and few releases of patches + some releases of brew and other dev environments to get it working. Again Breeze is your best bet there as it is "stable" environment. As on as you have Docker and Docker-compose, it will work on MacOS/Linux and even WSL2 for Windows in similar way.

`cattrs` now depends on `attrs >= 20.1.0`, because of `attr.resolve_types`. Source: https://github.com/Tinche/cattrs/blob/master/HISTORY.rst#110-2020-10-29 closes apache#11965 (cherry picked from commit 3ad0378)

Recent versions of Tensorflow and Airflow makes test fails with segmentation faults. Airflow doesn't support macos as an execution environment.[1] [1] apache/airflow#11965 (comment) PiperOrigin-RevId: 364952307

`cattrs` now depends on `attrs >= 20.1.0`, because of `attr.resolve_types`. Source: https://github.com/Tinche/cattrs/blob/master/HISTORY.rst#110-2020-10-29 closes apache#11965

Recent versions of Tensorflow and Airflow makes test fails with segmentation faults. Airflow doesn't support macos as an execution environment.[1] [1] apache/airflow#11965 (comment) PiperOrigin-RevId: 364952307

Recent versions of Tensorflow and Airflow makes test fails with segmentation faults. Airflow doesn't support macos as an execution environment.[1] [1] apache/airflow#11965 (comment) PiperOrigin-RevId: 365168108

`cattrs` now depends on `attrs >= 20.1.0`, because of `attr.resolve_types`. Source: https://github.com/Tinche/cattrs/blob/master/HISTORY.rst#110-2020-10-29 closes apache/airflow#11965 (cherry picked from commit 3ad037872e54ec617f1b2734781c61640c7528ca) GitOrigin-RevId: 6b41e9541d445261bd8073750e047cbfaf03a624

`cattrs` now depends on `attrs >= 20.1.0`, because of `attr.resolve_types`. Source: https://github.com/Tinche/cattrs/blob/master/HISTORY.rst#110-2020-10-29 closes apache/airflow#11965 GitOrigin-RevId: 3ad037872e54ec617f1b2734781c61640c7528ca

tdbabas added the kind:bug This is a clearly a bug label Oct 30, 2020

kaxil added this to the Airflow 1.10.13 milestone Oct 30, 2020

kaxil mentioned this issue Oct 30, 2020

Bump attrs and cattrs dependencies #11969

Merged

kaxil mentioned this issue Oct 30, 2020

Set Explicit requirement for Python>=3.7 python-attrs/cattrs#103

Merged

kaxil closed this as completed in #11969 Oct 30, 2020

julienledem added a commit to MarquezProject/marquez-airflow that referenced this issue Oct 30, 2020

fix airflow instrall per: apache/airflow#11965 (comment)

674cdd3

Signed-off-by: Julien Le Dem <[email protected]>

julienledem added a commit to MarquezProject/marquez-airflow that referenced this issue Oct 30, 2020

fix airflow instrall per: apache/airflow#11965 (comment) (#100)

3b9dfa1

Signed-off-by: Julien Le Dem <[email protected]>

kaxil mentioned this issue Nov 2, 2020

1.10.12 attrs package dependency breaks pipenv locking #12031

Closed

zachliu mentioned this issue Nov 2, 2020

ImportError: cannot import name 'bytes_type' from 'oauthlib.common' #8467

Closed

turbaszek mentioned this issue Dec 8, 2020

cannot import name 'resolve_types' from 'attr' #12924

Closed

copybara-service bot mentioned this issue Mar 25, 2021

Skips flakky airflow test on macos. tensorflow/tfx#3451

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Airflow fails to initdb with cattrs 1.1.0 #11965

Airflow fails to initdb with cattrs 1.1.0 #11965

tdbabas commented Oct 30, 2020 •

edited

Loading

boring-cyborg bot commented Oct 30, 2020

cgddrd commented Oct 30, 2020 •

edited

Loading

kaxil commented Oct 30, 2020 •

edited

Loading

cgddrd commented Oct 30, 2020

kaxil commented Oct 30, 2020

jodmoreira commented Nov 2, 2020

zachliu commented Nov 3, 2020

kaxil commented Nov 3, 2020

potiuk commented Nov 4, 2020

zachliu commented Nov 4, 2020

dark-spark2 commented Nov 5, 2020 •

edited

Loading

0xCakin commented Nov 7, 2020

mmgithub123 commented Nov 9, 2020

gaj995 commented Nov 11, 2020

potiuk commented Nov 11, 2020 •

edited

Loading

noelmcloughlin commented Dec 6, 2020

potiuk commented Dec 6, 2020

sephethus commented Dec 7, 2020

potiuk commented Dec 10, 2020

Airflow fails to initdb with cattrs 1.1.0 #11965

Airflow fails to initdb with cattrs 1.1.0 #11965

Comments

tdbabas commented Oct 30, 2020 • edited Loading

boring-cyborg bot commented Oct 30, 2020

cgddrd commented Oct 30, 2020 • edited Loading

kaxil commented Oct 30, 2020 • edited Loading

cgddrd commented Oct 30, 2020

kaxil commented Oct 30, 2020

jodmoreira commented Nov 2, 2020

zachliu commented Nov 3, 2020

kaxil commented Nov 3, 2020

potiuk commented Nov 4, 2020

zachliu commented Nov 4, 2020

dark-spark2 commented Nov 5, 2020 • edited Loading

0xCakin commented Nov 7, 2020

mmgithub123 commented Nov 9, 2020

gaj995 commented Nov 11, 2020

potiuk commented Nov 11, 2020 • edited Loading

noelmcloughlin commented Dec 6, 2020

potiuk commented Dec 6, 2020

sephethus commented Dec 7, 2020

potiuk commented Dec 10, 2020

tdbabas commented Oct 30, 2020 •

edited

Loading

cgddrd commented Oct 30, 2020 •

edited

Loading

kaxil commented Oct 30, 2020 •

edited

Loading

dark-spark2 commented Nov 5, 2020 •

edited

Loading

potiuk commented Nov 11, 2020 •

edited

Loading