AttributeError: 'pyarrow._flight.FlightClient' object has no attribute 'close'

[alexandnpu]

There is exception when closing InfluxDBClient3

see issue title

my version is influxdb3-python==0.2.3

[Jayclifford345]

Hi @alexandnpu,
Many thanks for using the Python client! Would you mind showing me how you are closing the client as I might have overlooked a method of closing, Here is how I currently do this:

import polars as pl
from influxdb_client_3 import InfluxDBClient3



client = InfluxDBClient3(
    token="",
    host="eu-central-1-1.aws.cloud2.influxdata.com",
    org="6a841c0c08328fb1")

sql = 'SELECT * FROM caught LIMIT 10'

table = client.query(database="pokemon-codex", query=sql, language='sql', mode='all')

df = pl.from_arrow(table)

print(df)

client.close()

Here is the result:

(.venv) jayclifford@Jays-MBP Polars % python3 influxdb_query.py 
shape: (10, 12)
┌────────┬─────────┬─────┬──────┬───┬────────────────────────────┬─────────┬───────┬────────┐
│ attack ┆ defense ┆ hp  ┆ id   ┆ … ┆ time                       ┆ trainer ┆ type1 ┆ type2  │
│ ---    ┆ ---     ┆ --- ┆ ---  ┆   ┆ ---                        ┆ ---     ┆ ---   ┆ ---    │
│ i64    ┆ i64     ┆ i64 ┆ str  ┆   ┆ datetime[ns]               ┆ str     ┆ str   ┆ str    │
╞════════╪═════════╪═════╪══════╪═══╪════════════════════════════╪═════════╪═══════╪════════╡
│ 49     ┆ 49      ┆ 45  ┆ 0001 ┆ … ┆ 2023-12-20 11:08:25.209547 ┆ ash     ┆ Grass ┆ Poison │
│ 49     ┆ 49      ┆ 45  ┆ 0001 ┆ … ┆ 2023-12-20 14:36:19.893693 ┆ ash     ┆ Grass ┆ Poison │
│ 49     ┆ 49      ┆ 45  ┆ 0001 ┆ … ┆ 2023-12-20 11:11:25.209547 ┆ ash     ┆ Grass ┆ Poison │
│ 49     ┆ 49      ┆ 45  ┆ 0001 ┆ … ┆ 2023-12-20 14:49:19.893693 ┆ ash     ┆ Grass ┆ Poison │
│ …      ┆ …       ┆ …   ┆ …    ┆ … ┆ …                          ┆ …       ┆ …     ┆ …      │
│ 49     ┆ 49      ┆ 45  ┆ 0001 ┆ … ┆ 2023-12-20 11:16:25.209547 ┆ ash     ┆ Grass ┆ Poison │
│ 49     ┆ 49      ┆ 45  ┆ 0001 ┆ … ┆ 2023-12-20 15:31:19.893693 ┆ ash     ┆ Grass ┆ Poison │
│ 49     ┆ 49      ┆ 45  ┆ 0001 ┆ … ┆ 2023-12-20 11:10:25.209547 ┆ ash     ┆ Grass ┆ Poison │
│ 49     ┆ 49      ┆ 45  ┆ 0001 ┆ … ┆ 2023-12-20 15:15:19.893693 ┆ ash     ┆ Grass ┆ Poison │

[alexandnpu]

@Jayclifford345 , thanks for your reply.

I pasted my stacktrace here, noticing that I am using python 3.6.

Traceback (most recent call last):
File "/usr/lib64/python3.6/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib64/python3.6/multiprocessing/process.py", line 93, in run
self._target(*self._args, **self._kwargs)
File "write_iox_client.py", line 49, in write_to_iox
iox_client.write(point)
File "/path-to-venv/venv/lib64/python3.6/site-packages/influxdb_client_3/init.py", line 227, in exit
self.close()
File "/path-to-venv/venv/lib64/python3.6/site-packages/influxdb_client_3/init.py", line 220, in close
self._flight_client.close()
AttributeError: 'pyarrow._flight.FlightClient' object has no attribute 'close'

below is my code

from influxdb_client_3 import write_client_options, WritePrecision, WriteOptions, InfluxDBError, Point

write_options = WriteOptions(batch_size=int(batch_size),
                             flush_interval=10_000,
                             jitter_interval=2_000,
                             retry_interval=5_000,
                             max_retries=5,
                             max_retry_delay=30_000,
                             exponential_base=2)

wco = write_client_options(WriteOptions=write_options)



def write_to_iox(data_file):
    print("processing {}".format(data_file))

    with InfluxDBClient3.InfluxDBClient3(host="http://127.0.0.1:18080", enable_gzip=True, org="test", database="xxxx", write_client_options=wco) as iox_client:
        with open(data_file, "r") as f:
            batch_lines = []
            for line in f:
                obj = json.loads(line)
                point = create_iox_point(obj)
                iox_client.write(point)

and pip freeze tells me that

influxdb-client==1.31.0
influxdb3-python==0.2.3
pyarrow==6.0.1

[Jayclifford345]

hmm interesting can you try with the latest version?
I will try to reproduce on my end with v0.3.4

[Jayclifford345]

I sadly still not reproduce this on the latest build:

[alexandnpu]

Root Cause

I found the root cause!

in my setup, the versions are listed below

influxdb-client==1.31.0
influxdb3-python==0.2.3
pyarrow==6.0.1

in pyarrow 6.0.1, there is indeed no close method for FlightClient.
It seems that the close method is added in 8.0.0,

So, in order to make influxdb3-python close work, pyarrow need to be above 8.0.0.

python version

I also found another small issue when I tried influxdb3-client v0.3.4.
As v0.3.4 depends reactive>=4.0.4 and reactive needs python to be at least python 3.7, influxdb3-python should also have this version requirement.
Also, the minimum python version that can be used with pyarrow>=8.0.0 is python 3.7.

So I think influxdb3-python should also update its minimum allowed python version.
Or you can find another solution to make python 3.6 work with influxdb3-python, which for my work environment will be better.

[Jayclifford345]

Thank you @alexandnpu, I will create a ticket and get the versions updated