Connector reads 0 rows although Cluster returned results #383
Description
As the title says, I'm having an issue where the SQL connector, upon executing .fetchall() returns 0 rows, while the Cluster that ran the query returns approx. 151,653 rows - retrieved from cached in 500ms.
with adb_sql.connect(
server_hostname=db_creds_dict["db_name"],
http_path=db_creds_dict["db_path"],
access_token=db_creds_dict["db_token"],
) as conn:
with conn.cursor() as cursor:
if parameters is None:
cursor.execute(query)
else:
cursor.execute(query.format(*parameters))
data = pd.DataFrame(
cursor.fetchall(),
columns=[desc[0] for desc in cursor.description],
)In other situations where the same query returns fewer rows (i.e. 10s to return 28k rows), the connection reads correctly.
Python: 3.8.12
Package Version: 3.1.1
Databricks SQL Warehouse configuration:
- DBSQL v. 2023.50
- Serverless
- X-Small