Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug: dim pathways issue #3514

Closed
vevetron opened this issue Oct 25, 2024 · 1 comment · Fixed by #3679
Closed

Bug: dim pathways issue #3514

vevetron opened this issue Oct 25, 2024 · 1 comment · Fixed by #3679
Assignees
Labels
bug Something isn't working

Comments

@vevetron
Copy link
Contributor

Describe the bug
DIM pathways sql failed on a dag run. Not sure if this would be a recurring issue yet.

Single error on a transform_warehouse dbt run on 2024-10-24:
https://b2062ffca77d44a28b4e05f8f5bf4996-dot-us-west2.composer.googleusercontent.com/dags/transform_warehouse/grid?dag_run_id=scheduled__2024-10-24T14%3A00%3A00%2B00%3A00&task_id=dbt_run_and_upload_artifacts

[2024-10-25, 14:47:16 UTC] {pod_manager.py:435} INFO - [base] �[0m14:47:16  �[31mCompleted with 1 error and 0 warnings:�[0m
[2024-10-25, 14:47:16 UTC] {pod_manager.py:435} INFO - [base] �[0m14:47:16
[2024-10-25, 14:47:16 UTC] {pod_manager.py:435} INFO - [base] �[0m14:47:16  �[33mDatabase Error in model dim_pathways (models/mart/gtfs/dim_pathways.sql)�[0m
[2024-10-25, 14:47:16 UTC] {pod_manager.py:435} INFO - [base] �[0m14:47:16    Invalid NUMERIC value: 65.00730846754857 Field: length; Value: 65.00730846754857
[2024-10-25, 14:47:16 UTC] {pod_manager.py:435} INFO - [base] �[0m14:47:16    compiled Code at target/run/calitp_warehouse/models/mart/gtfs/dim_pathways.sql
[2024-10-25, 14:47:16 UTC] {pod_manager.py:435} INFO - [base] �[0m14:47:16

Please enter a clear and concise description of the bug.

To Reproduce
Please enter step by step instructions to reproduce the behavior. For example: Query column A for organization Y on date Z.

Expected behavior
NO ERRORS DUH.

@erikamov erikamov added the bug Something isn't working label Jan 23, 2025
@erikamov erikamov self-assigned this Feb 5, 2025
erikamov added a commit that referenced this issue Feb 7, 2025
“Invalid NUMERIC value: 65.00730846754857 Field: length; Value: 65.00730846754857” from transform_warehouse

[#3514]

Signed-off-by: Doc Ritezel <[email protected]>
@erikamov
Copy link
Contributor

erikamov commented Feb 7, 2025

dim_pathways was fixed, changing the length column to FLOAT on external_gtfs_schedule.pathways.
It was not updating since October last year (2024).
transform_warehouse still fail today because the table is an incremental table and needs a full refresh.
Charlie helped me running manually a full refresh and the table was updated successfully.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants