move debug logs to debug channel

[matthieuauger]

Description

These logs are displayed on every task multiple times. They hide meaningful information logged in the tasks.
There are more useful when trying to debug performance issues.

Here is an example of what is shown in my tasks, this makes the logs less readable

Related Issue(s)

closes #2069

Breaking Change?

This could be a breaking change is anyone is using these logs programatically but I doubt that is the case

Checklist

• I have made corresponding changes to the documentation (if required)
• I have added tests that prove my fix is effective or that my feature works

[pankajastro]

Thanks for the PR! It looks like the CI checks are failing—could you please take a look and fix them?

[matthieuauger]

hello @pankajastro tests should be good now, just need your approval to execute tests again on CI

[matthieuauger]

@pankajastro is this normal that my CI is blocked? Thanks

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 97.81%. Comparing base (80b7abd) to head (b244f00).
⚠️ Report is 63 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #2163   +/-   ##
=======================================
  Coverage   97.81%   97.81%           
=======================================
  Files          93       93           
  Lines        6006     6006           
=======================================
  Hits         5875     5875           
  Misses        131      131           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[pankajastro]

@pankajastro is this normal that my CI is blocked? Thanks

Yes, for security reasons and to avoid potential misuse, CI requires approval.

[pankajastro]

I know the duplicated log lines aren’t ideal, but I think it’s important to understand why they’re happening.

[pankajastro]

I know the duplicated log lines aren’t ideal, but I think it’s important to understand why they’re happening.

I tried running a few DAGs and couldn’t see duplicate logs. We may need a broader discussion about changing the log level and deciding what we should and shouldn’t log.

[pankajastro]

These logs are helpful for many users—they make it easier to understand what’s happening under the hood and also give a rough idea of performance.

PR #2235 adds Airflow ::group:: to group logs. I think the changes in the PR: #2235 will significantly improve readability, and we may not need to change the log level to debug.

[pankajastro]

Maybe we can combine both and keep keep as info

[pankajastro]

Closing since PR: #2235 has improved the readability, and we will cut alpha soon for testing