Update databricks deployment docs and remove mentions of custom entrypoint

[merelcht]

Description

Update Databricks deployment docs now the __main__.py has been updated: #4026

Development notes

• Removed mention to the custom entrypoint
• Updated image of job task configuration
• Updated instructions of file copying to location of files in DBFS to match changes made in align databricks-iris template to work with kedro-databricks kedro-starters#227
• Removed instructions to set custom logging. AFAIK and tested this is no longer needed.

Note

I'll update the databricks-iris starter in a follow up PR

Developer Certificate of Origin

We need all contributions to comply with the Developer Certificate of Origin (DCO). All commits must be signed off by including a Signed-off-by line in the commit message. See our wiki for guidance.

If your PR is blocked due to unsigned commits, then you must follow the instructions under "Rebase the branch" on the GitHub Checks page for your PR. This will retroactively add the sign-off to all unsigned commits and allow the DCO check to pass.

Checklist

• Read the contributing guidelines
• Signed off each commit with a Developer Certificate of Origin (DCO)
• Opened this PR as a 'Draft Pull Request' if it is work-in-progress
• Updated the documentation to reflect the code changes
• Added a description of this change in the RELEASE.md file
• Added tests to cover my changes
• Checked if this change will affect Kedro-Viz, and if so, communicated that with the Viz team

[noklam]

@JenspederM After this we no longer need a custom entrypoint for Databricks, and this would have the full argument list as kedro run.

[noklam]

⭐️ Happy to see the custom entrypoints get deleted!

[ElenaKhaustova]

LGTM ✨