[Confluence] Update logs

[moxarth-elastic]

Part Of #2299

Adds a data source validation and update existing logs.

Log file: https://drive.google.com/file/d/1NmTwME31dcvFzVRMhUCrjQaWAF93CfM6/view?usp=drive_link

Checklists

Pre-Review Checklist

• this PR does NOT contain credentials of any kind, such as API keys or username/passwords (double check config.yml.example)
• this PR has a meaningful title
• this PR links to all relevant github issues that it fixes or partially addresses
• if there is no GH issue, please create it. Each PR should have a link to an issue
• this PR has a thorough description
• Covered the changes with automated tests
• Tested the changes locally
• Added a label for each target release version (example: v7.13.2, v7.14.0, v8.0.0)

[jedrazb]

looks good, when handling client errors in _handle_client_errors

• can we log url that is causing 500
• when handling other errors (else raise at the end) can we log as error full exception and url

[jedrazb]

in api_call the ServerDisconnectedError should be probably logged as well (as we are closing the session and re-raising)

[artem-shelkovnikov]

1. "Started pagination for the API endpoint: rest/api/search?cql={query} to host: https://jira-connector.atlassian.net/wiki" should be DEBUG. Also query is not actually shown
2. Sync should report progress while in INFO. Now I see nothing - can we log what entities are fetched in INFO?
3. Paginated calls report only the first call, can you make sure every page call generates a log line?

[artem-shelkovnikov]

@moxarth-elastic can you share updated log lines in DEBUG for all the log issues when you finish addressing comments?

[moxarth-elastic]

@moxarth-elastic can you share updated log lines in DEBUG for all the log issues when you finish addressing comments?

Here is the updated log file: https://drive.google.com/file/d/1NmTwME31dcvFzVRMhUCrjQaWAF93CfM6/view?usp=drive_link. Updated the same in the description

[artem-shelkovnikov]

Looks better, a couple more:

• "Successfully connected to Confluence" should be DEBUG when called from ping method, it's great to have it when you call it from get_docs though. Failure to connect should be WARN
• "Started pagination for the API endpoint: rest/api/search?cql={query} to host: https://jira-connector.atlassian.net/wiki" - notice {query} is not inlined. Can we also use generic message here, like you did for GET call? Also this line should not be info.

[moxarth-elastic]

buildkite test this