[SPARK-31533][SQL][TESTS] Enable DB2IntegrationSuite test and upgrade the DB2 docker inside

[gaborgsomogyi]

What changes were proposed in this pull request?

This is a followup PR discussed here.

Why are the changes needed?

It would be good to re-enable DB2IntegrationSuite and upgrade the docker image inside to use the latest.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Existing docker integration tests.

[gaborgsomogyi]

ARCHIVE_LOGS and AUTOCONFIG is needed because it triggers a server side restart (which made the suite fail all the time). Please see the following code snippet extracted from the docker image:

configure_db()
{
   dbname=$1

   if [ ${ARCHIVE_LOGS?} = "true" -o "${HADR_ENABLED?}" = "true" ]; then
       # Enabling log archiving does not exit with a zero because of SQL1363W
       enable_log_archiving ${dbname?}
       restart_db2

       if ! back_up ${dbname?}; then
          echo "(!) Failed to back up ${dbname?} database"
       fi
   else
       echo "(*) Log archiving will not be configured as ARCHIVE_LOGS has been set to false. "
   fi
   
   if [ ${AUTOCONFIG?} = "true" -o "${HADR_ENABLED?}" = "true" ]; then
      if ! run_autoconfig ${dbname?}; then
         echo "(!) Failed to automatically configure ${dbname?} database"
      fi
   else
      echo "(*) Instance and database will not be auto configured. AUTOCONFIG has been set to false. "
   fi

   if ! configure_text_search ${dbname?}; then
      echo "(!) Failed to configure ${dbname?} database for text search"
   fi
}

I've applied the same in the kerberos suite because until now it was only timing luck that it's not failed.

[dongjoon-hyun]

Got it.

[gaborgsomogyi]

cc @HeartSaVioR

[SparkQA]

Test build #121747 has finished for PR 28325 at commit 7fbc27b.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[gaborgsomogyi]

retest this, please

[SparkQA]

Test build #121760 has finished for PR 28325 at commit 7fbc27b.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[gaborgsomogyi]

retest this, please

[dongjoon-hyun]

Thank you, @gaborgsomogyi .

[dongjoon-hyun]

Ur, why privileged is required?

[gaborgsomogyi]

This docker requires priviliged run. Please see the how to use section of the docker image.

[dongjoon-hyun]

Thanks. I checked the doc. It's at least required during re-mount the volumes even we don't provide a volume.

[SparkQA]

Test build #121771 has finished for PR 28325 at commit 7fbc27b.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[dongjoon-hyun]

+1, LGTM. Thank you. I verified this locally.

DB2IntegrationSuite:
...
- Basic test
- Numeric types
- Date types
- String types
- Basic write test
- query JDBC option
...

[dongjoon-hyun]

Merged to master.