[SPARK-3806][SQL]Minor fix for CliSuite

[scwf]

To fix two issues in CliSuite
1 CliSuite throw IndexOutOfBoundsException:
Exception in thread "Thread-6" java.lang.IndexOutOfBoundsException: 6
at scala.collection.mutable.ResizableArray$class.apply(ResizableArray.scala:43)
at scala.collection.mutable.ArrayBuffer.apply(ArrayBuffer.scala:47)
at org.apache.spark.sql.hive.thriftserver.CliSuite.org$apache$spark$sql$hive$thriftserver$CliSuite$$captureOutput$1(CliSuite.scala:67)
at org.apache.spark.sql.hive.thriftserver.CliSuite$$anonfun$4.apply(CliSuite.scala:78)
at org.apache.spark.sql.hive.thriftserver.CliSuite$$anonfun$4.apply(CliSuite.scala:78)
at scala.sys.process.ProcessLogger$$anon$1.out(ProcessLogger.scala:96)
at scala.sys.process.BasicIO$$anonfun$processOutFully$1.apply(BasicIO.scala:135)
at scala.sys.process.BasicIO$$anonfun$processOutFully$1.apply(BasicIO.scala:135)
at scala.sys.process.BasicIO$.readFully$1(BasicIO.scala:175)
at scala.sys.process.BasicIO$.processLinesFully(BasicIO.scala:179)
at scala.sys.process.BasicIO$$anonfun$processFully$1.apply(BasicIO.scala:164)
at scala.sys.process.BasicIO$$anonfun$processFully$1.apply(BasicIO.scala:162)
at scala.sys.process.ProcessBuilderImpl$Simple$$anonfun$3.apply$mcV$sp(ProcessBuilderImpl.scala:73)
at scala.sys.process.ProcessImpl$Spawn$$anon$1.run(ProcessImpl.scala:22)

Actually, it is the Mutil-Threads lead to this problem.

2 Using line.startsWith instead line.contains to assert expected answer. This is a tiny bug in CliSuite, for test case "Simple commands", there is a expected answers "5", if we use contains that means output like "14/10/06 11:54:36 INFO CliDriver: Time taken: 1.078 seconds" or "14/10/06 11:54:36 INFO StatsReportListener: 0% 5% 10% 25% 50% 75% 90% 95% 100%" will make the assert true.

[scwf]

cc @liancheng

[AmplabJenkins]

Can one of the admins verify this patch?

[liancheng]

ok to test

[liancheng]

Good catch! LGTM.

[SparkQA]

QA tests have started for PR 2666 at commit 11430db.

• This patch merges cleanly.

[SparkQA]

QA tests have finished for PR 2666 at commit 11430db.

• This patch passes unit tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • case class CacheTableCommand(tableName: String, plan: Option[LogicalPlan], isLazy: Boolean)
  • case class UncacheTableCommand(tableName: String) extends Command
  • case class CacheTableCommand(
  • case class UncacheTableCommand(tableName: String) extends LeafNode with Command
  • case class DescribeCommand(child: SparkPlan, output: Seq[Attribute])(

[marmbrus]

Thanks! Merged to master.