Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] The Tispark task failed when injecting one pd, one voter, and one learner failure are injected at the same time(Simulated one AZ failure #2705

Closed
Lily2025 opened this issue May 19, 2023 · 2 comments
Assignees
Labels

Comments

@Lily2025
Copy link

Describe the bug

What did you do
df=spark.sql("select * from sysbench_1_100000000000.sbtest1")
df.write.format('csv').save('ks3://qe-testing/kernel-testing/rel-read-learner-leader-05191158',mode="overwrite")

What do you expect
The Tispark task can be succeed when injecting one pd, one voter, and one learner failure are injected at the same time

What happens instead
The Tispark task failed when injecting one pd, one voter, and one learner failure are injected at the same time(Simulated one AZ failure
image

Spark and TiSpark version info
TiDB: v6.5.0
TiSpark: v3.2.1, Spark: 3.3.2

Additional context

@Lily2025
Copy link
Author

/type bug
/severity critical
/assign shiyuhang0

@shiyuhang0
Copy link
Member

TiSpark config:

park.sql.extensions  org.apache.spark.sql.TiExtensions
spark.tispark.pd.addresses  10.99.182.141:2379
spark.sql.catalog.tidb_catalog  org.apache.spark.sql.catalyst.catalog.TiCatalog
spark.sql.catalog.tidb_catalog.pd.addresses  10.99.182.141:2379
spark.sql.auth.enable false
spark.tispark.replica_read learner,leader

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants