Hi All,
TiSpark 3.0.0 was officially released on June 15th, 2022. The full changelog is as follows:
Compatibility Changes
- TiSpark without catalog plugin is no more supported. You must configure catalog configs and use tidb_catalog now #2252
- TiSpark’s jar has a new naming rule like
tispark-assembly-{$spark_version}_{$scala_version}-{$tispark_verison}#2370
New Feature
- Support DELETE statement #2276
- Support Spark 3.2 #2287
- Support telemetry to collect information #2316
- Support stale read to read historical versions of data #2322
- Support TLS with reload capability #2306 #2349 #2365 #2377
Fixes
- Fix the wrong result of _tidb_rowid when set
spark.tispark.show_rowid=true#2270 - Fix sum not push down bug #2314
- Fix limit not push down bug #2329
- Avoid NoSuchElementException when setting catalog #2220
- Avoid ClassCastException when cluster index with type Timestamp and Date #2319
- Improve retry logic in write so that it will not retry in some scenarios which needn’t retry #2279
- Delete unused configuration
spark.tispark.statistics.auto_load#2300 - Upgrade jackson-databind from 2.9.10.8 to 2.12.6.1 #2285
- Upgrade guava from 26.0-android to 29.0-android #2340
- Upgrade mysql-connector-java from 5.1.44 to 5.1.49 #2367