Skip to content

Commit cf26c42

Browse files
dongjoon-hyundongjoon-hyun
committed
[SPARK-56397][BUILD] Upgrade ICU4J to 78.3
### What changes were proposed in this pull request? This PR updates the ICU4J dependency to 78.3. ### Why are the changes needed? To keep the dependency up to date with the latest release. - https://github.com/unicode-org/icu/releases/tag/release-78.3 - unicode-org/icu#3896 - https://cldr.unicode.org/downloads/cldr-48#482-changes ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Code (Claude Opus 4.6) Closes #55264 from dongjoon-hyun/SPARK-56397. Lead-authored-by: Dongjoon Hyun <dongjoon@apache.org> Co-authored-by: dongjoon-hyun <dongjoon-hyun@users.noreply.github.com> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
1 parent 05f6f69 commit cf26c42

8 files changed

Lines changed: 310 additions & 310 deletions

‎dev/deps/spark-deps-hadoop-3-hive-2.3‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -99,7 +99,7 @@ hk2-locator/3.0.6//hk2-locator-3.0.6.jar
9999
hk2-utils/3.0.6//hk2-utils-3.0.6.jar
100100
httpclient/4.5.14//httpclient-4.5.14.jar
101101
httpcore/4.4.16//httpcore-4.4.16.jar
102-
icu4j/78.2//icu4j-78.2.jar
102+
icu4j/78.3//icu4j-78.3.jar
103103
ini4j/0.5.4//ini4j-0.5.4.jar
104104
istack-commons-runtime/4.1.2//istack-commons-runtime-4.1.2.jar
105105
ivy/2.5.3//ivy-2.5.3.jar

‎pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -218,7 +218,7 @@
218218
<datasketches.version>6.2.0</datasketches.version>
219219
<netty.version>4.2.12.Final</netty.version>
220220
<netty-tcnative.version>2.0.75.Final</netty-tcnative.version>
221-
<icu4j.version>78.2</icu4j.version>
221+
<icu4j.version>78.3</icu4j.version>
222222
<junit.version>6.0.3</junit.version>
223223
<jline.version>2.14.6</jline.version>
224224
<!--

‎sql/core/benchmarks/CollationBenchmark-jdk21-results.txt‎

Lines changed: 58 additions & 58 deletions
Original file line numberDiff line numberDiff line change
@@ -1,88 +1,88 @@
1-
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.14.0-1017-azure
2-
AMD EPYC 7763 64-Core Processor
1+
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.17.0-1008-azure
2+
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
33
collation unit benchmarks - equalsFunction: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative time
44
--------------------------------------------------------------------------------------------------------------------------
5-
UTF8_BINARY 1700 1701 2 0.1 16999.2 1.0X
6-
UTF8_LCASE 2677 2680 4 0.0 26769.8 1.6X
7-
UNICODE 16807 16815 12 0.0 168065.3 9.9X
8-
UNICODE_CI 16675 16680 7 0.0 166754.2 9.8X
5+
UTF8_BINARY 1419 1420 1 0.1 14186.9 1.0X
6+
UTF8_LCASE 2787 2787 0 0.0 27869.7 2.0X
7+
UNICODE 16535 16536 2 0.0 165345.4 11.7X
8+
UNICODE_CI 16027 16027 1 0.0 160269.1 11.3X
99

10-
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.14.0-1017-azure
11-
AMD EPYC 7763 64-Core Processor
10+
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.17.0-1008-azure
11+
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
1212
collation unit benchmarks - compareFunction: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative time
1313
---------------------------------------------------------------------------------------------------------------------------
14-
UTF8_BINARY 1772 1772 0 0.1 17715.4 1.0X
15-
UTF8_LCASE 3826 3827 1 0.0 38260.0 2.2X
16-
UNICODE 17744 17749 8 0.0 177438.9 10.0X
17-
UNICODE_CI 17466 17468 4 0.0 174655.7 9.9X
14+
UTF8_BINARY 1656 1657 0 0.1 16562.2 1.0X
15+
UTF8_LCASE 2675 2676 0 0.0 26751.6 1.6X
16+
UNICODE 16196 16198 3 0.0 161955.9 9.8X
17+
UNICODE_CI 15868 15869 1 0.0 158679.6 9.6X
1818

19-
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.14.0-1017-azure
20-
AMD EPYC 7763 64-Core Processor
19+
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.17.0-1008-azure
20+
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
2121
collation unit benchmarks - hashFunction: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative time
2222
------------------------------------------------------------------------------------------------------------------------
23-
UTF8_BINARY 10829 10832 4 0.0 108287.4 1.0X
24-
UTF8_LCASE 17980 17991 14 0.0 179803.1 1.7X
25-
UNICODE 106747 106768 30 0.0 1067468.1 9.9X
26-
UNICODE_CI 153429 153454 35 0.0 1534292.9 14.2X
23+
UTF8_BINARY 10903 10903 1 0.0 109025.6 1.0X
24+
UTF8_LCASE 17399 17400 1 0.0 173994.0 1.6X
25+
UNICODE 117085 117090 8 0.0 1170847.9 10.7X
26+
UNICODE_CI 163656 163688 46 0.0 1636555.3 15.0X
2727

28-
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.14.0-1017-azure
29-
AMD EPYC 7763 64-Core Processor
28+
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.17.0-1008-azure
29+
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
3030
collation unit benchmarks - contains: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative time
3131
------------------------------------------------------------------------------------------------------------------------
32-
UTF8_BINARY 3025 3027 2 0.0 30253.4 1.0X
33-
UTF8_LCASE 14653 14660 10 0.0 146527.7 4.8X
34-
UNICODE 312274 312531 363 0.0 3122742.5 103.2X
35-
UNICODE_CI 321692 321807 162 0.0 3216921.4 106.3X
32+
UTF8_BINARY 2251 2253 2 0.0 22513.9 1.0X
33+
UTF8_LCASE 26923 26924 2 0.0 269231.8 12.0X
34+
UNICODE 482209 482784 813 0.0 4822094.5 214.2X
35+
UNICODE_CI 489363 490452 1540 0.0 4893633.2 217.4X
3636

37-
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.14.0-1017-azure
38-
AMD EPYC 7763 64-Core Processor
37+
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.17.0-1008-azure
38+
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
3939
collation unit benchmarks - startsWith: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative time
4040
------------------------------------------------------------------------------------------------------------------------
41-
UTF8_BINARY 2062 2064 2 0.0 20624.7 1.0X
42-
UTF8_LCASE 9960 9964 6 0.0 99597.4 4.8X
43-
UNICODE 321472 321769 419 0.0 3214722.6 155.9X
44-
UNICODE_CI 324168 324481 443 0.0 3241677.3 157.2X
41+
UTF8_BINARY 1811 1812 1 0.1 18112.7 1.0X
42+
UTF8_LCASE 13875 13878 3 0.0 138753.0 7.7X
43+
UNICODE 498193 499255 1502 0.0 4981931.4 275.1X
44+
UNICODE_CI 509087 509800 1009 0.0 5090869.3 281.1X
4545

46-
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.14.0-1017-azure
47-
AMD EPYC 7763 64-Core Processor
46+
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.17.0-1008-azure
47+
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
4848
collation unit benchmarks - endsWith: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative time
4949
------------------------------------------------------------------------------------------------------------------------
50-
UTF8_BINARY 2060 2061 2 0.0 20595.7 1.0X
51-
UTF8_LCASE 9931 9939 12 0.0 99312.2 4.8X
52-
UNICODE 326090 326389 422 0.0 3260901.9 158.3X
53-
UNICODE_CI 329588 329985 561 0.0 3295881.2 160.0X
50+
UTF8_BINARY 1841 1842 2 0.1 18411.3 1.0X
51+
UTF8_LCASE 13807 13808 2 0.0 138071.5 7.5X
52+
UNICODE 512425 512425 1 0.0 5124248.6 278.3X
53+
UNICODE_CI 512728 513123 559 0.0 5127280.4 278.5X
5454

55-
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.14.0-1017-azure
56-
AMD EPYC 7763 64-Core Processor
55+
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.17.0-1008-azure
56+
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
5757
collation unit benchmarks - initCap using impl execICU: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative time
5858
--------------------------------------------------------------------------------------------------------------------------------------
59-
UNICODE 336 337 1 0.3 3363.9 1.0X
60-
UNICODE_CI 344 344 1 0.3 3436.0 1.0X
59+
UNICODE 351 352 1 0.3 3506.4 1.0X
60+
UNICODE_CI 350 351 1 0.3 3503.6 1.0X
6161

62-
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.14.0-1017-azure
63-
AMD EPYC 7763 64-Core Processor
62+
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.17.0-1008-azure
63+
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
6464
collation unit benchmarks - initCap using impl execBinaryICU: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative time
6565
--------------------------------------------------------------------------------------------------------------------------------------------
66-
UTF8_BINARY 580 581 1 0.2 5795.2 1.0X
67-
UTF8_LCASE 580 582 1 0.2 5803.5 1.0X
68-
UNICODE 580 581 1 0.2 5796.4 1.0X
69-
UNICODE_CI 580 581 1 0.2 5802.4 1.0X
66+
UTF8_BINARY 575 577 1 0.2 5749.9 1.0X
67+
UTF8_LCASE 576 577 1 0.2 5756.6 1.0X
68+
UNICODE 576 578 1 0.2 5762.7 1.0X
69+
UNICODE_CI 575 579 6 0.2 5752.4 1.0X
7070

71-
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.14.0-1017-azure
72-
AMD EPYC 7763 64-Core Processor
71+
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.17.0-1008-azure
72+
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
7373
collation unit benchmarks - initCap using impl execBinary: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative time
7474
-----------------------------------------------------------------------------------------------------------------------------------------
75-
UTF8_BINARY 137 140 1 0.7 1370.0 1.0X
76-
UTF8_LCASE 134 139 3 0.7 1335.7 1.0X
77-
UNICODE 134 139 2 0.7 1340.8 1.0X
78-
UNICODE_CI 134 140 2 0.7 1344.8 1.0X
75+
UTF8_BINARY 149 150 1 0.7 1485.2 1.0X
76+
UTF8_LCASE 148 150 1 0.7 1477.1 1.0X
77+
UNICODE 148 151 1 0.7 1482.8 1.0X
78+
UNICODE_CI 148 151 1 0.7 1476.7 1.0X
7979

80-
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.14.0-1017-azure
81-
AMD EPYC 7763 64-Core Processor
80+
OpenJDK 64-Bit Server VM 21.0.10+7-LTS on Linux 6.17.0-1008-azure
81+
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
8282
collation unit benchmarks - initCap using impl execLowercase: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative time
8383
--------------------------------------------------------------------------------------------------------------------------------------------
84-
UTF8_BINARY 329 334 3 0.3 3288.6 1.0X
85-
UTF8_LCASE 332 336 2 0.3 3319.9 1.0X
86-
UNICODE 336 341 8 0.3 3364.7 1.0X
87-
UNICODE_CI 337 337 1 0.3 3366.3 1.0X
84+
UTF8_BINARY 348 350 1 0.3 3484.1 1.0X
85+
UTF8_LCASE 349 350 1 0.3 3487.0 1.0X
86+
UNICODE 349 350 1 0.3 3488.5 1.0X
87+
UNICODE_CI 349 350 1 0.3 3488.9 1.0X
8888

0 commit comments

Comments
 (0)