[SPARK-56478][INFRA] Remove hamcrest-core-1.3 in the Maven local as a workaround

### What changes were proposed in this pull request?

Retry of f37a0d9

### Why are the changes needed?

Retry of f37a0d9

### Does this PR introduce _any_ user-facing change?

No

### How was this patch tested?

Will monitor the build.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #55358 from HyukjinKwon/SPARK-56478-retry.

Authored-by: Hyukjin Kwon <gurwls223@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>

Author: HyukjinKwon

docs/_plugins/build_api_docs.rb

@@ -45,6 +45,10 @@ def build_spark_if_necessary
 
   print_header "Building Spark."
   cd(SPARK_PROJECT_ROOT)
+  # Maven may leave POM-only org.hamcrest:hamcrest-core trees under ~/.m2; SBT/Coursier then
+  # fails with "file:.../hamcrest-core-*.jar: not found". Clear before invoking SBT.
+  hamcrest_m2 = File.join(Dir.home, '.m2/repository/org/hamcrest/hamcrest-core')
+  FileUtils.rm_rf(hamcrest_m2)
   command = "NO_PROVIDED_SPARK_JARS=0 build/sbt -Phive -Pkinesis-asl clean package"
   puts "Running '#{command}'; this may take a few minutes..."
   system(command) || raise("Failed to build Spark")