Skip to content

Spark: Backport LICENSE and NOTICE changes to 1.10.x (#16142) #16162

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
amogh-jahagirdar merged 3 commits into from
Apr 29, 2026
Merged

Spark: Backport LICENSE and NOTICE changes to 1.10.x (#16142) #16162

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
364afad
Spark: Backport LICENSE and NOTICE changes to 1.10.x (#16142)
rdblue Apr 29, 2026
f943f0f
Keep jetbrains annotations in License/Notice
amogh-jahagirdar Apr 29, 2026
e40d066
fix newlines
amogh-jahagirdar Apr 29, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
211 changes: 116 additions & 95 deletions spark/v3.4/spark-runtime/LICENSE
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -203,77 +203,82 @@

--------------------------------------------------------------------------------

This binary artifact contains Apache Avro.
This product bundles Apache Avro.

Copyright: Copyright 2010-2019 The Apache Software Foundation
Home page: https://avro.apache.org/
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://avro.apache.org/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

@rdblue rdblue Apr 29, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's unfortunate that changes to formatting were introduced in main that cause unnecessary changes to the content like this. But I think it is probably better to get in sync with main than to try to apply the same changes from that review manually.


--------------------------------------------------------------------------------

This binary artifact contains the Jackson JSON processor.
This product bundles Jackson JSON processor.

Copyright: 2007-2019 Tatu Saloranta and other contributors
Home page: http://jackson.codehaus.org/
License: http://www.apache.org/licenses/LICENSE-2.0.txt
Project URL: https://github.com/FasterXML/jackson
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains Apache Parquet.
This product bundles Apache Parquet.

Copyright: 2014-2024 The Apache Software Foundation
Home page: https://parquet.apache.org/
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://parquet.apache.org/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains Apache Thrift.
This product bundles Apache Thrift (bundled by Parquet).

Copyright: 2006-2017 The Apache Software Foundation.
Home page: https://thrift.apache.org/
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://thrift.apache.org/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains code from Daniel Lemire's JavaFastPFOR project.
This product includes code from Daniel Lemire's JavaFastPFOR project (bundled by Parquet).

Copyright: 2013 Daniel Lemire
Home page: https://github.com/lemire/JavaFastPFOR
License: Apache License Version 2.0 http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://github.com/lemire/JavaFastPFOR
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains fastutil.
This product bundles fastutil (bundled by Parquet).

Copyright: 2002-2014 Sebastiano Vigna
Home page: http://fastutil.di.unimi.it/
License: http://www.apache.org/licenses/LICENSE-2.0.html
Project URL: http://fastutil.di.unimi.it/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This product bundles Zero-Allocation Hashing (bundled by Parquet).

Project URL: https://github.com/OpenHFT/Zero-Allocation-Hashing
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains Apache ORC.
This product bundles Apache ORC.

Copyright: 2013 and onwards The Apache Software Foundation.
Home page: https://orc.apache.org/
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://orc.apache.org/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains Apache Hive's storage API via ORC.
This product bundles Apache Hive's Storage API (bundled by ORC).

Copyright: 2008-2020 The Apache Software Foundation
Home page: https://hive.apache.org/
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://hive.apache.org/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains Google protobuf via ORC.
This product bundles Google protobuf (bundled by ORC).

Copyright: 2008 Google Inc.
Home page: https://developers.google.com/protocol-buffers
License: https://github.com/protocolbuffers/protobuf/blob/master/LICENSE (BSD)

License text:
Project URL: https://developers.google.com/protocol-buffers
License: BSD 3-Clause

| Copyright 2008 Google Inc. All rights reserved.
|
Expand Down Expand Up @@ -310,61 +315,59 @@ License text:

--------------------------------------------------------------------------------

This binary artifact contains Airlift Aircompressor.
This product bundles Airlift Aircompressor.

Copyright: 2011-2019 Aircompressor authors.
Home page: https://github.com/airlift/aircompressor
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://github.com/airlift/aircompressor
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains JetBrains annotations.

@amogh-jahagirdar amogh-jahagirdar Apr 29, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I changed the wording "binary artifact contains" to "product bundles" to match what is there in the other changes.

@rdblue rdblue Apr 29, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to avoid making changes that are not substantive like that. It's too bad those made it into main.

This product bundles JetBrains annotations.

Copyright: 2000-2020 JetBrains s.r.o.
Home page: https://github.com/JetBrains/java-annotations
License: http://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains code from Cloudera Kite.
This product includes code from Cloudera Kite.

Copyright: 2013-2017 Cloudera Inc.
Home page: https://kitesdk.org/
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://kitesdk.org/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains code from Presto.
This product includes code from Presto.

Copyright: 2016 Facebook and contributors
Home page: https://prestodb.io/
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://prestodb.io/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains Google Guava.
This product bundles Google Guava.

Copyright: 2006-2019 The Guava Authors
Home page: https://github.com/google/guava
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://github.com/google/guava
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains Google Error Prone Annotations.
This product bundles Google Error Prone Annotations.

Copyright: Copyright 2011-2019 The Error Prone Authors
Home page: https://github.com/google/error-prone
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://github.com/google/error-prone
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains checkerframework checker-qual Annotations.
This product bundles checkerframework checker-qual.

Copyright: 2004-2019 the Checker Framework developers
Home page: https://github.com/typetools/checker-framework
License: https://github.com/typetools/checker-framework/blob/master/LICENSE.txt (MIT license)

License text:
Project URL: https://github.com/typetools/checker-framework
License: MIT license
| The annotations are licensed under the MIT License. (The text of this
| license appears below.) More specifically, all the parts of the Checker
| Framework that you might want to include with your own program use the
Expand Down Expand Up @@ -395,46 +398,43 @@ License text:

--------------------------------------------------------------------------------

This binary artifact contains Caffeine by Ben Manes.
This product bundles Caffeine by Ben Manes.

Copyright: 2014-2019 Ben Manes and contributors
Home page: https://github.com/ben-manes/caffeine
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://github.com/ben-manes/caffeine
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains Apache Arrow.
This product bundles Apache Arrow.

Copyright: 2016-2019 The Apache Software Foundation.
Home page: https://arrow.apache.org/
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://arrow.apache.org/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains Netty's buffer library.
This product bundles Netty.

Copyright: 2014-2020 The Netty Project
Home page: https://netty.io/
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://netty.io/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains Google FlatBuffers.
This product bundles Google FlatBuffers.

Copyright: 2013-2020 Google Inc.
Home page: https://google.github.io/flatbuffers/
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://google.github.io/flatbuffers/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains ThreeTen.
This product bundles ThreeTen Extra.

Copyright: 2007-present, Stephen Colebourne & Michael Nascimento Santos.
Home page: https://www.threeten.org/threeten-extra/
License: https://github.com/ThreeTen/threeten-extra/blob/master/LICENSE.txt (BSD 3-clause)

License text:

Project URL: https://www.threeten.org/threeten-extra/
License: BSD 3-Clause
| All rights reserved.
|
| * Redistribution and use in source and binary forms, with or without
Expand Down Expand Up @@ -465,24 +465,24 @@ License text:

--------------------------------------------------------------------------------

This binary artifact contains code from Project Nessie.
This product bundles Project Nessie.

Copyright: 2015-2025 Dremio Corporation.
Home page: https://projectnessie.org/
License: http://www.apache.org/licenses/LICENSE-2.0
Project URL: https://projectnessie.org/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This product includes code from Apache Spark.
This product bundles and includes code from Apache Spark.

* vectorized reading of definition levels in BaseVectorizedParquetValuesReader.java
* portions of the extensions parser
* casting logic in AssignmentAlignmentSupport
* implementation of SetAccumulator.

Copyright: 2011-2018 The Apache Software Foundation
Home page: https://spark.apache.org/
License: https://www.apache.org/licenses/LICENSE-2.0
Project URL: https://spark.apache.org/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

Expand All @@ -491,48 +491,69 @@ This product includes code from Delta Lake.
* AssignmentAlignmentSupport is an independent development but UpdateExpressionsSupport in Delta was used as a reference.

Copyright: 2020 The Delta Lake Project Authors.
Home page: https://delta.io/
License: https://www.apache.org/licenses/LICENSE-2.0
Project URL: https://delta.io/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary includes code from Apache Commons.
This product includes code from Apache Commons.

* Core ArrayUtil.

Copyright: 2020 The Apache Software Foundation
Home page: https://commons.apache.org/
License: https://www.apache.org/licenses/LICENSE-2.0
Project URL: https://commons.apache.org/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains Apache HttpComponents Client.
This product bundles and includes code from Apache HttpComponents (core/client).

Copyright: 1999-2022 The Apache Software Foundation.
Home page: https://hc.apache.org/
License: http://www.apache.org/licenses/LICENSE-2.0
* retry and error handling logic in ExponentialHttpRequestRetryStrategy.java

Copyright: 1999-2022 The Apache Software Foundation
Project URL: https://hc.apache.org/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This product includes code from Apache HttpComponents Client.
This product bundles failsafe.

* retry and error handling logic in ExponentialHttpRequestRetryStrategy.java
Copyright: Jonathan Halterman and friends
Project URL: https://failsafe.dev/
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

Copyright: 1999-2022 The Apache Software Foundation.
Home page: https://hc.apache.org/
License: https://www.apache.org/licenses/LICENSE-2.0
This product bundles Eclipse MicroProfile OpenAPI.

Project URL: https://github.com/microprofile/microprofile-open-api
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This binary artifact contains failsafe.
This product bundles Eclipse Collections.

Copyright: Jonathan Halterman and friends
Home page: https://failsafe.dev/
License: https://www.apache.org/licenses/LICENSE-2.0.html
Project URL: https://github.com/eclipse-collections/eclipse-collections
License: Eclipse Public License v. 1.0 - https://www.eclipse.org/legal/epl-v10.html

--------------------------------------------------------------------------------

This product bundles Apache Datasketches.

Project URL: https://datasketches.apache.org
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0

--------------------------------------------------------------------------------

This product bundles JTS Topology Suite.

Project URL: https://github.com/locationtech/jts
License: Eclipse Public License v. 2.0 - https://www.eclipse.org/org/documents/epl-2.0/EPL-2.0.txt

--------------------------------------------------------------------------------

This binary artifact contains Eclipse MicroProfile OpenAPI.
This product bundles RoaringBitmap.

Home page: https://github.com/microprofile/microprofile-open-api
License: https://www.apache.org/licenses/LICENSE-2.0
Copyright: (c) 2013-... the RoaringBitmap authors
Project URL: https://github.com/RoaringBitmap/RoaringBitmap
License: Apache License, Version 2.0 - https://www.apache.org/licenses/LICENSE-2.0
Loading
Loading