Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions docs/source/user-guide/latest/compatibility/spark-versions.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,10 @@ compatibility guide.

Spark 3.4.3 is supported with Java 11/17 and Scala 2.12/2.13.

```{warning}
Spark 3.4 support is deprecated as of the 1.0.0 release and will be removed in the 1.1.0 release.
```

### Known Limitations

- **Reading `TimestampLTZ` as `TimestampNTZ`**: Spark 3.4 raises an error for this operation
Expand All @@ -43,6 +47,11 @@ Spark 3.4.3 is supported with Java 11/17 and Scala 2.12/2.13.

Spark 3.5.8 is supported with Java 11/17 and Scala 2.12/2.13.

```{warning}
JDK 11 support is deprecated as of the 1.0.0 release and will be removed in the 1.1.0 release.
We recommend moving to JDK 17 or later.
```

### Known Limitations

- **Reading `TimestampLTZ` as `TimestampNTZ`**: Spark 3.5 raises an error for this operation
Expand Down
5 changes: 5 additions & 0 deletions docs/source/user-guide/latest/installation.md
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,11 @@ in the [Compatibility Guide] for more information, such as known limitations per
We recommend only using Comet with Spark versions where we currently have both Comet and Spark tests enabled in CI.
Other versions may work well enough for development and evaluation purposes.

```{warning}
JDK 11 and Spark 3.4 support are deprecated as of the 1.0.0 release and will be removed in the 1.1.0 release.
We recommend moving to JDK 17 or later and Spark 3.5 or later.
```

| Spark Version | Java Version | Scala Version | Comet Tests in CI | Spark SQL Tests in CI |
| ------------- | ------------ | ------------- | ----------------- | --------------------- |
| 3.4.3 | 11/17 | 2.12/2.13 | Yes | Yes |
Expand Down