Skip to content

Commit 65418e6

Browse files
committed
fix(ci): add download retries on spark image
Signed-off-by: Cortland Goffena <30168413+cmgoffena13@users.noreply.github.com>
1 parent f180e03 commit 65418e6

1 file changed

Lines changed: 9 additions & 3 deletions

File tree

  • tests/core/engine_adapter/integration/docker/spark

‎tests/core/engine_adapter/integration/docker/spark/Dockerfile‎

Lines changed: 9 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,12 @@ FROM bitnamilegacy/spark:3.5.2
22
USER root
33
RUN install_packages curl
44
USER 1001
5-
RUN curl https://jdbc.postgresql.org/download/postgresql-42.5.0.jar -o /opt/bitnami/spark/jars/postgresql-42.5.0.jar
6-
RUN curl https://repo1.maven.org/maven2/com/amazonaws/aws-java-sdk-bundle/1.11.704/aws-java-sdk-bundle-1.11.704.jar -o /opt/bitnami/spark/jars/aws-java-sdk-bundle-1.11.704.jar
7-
RUN curl https://repo1.maven.org/maven2/org/apache/iceberg/iceberg-spark-runtime-3.5_2.12/1.4.1/iceberg-spark-runtime-3.5_2.12-1.4.1.jar -o /opt/bitnami/spark/jars/iceberg-spark-runtime-3.5_2.12-1.4.1.jar
5+
RUN curl --fail --show-error --location --retry 3 --retry-delay 5 --retry-all-errors \
6+
-o /opt/bitnami/spark/jars/postgresql-42.5.0.jar \
7+
https://jdbc.postgresql.org/download/postgresql-42.5.0.jar
8+
RUN curl --fail --show-error --location --retry 3 --retry-delay 5 --retry-all-errors \
9+
-o /opt/bitnami/spark/jars/aws-java-sdk-bundle-1.11.704.jar \
10+
https://repo1.maven.org/maven2/com/amazonaws/aws-java-sdk-bundle/1.11.704/aws-java-sdk-bundle-1.11.704.jar
11+
RUN curl --fail --show-error --location --retry 3 --retry-delay 5 --retry-all-errors \
12+
-o /opt/bitnami/spark/jars/iceberg-spark-runtime-3.5_2.12-1.4.1.jar \
13+
https://repo1.maven.org/maven2/org/apache/iceberg/iceberg-spark-runtime-3.5_2.12/1.4.1/iceberg-spark-runtime-3.5_2.12-1.4.1.jar

0 commit comments

Comments
 (0)