Replace MinIO with SeaweedFS in quickstart and docker-compose#15577
Replace MinIO with SeaweedFS in quickstart and docker-compose#15577chrislusf wants to merge 8 commits intoapache:mainfrom
Conversation
chrislusf
force-pushed
the
replace-minio-with-seaweedfs
branch
16 times, most recently
from
88fba7e to
f6642ad
Compare
MinIO is under maintenance mode and its Docker images have unpatched CVE vulnerabilities. Replace it with SeaweedFS mini mode, which provides an S3-compatible API in a lightweight single-binary deployment. Closes apache#14638
chrislusf
force-pushed
the
replace-minio-with-seaweedfs
branch
from
f6642ad to
32ffded
Compare
Fokko
left a comment
Fokko
left a comment
There was a problem hiding this comment.
This looks like a reasonable alternative to me. Seaweedfs seems to be well established: https://github.com/seaweedfs/seaweedfs
|
there are a few more references of "minio" in the codebase (current branch) we should at least fix the sql and md files first |
|
Here are a few other discussions around replacing minio: lets bring this up at the community sync tomorrow |
| hostname: minio | ||
| # SeaweedFS for S3-compatible object storage (mini mode) | ||
| seaweedfs: | ||
| image: chrislusf/seaweedfs:latest |
There was a problem hiding this comment.
nit: can we pin to a hash instead?
There was a problem hiding this comment.
I changed kafka-connect/kafka-connect-runtime/docker/docker-compose.yml and docker/iceberg-flink-quickstart/docker-compose.yml to a specific tag. They are used for CI, and better not fail due to docker image changes.
The site/docs/spark-quickstart.md isfor documentation purpose. Having a specific version in the documentation is an eyesore and may waste efforts to keep things up-to-date. So I just cleaned up the tag latest.
…ation guide Update S3 endpoint references from minio:9000 to seaweedfs:8333 to match the docker-compose configuration. Update Daft integration guide to reference SeaweedFS instead of MinIO.
SeaweedFS integration tests use GenericContainer from the core testcontainers library, so the dedicated MinIO module is no longer needed.
Replace MinioUtil with SeaweedFSUtil backed by GenericContainer running chrislusf/seaweedfs in mini mode. Update all S3 integration tests (TestS3FileIO, TestS3InputStream, TestS3OutputStream, TestS3RestSigner) to use the new utility. Rename TestS3FileIOWithLegacyMinIO to TestS3FileIOWithLegacyMd5.
4.17 to resolve v2 object listing
chrislusf
force-pushed
the
replace-minio-with-seaweedfs
branch
from
d91184e to
0284990
Compare
@kevinjqliu all minio references are changed, except one in the changelog. |
4 participants
Summary
Replace MinIO with SeaweedFS mini mode in quickstart and docker-compose files.
MinIO is under maintenance mode and its Docker images have unpatched CVE vulnerabilities (#14638). SeaweedFS mini mode is a single-binary S3-compatible storage server that is actively maintained and lightweight.
Changes
site/docs/spark-quickstart.mddocker/iceberg-flink-quickstart/docker-compose.ymlkafka-connect/.../docker-compose.ymlkafka-connect/.../TestContext.javaCloses #14638