Skip to content

Commit cf4fd68

Browse files
committed
Implement specific setup steps requested in PR review
- Step 1: Create new folder and docker-compose.yml from Databricks repo - Step 2: Create docker-compose.override.yml with ClickHouse configuration - Step 3: Run docker compose up - Step 4: Wait for services and check logs This addresses Blargian's specific feedback in PR #4031 for clearer setup instructions.
1 parent 89d0d7c commit cf4fd68

File tree

1 file changed

+25
-30
lines changed

1 file changed

+25
-30
lines changed

docs/use-cases/data_lake/rest_catalog.md

Lines changed: 25 additions & 30 deletions
Original file line numberDiff line numberDiff line change
@@ -44,45 +44,40 @@ For local development and testing, you can use a containerized REST catalog setu
4444

4545
You can use various containerized REST catalog implementations such as **[Databricks docker-spark-iceberg](https://github.com/databricks/docker-spark-iceberg/blob/main/docker-compose.yml?ref=blog.min.io)** which provides a complete Spark + Iceberg + REST catalog environment with docker-compose, making it ideal for testing Iceberg integrations.
4646

47-
**Step 1:** Clone or download the docker-compose setup from the Databricks repository.
47+
**Step 1:** Create a new folder in which to run the example, then create a file `docker-compose.yml` with the configuration from [Databricks docker-spark-iceberg](https://github.com/databricks/docker-spark-iceberg/blob/main/docker-compose.yml?ref=blog.min.io).
4848

49-
**Step 2:** Add ClickHouse as a service to your docker-compose.yml file:
49+
**Step 2:** Next, create a file `docker-compose.override.yml` and place the following ClickHouse container configuration into it:
5050

5151
```yaml
52-
clickhouse:
53-
image: clickhouse/clickhouse-server:main
54-
container_name: clickhouse
55-
user: '0:0' # Ensures root permissions
56-
ports:
57-
- "8123:8123"
58-
- "9002:9000"
59-
volumes:
60-
- ./clickhouse:/var/lib/clickhouse
61-
- ./clickhouse/data_import:/var/lib/clickhouse/data_import # Mount dataset folder
62-
networks:
63-
- iceberg_net
64-
environment:
65-
- CLICKHOUSE_DB=default
66-
- CLICKHOUSE_USER=default
67-
- CLICKHOUSE_DO_NOT_CHOWN=1
68-
- CLICKHOUSE_PASSWORD=
52+
version: '3.8'
53+
54+
services:
55+
clickhouse:
56+
image: clickhouse/clickhouse-server:main
57+
container_name: clickhouse
58+
user: '0:0' # Ensures root permissions
59+
ports:
60+
- "8123:8123"
61+
- "9002:9000"
62+
volumes:
63+
- ./clickhouse:/var/lib/clickhouse
64+
- ./clickhouse/data_import:/var/lib/clickhouse/data_import # Mount dataset folder
65+
networks:
66+
- iceberg_net
67+
environment:
68+
- CLICKHOUSE_DB=default
69+
- CLICKHOUSE_USER=default
70+
- CLICKHOUSE_DO_NOT_CHOWN=1
71+
- CLICKHOUSE_PASSWORD=
6972
```
7073
71-
**Step 3:** Ensure your docker-compose.yml includes the necessary network configuration:
72-
73-
```yaml
74-
networks:
75-
iceberg_net:
76-
driver: bridge
77-
```
78-
79-
**Step 4:** Start the entire stack:
74+
**Step 3:** Run the following command to start the services:
8075
8176
```bash
82-
docker-compose up -d
77+
docker compose up
8378
```
8479

85-
**Step 5:** Wait for all services to be ready. You can check the logs:
80+
**Step 4:** Wait for all services to be ready. You can check the logs:
8681

8782
```bash
8883
docker-compose logs -f

0 commit comments

Comments
 (0)