You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Implement specific setup steps requested in PR review
- Step 1: Create new folder and docker-compose.yml from Databricks repo
- Step 2: Create docker-compose.override.yml with ClickHouse configuration
- Step 3: Run docker compose up
- Step 4: Wait for services and check logs
This addresses Blargian's specific feedback in PR #4031 for clearer setup instructions.
Copy file name to clipboardExpand all lines: docs/use-cases/data_lake/rest_catalog.md
+25-30Lines changed: 25 additions & 30 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -44,45 +44,40 @@ For local development and testing, you can use a containerized REST catalog setu
44
44
45
45
You can use various containerized REST catalog implementations such as **[Databricks docker-spark-iceberg](https://github.com/databricks/docker-spark-iceberg/blob/main/docker-compose.yml?ref=blog.min.io)** which provides a complete Spark + Iceberg + REST catalog environment with docker-compose, making it ideal for testing Iceberg integrations.
46
46
47
-
**Step 1:**Clone or download the docker-compose setup from the Databricks repository.
47
+
**Step 1:**Create a new folder in which to run the example, then create a file `docker-compose.yml` with the configuration from [Databricks docker-spark-iceberg](https://github.com/databricks/docker-spark-iceberg/blob/main/docker-compose.yml?ref=blog.min.io).
48
48
49
-
**Step 2:**Add ClickHouse as a service to your docker-compose.yml file:
49
+
**Step 2:**Next, create a file `docker-compose.override.yml` and place the following ClickHouse container configuration into it:
50
50
51
51
```yaml
52
-
clickhouse:
53
-
image: clickhouse/clickhouse-server:main
54
-
container_name: clickhouse
55
-
user: '0:0'# Ensures root permissions
56
-
ports:
57
-
- "8123:8123"
58
-
- "9002:9000"
59
-
volumes:
60
-
- ./clickhouse:/var/lib/clickhouse
61
-
- ./clickhouse/data_import:/var/lib/clickhouse/data_import # Mount dataset folder
62
-
networks:
63
-
- iceberg_net
64
-
environment:
65
-
- CLICKHOUSE_DB=default
66
-
- CLICKHOUSE_USER=default
67
-
- CLICKHOUSE_DO_NOT_CHOWN=1
68
-
- CLICKHOUSE_PASSWORD=
52
+
version: '3.8'
53
+
54
+
services:
55
+
clickhouse:
56
+
image: clickhouse/clickhouse-server:main
57
+
container_name: clickhouse
58
+
user: '0:0'# Ensures root permissions
59
+
ports:
60
+
- "8123:8123"
61
+
- "9002:9000"
62
+
volumes:
63
+
- ./clickhouse:/var/lib/clickhouse
64
+
- ./clickhouse/data_import:/var/lib/clickhouse/data_import # Mount dataset folder
65
+
networks:
66
+
- iceberg_net
67
+
environment:
68
+
- CLICKHOUSE_DB=default
69
+
- CLICKHOUSE_USER=default
70
+
- CLICKHOUSE_DO_NOT_CHOWN=1
71
+
- CLICKHOUSE_PASSWORD=
69
72
```
70
73
71
-
**Step 3:** Ensure your docker-compose.yml includes the necessary network configuration:
72
-
73
-
```yaml
74
-
networks:
75
-
iceberg_net:
76
-
driver: bridge
77
-
```
78
-
79
-
**Step 4:** Start the entire stack:
74
+
**Step 3:** Run the following command to start the services:
80
75
81
76
```bash
82
-
docker-compose up -d
77
+
dockercompose up
83
78
```
84
79
85
-
**Step 5:** Wait for all services to be ready. You can check the logs:
80
+
**Step 4:** Wait for all services to be ready. You can check the logs:
0 commit comments