Skip to content

Commit

Permalink
doc(iceberg): iceberg doc updates
Browse files Browse the repository at this point in the history
  • Loading branch information
chakru-r committed Mar 5, 2025
1 parent cc3782e commit ff99030
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion docs/iceberg-catalog.md
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,8 @@ Before starting, ensure you have:
DH_ICEBERG_DATA_ROOT="s3://your-bucket/path"

```
The `DH_ICEBERG_CLIENT_ID` is the `AWS_ACCESS_KEY_ID` and `DH_ICEBERG_CLIENT_SECRET` is the `AWS_SECRET_ACCESS_KEY`

4. If using pyiceberg, configure pyiceberg to use your local datahub using one of its supported ways. For example, create `~/.pyiceberg.yaml` with
```commandline
catalog:
Expand Down Expand Up @@ -125,7 +127,9 @@ You can create Iceberg tables using PyIceberg with a defined schema. Here's an e
<TabItem value="spark" label="spark-sql" default>

Connect to the DataHub Iceberg Catalog using Spark SQL by defining `$GMS_HOST`, `$GMS_PORT`, `$WAREHOUSE` to connect to and `$USER_PAT` - the DataHub Personal Access Token used to connect to the catalog:
When datahub is running locally, set `GMS_HOST` to `localhost` and `GMS_PORT` to `8080`.
When datahub is running locally, set `GMS_HOST` to `localhost` and `GMS_PORT` to `8080`.
When using Acryl Cloud, the Iceberg Catalog URL is `https://<your-instance>.acryl.io/gms/iceberg/`

For this example, set `WAREHOUSE` to `arctic_warehouse`

```cli
Expand Down

0 comments on commit ff99030

Please sign in to comment.