From 6d4744f93b829455bdf699ee8a7549f312044f21 Mon Sep 17 00:00:00 2001 From: Chakru <161002324+chakru-r@users.noreply.github.com> Date: Thu, 6 Mar 2025 06:28:46 +0530 Subject: [PATCH] doc(iceberg): iceberg doc updates (#12787) Co-authored-by: Shirshanka Das --- docs/iceberg-catalog.md | 10 +++++++--- 1 file changed, 7 insertions(+), 3 deletions(-) diff --git a/docs/iceberg-catalog.md b/docs/iceberg-catalog.md index c11a2fb270f015..a4461a2cfc4a02 100644 --- a/docs/iceberg-catalog.md +++ b/docs/iceberg-catalog.md @@ -46,6 +46,8 @@ Before starting, ensure you have: DH_ICEBERG_DATA_ROOT="s3://your-bucket/path" ``` + The `DH_ICEBERG_CLIENT_ID` is the `AWS_ACCESS_KEY_ID` and `DH_ICEBERG_CLIENT_SECRET` is the `AWS_SECRET_ACCESS_KEY` + 4. If using pyiceberg, configure pyiceberg to use your local datahub using one of its supported ways. For example, create `~/.pyiceberg.yaml` with ```commandline catalog: @@ -124,8 +126,10 @@ You can create Iceberg tables using PyIceberg with a defined schema. Here's an e -Connect to the DataHub Iceberg Catalog using Spark SQL by defining `$GMS_HOST`, `$GMS_PORT`, `$WAREHOUSE` to connect to and `$USER_PAT` - the DataHub Personal Access Token used to connect to the catalog: -When datahub is running locally, set `GMS_HOST` to `localhost` and `GMS_PORT` to `8080`. +Connect to the DataHub Iceberg Catalog using Spark SQL by defining `$GMS_HOST`, `$GMS_PORT`, `$WAREHOUSE` to connect to and `$USER_PAT` - the DataHub Personal Access Token used to connect to the catalog. +When using DataHub Cloud (Acryl), the Iceberg Catalog URL is `https://.acryl.io/gms/iceberg/` +If you're running DataHub locally, set `GMS_HOST` to `localhost` and `GMS_PORT` to `8080`. + For this example, set `WAREHOUSE` to `arctic_warehouse` ```cli @@ -518,4 +522,4 @@ A: Check that: - [Apache Iceberg Documentation](https://iceberg.apache.org/) - [PyIceberg Documentation](https://py.iceberg.apache.org/) -- [DataHub Documentation](https://datahubproject.io/docs/) \ No newline at end of file +- [DataHub Documentation](https://datahubproject.io/docs/)