Skip to content

Commit

Permalink
[sdlf-stage-glue] Glue Crawler configurable through cfn parameter
Browse files Browse the repository at this point in the history
  • Loading branch information
cnfait committed Nov 21, 2024
1 parent 75d8610 commit b90758b
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion sdlf-stage-glue/src/glue.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,10 @@ Parameters:
Description: KMS key set as infra key for the dataset
Type: String
Default: "{{resolve:ssm:/sdlf/dataset/rKMSInfraKey/dev}}"
pDatasetGlueCrawler:
Description: Glue crawler for the dataset
Type: String
Default: "{{resolve:ssm:/sdlf/dataset/rStageGlueCrawler/dev}}"
pOrg:
Description: Name of the organization owning the datalake
Type: String
Expand Down Expand Up @@ -511,7 +515,7 @@ Resources:
lWorkerType: !Ref pGlueWorkerType
lNumberOfWorkers: !Ref pGlueNumberOfWorkers
# lArguments:
lCrawlerName: "sdlf-legislators-stage-crawler"
lCrawlerName: !Ref pDatasetGlueCrawler
lWaitTime: 75
Role: !GetAtt rStatesExecutionRole.Arn
Tracing:
Expand Down

0 comments on commit b90758b

Please sign in to comment.