Skip to content

Commit

Permalink
[sdlf-stage-glue] handling of storage parameters
Browse files Browse the repository at this point in the history
  • Loading branch information
cnfait committed Nov 25, 2024
1 parent 26b670b commit 6381e03
Showing 1 changed file with 10 additions and 18 deletions.
28 changes: 10 additions & 18 deletions sdlf-stage-glue/src/glue.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -39,14 +39,22 @@ Parameters:
Description: EventBridge schedule group for the dataset
Type: String
Default: "" # if not provided, pDatasetDeploymentInstance must be specified
pStorageDeploymentInstance:
Type: String
Description: The string uniquely identifying a sdlf-foundations deployment in this AWS account
Default: "" # see below comments
pRawBucket:
Description: Raw bucket
Type: String
Default: "{{resolve:ssm:/sdlf/storage/rRawBucket/dev}}"
Default: "" # if not provided, pStorageDeploymentInstance must be specified
pStageBucket:
Description: Stage bucket
Type: String
Default: "{{resolve:ssm:/sdlf/storage/rStageBucket/dev}}"
Default: "" # if not provided, pStorageDeploymentInstance must be specified
pAnalyticsBucket:
Description: Analytics bucket
Type: String
Default: "" # if not provided, pStorageDeploymentInstance must be specified
pDataset:
Description: The name of the dataset (all lowercase, no symbols or spaces)
Type: String
Expand Down Expand Up @@ -292,22 +300,6 @@ Resources:
Principal:
Service: lambda.amazonaws.com
Action: sts:AssumeRole
Policies:
- PolicyName: !Sub sdlf-${pDataset}-${pPipeline}-${pStageName}-metadata
PolicyDocument:
Version: "2012-10-17"
Statement:
- Effect: Allow
Action:
- s3:ListBucket
Resource:
- !Sub arn:${AWS::Partition}:s3:::${pRawBucket}
- !Sub arn:${AWS::Partition}:s3:::${pStageBucket}
- Effect: Allow
Action:
- s3:GetObject
Resource:
- !Sub arn:${AWS::Partition}:s3:::${pStageBucket}/${pDataset}/*

# Error Handling Lambda Role
rRoleLambdaExecutionErrorStep:
Expand Down

0 comments on commit 6381e03

Please sign in to comment.