Tracking

Manage files in storage

def add_file(self, 
             bucket, 
             object_name, 
             findability, 
             owner, 
             owner_id, 
             dataset_id, 
             flow_id, 
             size, 
             created_at):
    # Record a file was added to the storage
    pass

API

Get info about file

storage/info/<bucket>/<path:object_name>

return

{
  "bucket": "the-bucket",
  "object_name": "path/to/file",
  "findability": "published/unlisted/private/etc.",
  "owner": "username",
  "owner_id": "userid",
  "dataset_id": "owner/dataset-name",
  "last_flow_id": "owner/dataset-name/100",
  "flow_ids": ["owner/dataset-name/99", "owner/dataset-name/100"],  
  "size": 1234,
  "created_at": "2017-09-23T12:00:00"
}

Get total size for owner/dataset/flow

storage/owner/<owner> storage/dataset_id/<path:dataset_id> storage/flow_id/<path:flow_id>

return

{
  "totalBytes": 12345
}

An optional query parameter findability can be added to filter by findability, e.g. ?findability=unlisted.

Contributing

Please read the contribution guideline:

How to Contribute

Thanks!