Skip to content

Commit

Permalink
Merge pull request #69 from akash-network/provider-docs-gpu-attribtues
Browse files Browse the repository at this point in the history
feat: update provider gpu docs with suggestion to include vram
  • Loading branch information
chainzero authored Mar 22, 2024
2 parents c0c2f72 + 2eb90ee commit d84d92b
Showing 1 changed file with 7 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -448,6 +448,7 @@ Providers must be updated with attributes in order to bid on the GPUs.
- GPU model template is used in the subsequent `Provider Configuration File`
- Multiple such entries should be included in the `Provider Configuration File` if the providers has multiple GPU types
- Currently Akash providers may only host one GPU type per worker node. But different GPU models/types may be hosted on separate Kubernetes nodes.
- We recommend including both a GPU attribute which includes VRAM and a GPU attribute which does not include VRAM to ensure your provider bids when the deployer includes/excludes VRAM spec. Example of this recommended approach in the `provider.yaml` example below.

```
capabilities/gpu/vendor/<vendor name>/model/<model name>: true
Expand Down Expand Up @@ -485,7 +486,9 @@ attributes:
value: akash
- key: tier
value: community
- key: capabilities/gpu/vendor/nvidia/model/a4000
- key: capabilities/gpu/vendor/nvidia/model/rtx8000
value: true
- key: capabilities/gpu/vendor/nvidia/model/rtx8000/ram/48Gi
value: true
```

Expand Down Expand Up @@ -545,7 +548,9 @@ provider-services query provider get <provider-address>
value: community
- key: organization
value: akash test provider
- key: capabilities/gpu/vendor/nvidia/model/t4
- key: capabilities/gpu/vendor/nvidia/model/rtx8000
value: "true"
- key: capabilities/gpu/vendor/nvidia/model/rtx8000/ram/48Gi
value: "true"
host_uri: https://provider.akashtestprovider.xyz:8443
info:
Expand Down

0 comments on commit d84d92b

Please sign in to comment.