Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
fix(Jetstream Pt): batch returned in prefill initialized to None
This is required when there are no more tokens generated after prefill.
- Loading branch information