Code

WIP: Add ratchet-downloader#23

Code

Closed

sigma-andex wants to merge 14 commits intohuggingface:masterhuggingface/ratchet:masterfrom sigma-andex:ratchet-downloadersigma-andex/ratchet:ratchet-downloaderCopy head branch name to clipboard

+667-11

Commits

Commits on Jan 21, 2024

• WIP: Add ratchet-downloader

  sigma-andex

  committed
  b8867bd

  Copy full SHA for b8867bd

Commits on Jan 23, 2024

• First working test byob reader + stream parsing

  sigma-andex

  committed
  02dad10

  Copy full SHA for 02dad10

Commits on Jan 24, 2024

• Start with header parsing

  sigma-andex

  committed
  b164c33

  Copy full SHA for b164c33

• Prepare metdata_kv parsing

  sigma-andex

  committed
  3340889

  Copy full SHA for 3340889

• Parse string & metadata_kv

  sigma-andex

  committed
  f7a4456

  Copy full SHA for f7a4456

• Add metadata value type parsing

  sigma-andex

  committed
  d1c6d99

  Copy full SHA for d1c6d99

Commits on Jan 25, 2024

• Parse metadata kv types

  sigma-andex

  committed
  9fee169

  Copy full SHA for 9fee169

• Finish header parsing

  sigma-andex

  committed
  d3a8fba

  Copy full SHA for d3a8fba

Commits on Jan 26, 2024

• Try out ringbuffer

  sigma-andex

  committed
  6c48ccf

  Copy full SHA for 6c48ccf

• Fix

  sigma-andex

  committed
  ede621c

  Copy full SHA for ede621c

Commits on Jan 27, 2024

• Add tensor_info parser. Extract buffered parsing.

  sigma-andex

  committed
  f3abaeb

  Copy full SHA for f3abaeb

• Finish tensor info loading

  sigma-andex

  committed
  b95ac40

  Copy full SHA for b95ac40

• Get alignment

  sigma-andex

  committed
  402e01d

  Copy full SHA for 402e01d

• Head exploding

  sigma-andex

  committed
  9d83349

  Copy full SHA for 9d83349