Code

sandbox bench experiment workflow#364

Code

Merged

yxdyc merged 76 commits intomainmodelscope/data-juicer:mainfrom dev/dj_bench_demomodelscope/data-juicer:dev/dj_bench_demoCopy head branch name to clipboardAug 2, 2024

+3,817-268

Commits

Commits on Mar 21, 2024

• FVD and ISV for video eval

  BeachWang

  committed
  28f43d5

  Copy full SHA for 28f43d5

• Merge branch 'main' of github.com:alibaba/data-juicer into dev/fvd_eval

  BeachWang

  committed
  dbc1e0a

  Copy full SHA for dbc1e0a

Commits on Mar 26, 2024

• restore tools init

  BeachWang

  committed
  40e69e7

  Copy full SHA for 40e69e7

• restore tools init

  BeachWang

  committed
  8744767

  Copy full SHA for 8744767

• pre-commit done

  BeachWang

  committed
  6ae9b1b

  Copy full SHA for 6ae9b1b

Commits on Mar 29, 2024

• add FID KID IS PR and PRV metrics

  BeachWang

  committed
  173f0ce

  Copy full SHA for 173f0ce

• add KVD metric

  BeachWang

  committed
  809775f

  Copy full SHA for 809775f

Commits on Apr 2, 2024

• fix doc

  BeachWang

  committed
  381cf1c

  Copy full SHA for 381cf1c

Commits on Apr 3, 2024

• allow relative path

  BeachWang

  committed
  535748c

  Copy full SHA for 535748c

Commits on Apr 7, 2024

• fix sample 50000 image

  BeachWang

  committed
  f2cbadb

  Copy full SHA for f2cbadb

Commits on May 7, 2024

• Merge branch 'main' of github.com:alibaba/data-juicer into dev/fvd_eval

  BeachWang

  committed
  4915deb

  Copy full SHA for 4915deb

Commits on May 8, 2024

• fvd sandbox

  BeachWang

  committed
  4ec9efe

  Copy full SHA for 4ec9efe

• fvd sandbox test done

  BeachWang

  committed
  84a5290

  Copy full SHA for 84a5290

• precommit done

  BeachWang

  committed
  c11e045

  Copy full SHA for c11e045

Commits on May 13, 2024

• easyanimate train and infer in sandbox

  BeachWang

  committed
  9a36d7d

  Copy full SHA for 9a36d7d

• merge main

  BeachWang

  committed
  68d83cb

  Copy full SHA for 68d83cb

Commits on May 15, 2024

• divide dataset pipline

  BeachWang

  committed
  280907e

  Copy full SHA for 280907e

Commits on May 16, 2024

• merge fix_sandbox_pipline

  BeachWang

  committed
  95ef2b7

  Copy full SHA for 95ef2b7

• fix data num for each partition

  BeachWang

  committed
  0a897c1

  Copy full SHA for 0a897c1

• Merge branch 'dev/fix_sandbox_pipline' of github.com:alibaba/data-juicer into dev/easyanimate_for_sandbox

  BeachWang

  committed
  87051ce

  Copy full SHA for 87051ce

• pre-commit done

  BeachWang

  committed
  651e946

  Copy full SHA for 651e946

• Merge branch 'dev/fix_sandbox_pipline' of github.com:alibaba/data-juicer into dev/easyanimate_for_sandbox

  BeachWang

  committed
  f6364d4

  Copy full SHA for f6364d4

Commits on May 17, 2024

• test sandbox for videos done

  BeachWang

  committed
  a7e8f79

  Copy full SHA for a7e8f79

• fix executor

  BeachWang

  committed
  bfe8091

  Copy full SHA for bfe8091

• fix executor

  BeachWang

  committed
  d41a01a

  Copy full SHA for d41a01a

• check datalen

  BeachWang

  committed
  fd4bea0

  Copy full SHA for fd4bea0

• sort data for partition

  BeachWang

  committed
  e4d3ecd

  Copy full SHA for e4d3ecd

• sort data for partition

  BeachWang

  committed
  c935adc

  Copy full SHA for c935adc

Commits on May 20, 2024

• fix video_aspect_ratio_filter

  BeachWang

  committed
  846af68

  Copy full SHA for 846af68

• Merge branch 'dev/fix_video_filter_for_bench' into dev/easyanimate_for_sandbox

  BeachWang

  committed
  a4af5dd

  Copy full SHA for a4af5dd

• fix video_aspect_ratio_filter

  BeachWang

  committed
  e31127f

  Copy full SHA for e31127f

Commits on May 23, 2024

• tensor stats to float

  BeachWang

  committed
  cef83d5

  Copy full SHA for cef83d5

• precommit done

  BeachWang

  committed
  67c9db8

  Copy full SHA for 67c9db8

• Merge branch 'dev/fix_video_filter_for_bench' into dev/easyanimate_for_sandbox

  BeachWang

  committed
  00e4a49

  Copy full SHA for 00e4a49

• fix words num filter

  BeachWang

  committed
  828647c

  Copy full SHA for 828647c

• pre-commit done

  BeachWang

  committed
  ac75a53

  Copy full SHA for ac75a53

• Merge branch 'dev/fix_video_filter_for_bench' into dev/easyanimate_for_sandbox

  BeachWang

  committed
  f27273d

  Copy full SHA for f27273d

Commits on May 31, 2024

• add seed for train and infer

  BeachWang

  committed
  db205f3

  Copy full SHA for db205f3

• add seed for easyanimate

  BeachWang

  committed
  3de4ff6

  Copy full SHA for 3de4ff6

• merge

  BeachWang

  committed
  0ebac03

  Copy full SHA for 0ebac03

Commits on Jun 13, 2024

• sandbox rebuild v1

  BeachWang

  committed
  288e416

  Copy full SHA for 288e416

Commits on Jun 14, 2024

• fix empty frames

  BeachWang

  committed
  6738f5d

  Copy full SHA for 6738f5d

Commits on Jun 17, 2024

• switch

  BeachWang

  committed
  97bac93

  Copy full SHA for 97bac93

Commits on Jun 19, 2024

• fix conflict

  BeachWang

  committed
  a77113a

  Copy full SHA for a77113a

Commits on Jun 20, 2024

• fix hpo 3sigma

  BeachWang

  committed
  3c68d12

  Copy full SHA for 3c68d12

• Merge branch 'main' of github.com:alibaba/data-juicer into dev/rebuild_sandbox

  BeachWang

  committed
  9ac2f40

  Copy full SHA for 9ac2f40

• after pre-commit

  BeachWang

  committed
  79658c1

  Copy full SHA for 79658c1

• sandbox readme zh

  BeachWang

  committed
  727ccdd

  Copy full SHA for 727ccdd

• finish doc

  BeachWang

  committed
  b6662a2

  Copy full SHA for b6662a2

Commits on Jul 15, 2024

• remove training limit

  BeachWang

  committed
  498b985

  Copy full SHA for 498b985

• other_configs -> extra_configs

  BeachWang

  committed
  1d8d4de

  Copy full SHA for 1d8d4de

• other_configs -> extra_configs

  BeachWang

  committed
  39553dc

  Copy full SHA for 39553dc

• res_name -> meta_name

  BeachWang

  committed
  c6173fc

  Copy full SHA for c6173fc

• hooker -> hook

  BeachWang

  committed
  3305764

  Copy full SHA for 3305764

• analyze -> analyse

  BeachWang

  committed
  3ef86c7

  Copy full SHA for 3ef86c7

• after pre-commit

  BeachWang

  committed
  b79739d

  Copy full SHA for b79739d

Commits on Jul 16, 2024

• analyse -> analyze

  BeachWang

  committed
  5fbabcd

  Copy full SHA for 5fbabcd

• Merge branch 'main' of github.com:alibaba/data-juicer into dev/rebuild_sandbox

  BeachWang

  committed
  f32a234

  Copy full SHA for f32a234

• merge easyanimate_for_sandbox

  BeachWang

  committed
  739edfe

  Copy full SHA for 739edfe

• analyser.py -> analyzer.py

  BeachWang

  committed
  7caa923

  Copy full SHA for 7caa923

• analyser.py -> analyzer.py

  BeachWang

  committed
  0b9b1b9

  Copy full SHA for 0b9b1b9

• analyser.py -> analyzer.py

  BeachWang

  committed
  c8fcdbd

  Copy full SHA for c8fcdbd

• regist -> register, DICT -> MAPPING

  BeachWang

  committed
  0e6f651

  Copy full SHA for 0e6f651

• Merge branch 'dev/rebuild_sandbox' into dev/dj_bench_demo

  BeachWang

  committed
  24a4d65

  Copy full SHA for 24a4d65

Commits on Jul 17, 2024

• range_specified_field_selector

  BeachWang

  committed
  44d9159

  Copy full SHA for 44d9159

Commits on Jul 23, 2024

• pipline test done

  BeachWang

  committed
  fb66fdc

  Copy full SHA for fb66fdc

• dataset in readme

  BeachWang

  committed
  e6f14d6

  Copy full SHA for e6f14d6

• conflict solved

  BeachWang

  committed
  51f24a5

  Copy full SHA for 51f24a5

Commits on Jul 24, 2024

• update readme

  BeachWang

  committed
  cedd22c

  Copy full SHA for cedd22c

• pre-commit done

  BeachWang

  committed
  c5a015e

  Copy full SHA for c5a015e

• rm experiment name in dj

  BeachWang

  committed
  2a5cd09

  Copy full SHA for 2a5cd09

Commits on Jul 25, 2024

• add init dataset

  BeachWang

  committed
  9e96feb

  Copy full SHA for 9e96feb

Commits on Jul 30, 2024

• Merge branch 'main' of github.com:alibaba/data-juicer into dev/dj_bench_demo

  BeachWang

  committed
  8727c67

  Copy full SHA for 8727c67

Commits on Jul 31, 2024

• fix auto_evaluation_helm readme

  BeachWang

  committed
  110f109

  Copy full SHA for 110f109

Commits on Aug 1, 2024

• remove easyanimate code

  BeachWang

  committed
  ec81af5

  Copy full SHA for ec81af5

• shorten diff

  BeachWang

  committed
  69e3444

  Copy full SHA for 69e3444