HPU support #5403

Job	Run time
run-tests (latest, test_prod)	1m 58s
run-tests (latest, test_core)	2m 33s
run-tests (latest, test_cli)	2m 35s
run-tests (latest, test_big_modeling)	2m 19s
run-tests (latest, test_deepspeed)	2m 14s
run-tests (latest, test_fsdp)	2m 28s
run-tests (latest, test_example_differences)	2m 18s
run-tests (latest, test_checkpoint_step)	2m 12s
run-tests (latest, test_checkpoint_epoch)	2m 12s
run-tests (latest, test_rest)	2m 16s
run-tests (minimum, test_prod)	2m 28s
run-tests (minimum, test_core)	3m 21s
run-tests (minimum, test_cli)	3m 7s
run-tests (minimum, test_big_modeling)	3m 25s
run-tests (minimum, test_deepspeed)	3m 25s
run-tests (minimum, test_fsdp)	3m 9s
run-tests (minimum, test_example_differences)	3m 18s
run-tests (minimum, test_checkpoint_step)	3m 26s
run-tests (minimum, test_checkpoint_epoch)	3m 15s
run-tests (minimum, test_rest)	3m 24s
	55m 23s

Provide feedback