HPU support #5406

Job	Run time
run-tests (latest, test_prod)	1m 51s
run-tests (latest, test_core)	2m 57s
run-tests (latest, test_cli)	2m 46s
run-tests (latest, test_big_modeling)	2m 28s
run-tests (latest, test_deepspeed)	2m 31s
run-tests (latest, test_fsdp)	2m 20s
run-tests (latest, test_example_differences)	2m 36s
run-tests (latest, test_checkpoint_step)	2m 41s
run-tests (latest, test_checkpoint_epoch)	3m 45s
run-tests (latest, test_rest)	9m 44s
run-tests (minimum, test_prod)	3m 28s
run-tests (minimum, test_core)	3m 47s
run-tests (minimum, test_cli)	3m 28s
run-tests (minimum, test_big_modeling)	3m 16s
run-tests (minimum, test_deepspeed)	3m 14s
run-tests (minimum, test_fsdp)	3m 13s
run-tests (minimum, test_example_differences)	3m 25s
run-tests (minimum, test_checkpoint_step)	4m 38s
run-tests (minimum, test_checkpoint_epoch)	4m 35s
run-tests (minimum, test_rest)	10m 40s
	1h 17m 23s

Provide feedback