v0.10.5.gs.240315

Summary

Changelog for Release v0.10.5 (notable changes since v0.9.80).

To pull this release: docker pull ghcr.io/tenstorrent/tt-buda/ubuntu-20-04-amd64/gs:v0.10.5.gs.240315

Changelog

Features/Improvements

• Across-the-board bug fixes and enhancements to compiler stability
• Added support for ONNX quantized models

Models

• Implemented support for 9 additional model variants, including 2 new architectures:
  • Wide ResNet
  • Xception

Performance

• Achieved broad performance improvements averaging 18.5%
• Significantly enhanced performance observed in UNet (93%), Inception v4 (57%), and Yolo v5 (44%)
• Notable performance regressions include MobileNet v2 (-23%), Flan T5 (-6%), BERT (-5%)

Libs

• Upgraded our TVM fork to version 01.14
• Introduced standalone build for TorchVision v0.16.0 with cxx11.abi support (refer to documentation for details)

General

• Enhanced customer-facing documentation for improved clarity and accessibility
• Support of Ubuntu 22.04 as a secondary OS option

Compatability matrix

OS	Python	PyTorch	Driver	Firmware
Ubuntu 20.04	3.8.10	2.1.0+cpu.cxx11.abi	ttkmd_1.27.1	fw_v80.8.0.0

What's Changed

• [doc] Fix BudaLin -> BudaLinear in pybuda example by @artem-erofeev in #9
• [doc] Insert newline in compile PyBUDA from source block by @zhoujingya in #7

New Contributors

• @artem-erofeev made their first contribution in #9
• @zhoujingya made their first contribution in #7

Full Changelog: v0.9.80.gs.231222...v0.10.5.gs.240315