Skip to content

TensorRT OSS v10.8.0

Latest
Compare
Choose a tag to compare
@yuanyao-nv yuanyao-nv released this 01 Feb 01:09
64e56ab

10.8.0 GA

For more information, see the TensorRT 10.8.0 release notes.

Key Features and Updates:

  • Demo changes
  • Plugin changes
    • Added SM 100 and SM 120 support to bertQKVToContextPlugin. This enables demo/BERT on Blackwell GPUs.
  • Sample changes
    • Added a new sampleEditableTimingCache to demonstrate how to build an engine with the desired tactics by modifying the timing cache.
    • Deleted the sampleAlgorithmSelector sample.
    • Fixed sampleOnnxMNIST by updating the correct INT8 dynamic range.
  • Parser changes
    • Added support for FLOAT4E2M1 types for quantized networks.
    • Added support for dynamic axes and improved performance of CumSum operations.
    • Fixed the import of local functions when their input tensor names aliased one from an outside scope.
    • Added support for Pow ops with integer-typed exponent values.
  • Fixed issues
    • Fixed segmentation of boolean constant nodes - 4224.
    • Fixed accuracy issue when multiple optimization profiles were defined 4250.