Skip to content

Commit

Permalink
[pre-commit.ci] auto fixes from pre-commit.com hooks
Browse files Browse the repository at this point in the history
for more information, see https://pre-commit.ci
  • Loading branch information
pre-commit-ci[bot] committed Feb 2, 2025
1 parent c385529 commit cf8b2fe
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions transformer_engine/common/util/cast_gated_kernels.cuh
Original file line number Diff line number Diff line change
Expand Up @@ -955,9 +955,7 @@ void quantize_gated(const Tensor &grad, const Tensor &gated_input, Tensor *outpu
NVTE_CHECK(output->flat_last_dim() == output_cols, "Wrong dimension of the output.");
}

const bool use_tma_kernels = is_fp8_rowwise_output &&
is_fp8_colwise_output &&
cols % 16 == 0;
const bool use_tma_kernels = is_fp8_rowwise_output && is_fp8_colwise_output && cols % 16 == 0;

if (is_delayed_tensor_scaling(output->scaling_mode)) {
if (use_tma_kernels) {
Expand Down

0 comments on commit cf8b2fe

Please sign in to comment.