cp.async.bulk.wait_group GPU Virtual ISA NVIDIA

cp.async.bulk.wait_group Data Movement and Conversion Instructions

cp.async.bulk.wait_group{.read} N;

cp.async.bulk.wait_group instruction will cause the executing thread to wait until only N or fewer of the most recent bulk async-groups are pending and all the prior bulk async-groups committed by the executing threads are complete.

Encoding

PTX is a virtual instruction set. It has no single, stable native binary encoding - the compiler lowers this instruction to different native machine code depending on the selected NVIDIA target architecture (compute capability). This page intentionally shows no bit-diagram; see the target/version requirements below for what governs how this instruction compiles.
PTX ISA Version Introduced PTX ISA 8.0
Minimum Target sm_90

Syntax Forms

One mnemonic covers many type / state-space / scope / modifier combinations - each row below is an independently valid form.

Syntax Data Types State Space(s) Modifiers Min. Target Description
cp.async.bulk.wait_group{.read} N; sm_90 cp.async.bulk.wait_group instruction will cause the executing thread to wait until only N or fewer of the most recent bulk async-groups are pending and all the prior bulk async-groups committed by the… (see the official PTX ISA docs for the full description)

Operands

  • N
    Operand

At a Glance

Data Types -

Reference

NVIDIA PTX ISA

Description

cp.async.bulk.wait_group instruction will cause the executing thread to wait until only N or fewer of the most recent bulk async-groups are pending and all the prior bulk async-groups committed by the executing threads are complete. For example, when N is 0, the executing thread waits on all the prior bulk async-groups to complete. Operand N is an integer constant. By default, cp.async.bulk.wait_group instruction will cause the executing thread to wait until completion of all the bulk async operations in the specified bulk async-group. A bulk async operation includes the following: Optionally, reading from the tensormap. Reading from the source locations. (see the official PTX ISA docs for the full description)

Examples

cp.async.bulk.wait_group.read   0;
cp.async.bulk.wait_group        2;

Reproduced from NVIDIA's official PTX ISA documentation for technical accuracy.

Sources