Skip to content

Commit d8e6119

Browse files
Update docs
1 parent b89c348 commit d8e6119

File tree

171 files changed

+1094
-28
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

171 files changed

+1094
-28
lines changed

_sources/autoapi/tilelang/intrinsics/mfma_macro_generator/index.rst.txt

Lines changed: 43 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ Module Contents
2626

2727
.. py:data:: lift
2828
29-
.. py:class:: MatrixCoreIntrinEmitter(a_dtype = 'float16', b_dtype = 'float16', accum_dtype = 'float16', a_transposed = False, b_transposed = False, block_row_warps = 2, block_col_warps = 2, warp_row_tiles = 8, warp_col_tiles = 8, chunk = 16, reduce_k = 1, num_elems_per_byte = 1, k_pack = None, is_m_first = False, b_preshuffle = False)
29+
.. py:class:: MatrixCoreIntrinEmitter(a_dtype = 'float16', b_dtype = 'float16', accum_dtype = 'float16', a_transposed = False, b_transposed = False, block_row_warps = 2, block_col_warps = 2, warp_row_tiles = 8, warp_col_tiles = 8, chunk = 16, reduce_k = 1, num_elems_per_byte = 1, k_pack = None, is_m_first = False, b_preshuffle = False, thread_var = None)
3030
3131
To eliminate Python syntax within TIR Macro.
3232

@@ -134,9 +134,20 @@ Module Contents
134134

135135

136136

137+
.. py:attribute:: thread_var
138+
:value: None
139+
140+
141+
137142
.. py:method:: get_ldmatrix_index_map(is_b=False)
138143
139144
145+
.. py:method:: get_store_index_map(inverse = False)
146+
147+
148+
.. py:method:: get_thread_binding()
149+
150+
140151
.. py:method:: extract_thread_binding(thread_id, is_m_first=None)
141152
142153
is_m_first: True if the thread binding is in the form of (tx, warp_n, warp_m)
@@ -151,12 +162,42 @@ Module Contents
151162
.. py:method:: ldmatrix_b(B_local_buf, B_shared_buf, ki, rk=0)
152163
153164
154-
.. py:method:: mfma(A_local_buf, B_local_buf, C_local_buf)
165+
.. py:method:: mfma(A_local_buf, B_local_buf, C_local_buf, k_inner = 0)
155166
156167
157168
.. py:method:: stmatrix(C_local_buf, C_buf, pid_m=None, pid_n=None)
158169
159170
171+
.. py:method:: make_mfma_load_layout(local_buf, matrix = 'A')
172+
173+
Create a layout function for storing MFMA results into a fragment buffer.
174+
175+
:param local_buf: The local buffer representing a fragment of a matrix.
176+
:type local_buf: tir.Buffer
177+
178+
:returns: A fragment object that describes how threads and indices
179+
in `local_buf` are laid out.
180+
:rtype: T.Fragment
181+
182+
:raises AssertionError: If `local_buf` is not detected to be a fragment buffer.
183+
184+
185+
186+
.. py:method:: make_mfma_store_layout(local_buf)
187+
188+
Create a layout function for storing MFMA results into a fragment buffer.
189+
190+
:param local_buf: The local buffer representing a fragment of a matrix.
191+
:type local_buf: tir.Buffer
192+
193+
:returns: A fragment object that describes how threads and indices
194+
in `local_buf` are laid out.
195+
:rtype: T.Fragment
196+
197+
:raises AssertionError: If `local_buf` is not detected to be a fragment buffer.
198+
199+
200+
160201
.. py:class:: MatrixCorePreshuffleIntrinEmitter(a_dtype = 'float16', b_dtype = 'float16', accum_dtype = 'float16', a_transposed = False, b_transposed = False, block_row_warps = 2, block_col_warps = 2, warp_row_tiles = 8, warp_col_tiles = 8, chunk = 16, reduce_k = 1, num_elems_per_byte = 1, k_pack = None, is_m_first = False, a_preshuffle = False, b_preshuffle = False)
161202
162203
Bases: :py:obj:`MatrixCoreIntrinEmitter`
Lines changed: 40 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,40 @@
1+
tilelang.tileop.gemm.gemm_mfma
2+
==============================
3+
4+
.. py:module:: tilelang.tileop.gemm.gemm_mfma
5+
6+
7+
Classes
8+
-------
9+
10+
.. autoapisummary::
11+
12+
tilelang.tileop.gemm.gemm_mfma.GemmMFMA
13+
14+
15+
Module Contents
16+
---------------
17+
18+
.. py:class:: GemmMFMA
19+
20+
Bases: :py:obj:`tilelang.tileop.gemm.gemm_base.GemmBase`
21+
22+
23+
.. py:method:: infer_layout(target, thread_nums)
24+
25+
26+
.. py:method:: lower(layout_map, target, thread_nums, thread_var)
27+
28+
29+
.. py:method:: is_gemm_ss()
30+
31+
32+
.. py:method:: is_gemm_sr()
33+
34+
35+
.. py:method:: is_gemm_rs()
36+
37+
38+
.. py:method:: is_gemm_rr()
39+
40+

_sources/autoapi/tilelang/tileop/gemm/index.rst.txt

Lines changed: 11 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,7 @@ Submodules
1111
:maxdepth: 1
1212

1313
/autoapi/tilelang/tileop/gemm/gemm_base/index
14+
/autoapi/tilelang/tileop/gemm/gemm_mfma/index
1415
/autoapi/tilelang/tileop/gemm/gemm_mma/index
1516
/autoapi/tilelang/tileop/gemm/gemm_wgmma/index
1617

@@ -53,22 +54,30 @@ Package Contents
5354

5455

5556

56-
.. py:attribute:: WGMMMA
57+
.. py:attribute:: WGMMA
5758
:value: 1
5859

5960

6061

61-
.. py:attribute:: MFMA
62+
.. py:attribute:: TCGEN5MMA
6263
:value: 2
6364

6465

6566

67+
.. py:attribute:: MFMA
68+
:value: 3
69+
70+
71+
6672
.. py:method:: is_mma()
6773
6874
6975
.. py:method:: is_wgmma()
7076
7177
78+
.. py:method:: is_tcgen5mma()
79+
80+
7281
.. py:method:: is_mfma()
7382
7483

autoapi/index.html

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -409,6 +409,7 @@
409409
<li class="toctree-l2 has-children"><a class="reference internal" href="tilelang/tileop/index.html">tilelang.tileop</a><input aria-label="Toggle navigation of tilelang.tileop" class="toctree-checkbox" id="toctree-checkbox-29" name="toctree-checkbox-29" role="switch" type="checkbox"/><label for="toctree-checkbox-29"><span class="icon"><svg><use href="#svg-arrow-right"></use></svg></span></label><ul>
410410
<li class="toctree-l3 has-children"><a class="reference internal" href="tilelang/tileop/gemm/index.html">tilelang.tileop.gemm</a><input aria-label="Toggle navigation of tilelang.tileop.gemm" class="toctree-checkbox" id="toctree-checkbox-30" name="toctree-checkbox-30" role="switch" type="checkbox"/><label for="toctree-checkbox-30"><span class="icon"><svg><use href="#svg-arrow-right"></use></svg></span></label><ul>
411411
<li class="toctree-l4"><a class="reference internal" href="tilelang/tileop/gemm/gemm_base/index.html">tilelang.tileop.gemm.gemm_base</a></li>
412+
<li class="toctree-l4"><a class="reference internal" href="tilelang/tileop/gemm/gemm_mfma/index.html">tilelang.tileop.gemm.gemm_mfma</a></li>
412413
<li class="toctree-l4"><a class="reference internal" href="tilelang/tileop/gemm/gemm_mma/index.html">tilelang.tileop.gemm.gemm_mma</a></li>
413414
<li class="toctree-l4"><a class="reference internal" href="tilelang/tileop/gemm/gemm_wgmma/index.html">tilelang.tileop.gemm.gemm_wgmma</a></li>
414415
</ul>
@@ -670,6 +671,7 @@ <h1>API Reference<a class="headerlink" href="#api-reference" title="Link to this
670671
<li class="toctree-l2"><a class="reference internal" href="tilelang/tileop/index.html">tilelang.tileop</a><ul>
671672
<li class="toctree-l3"><a class="reference internal" href="tilelang/tileop/gemm/index.html">tilelang.tileop.gemm</a><ul>
672673
<li class="toctree-l4"><a class="reference internal" href="tilelang/tileop/gemm/gemm_base/index.html">tilelang.tileop.gemm.gemm_base</a></li>
674+
<li class="toctree-l4"><a class="reference internal" href="tilelang/tileop/gemm/gemm_mfma/index.html">tilelang.tileop.gemm.gemm_mfma</a></li>
673675
<li class="toctree-l4"><a class="reference internal" href="tilelang/tileop/gemm/gemm_mma/index.html">tilelang.tileop.gemm.gemm_mma</a></li>
674676
<li class="toctree-l4"><a class="reference internal" href="tilelang/tileop/gemm/gemm_wgmma/index.html">tilelang.tileop.gemm.gemm_wgmma</a></li>
675677
</ul>

autoapi/tilelang/autotuner/capture/index.html

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -409,6 +409,7 @@
409409
<li class="toctree-l2 has-children"><a class="reference internal" href="../../tileop/index.html">tilelang.tileop</a><input aria-label="Toggle navigation of tilelang.tileop" class="toctree-checkbox" id="toctree-checkbox-29" name="toctree-checkbox-29" role="switch" type="checkbox"/><label for="toctree-checkbox-29"><span class="icon"><svg><use href="#svg-arrow-right"></use></svg></span></label><ul>
410410
<li class="toctree-l3 has-children"><a class="reference internal" href="../../tileop/gemm/index.html">tilelang.tileop.gemm</a><input aria-label="Toggle navigation of tilelang.tileop.gemm" class="toctree-checkbox" id="toctree-checkbox-30" name="toctree-checkbox-30" role="switch" type="checkbox"/><label for="toctree-checkbox-30"><span class="icon"><svg><use href="#svg-arrow-right"></use></svg></span></label><ul>
411411
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_base/index.html">tilelang.tileop.gemm.gemm_base</a></li>
412+
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_mfma/index.html">tilelang.tileop.gemm.gemm_mfma</a></li>
412413
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_mma/index.html">tilelang.tileop.gemm.gemm_mma</a></li>
413414
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_wgmma/index.html">tilelang.tileop.gemm.gemm_wgmma</a></li>
414415
</ul>

autoapi/tilelang/autotuner/index.html

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -409,6 +409,7 @@
409409
<li class="toctree-l2 has-children"><a class="reference internal" href="../tileop/index.html">tilelang.tileop</a><input aria-label="Toggle navigation of tilelang.tileop" class="toctree-checkbox" id="toctree-checkbox-29" name="toctree-checkbox-29" role="switch" type="checkbox"/><label for="toctree-checkbox-29"><span class="icon"><svg><use href="#svg-arrow-right"></use></svg></span></label><ul>
410410
<li class="toctree-l3 has-children"><a class="reference internal" href="../tileop/gemm/index.html">tilelang.tileop.gemm</a><input aria-label="Toggle navigation of tilelang.tileop.gemm" class="toctree-checkbox" id="toctree-checkbox-30" name="toctree-checkbox-30" role="switch" type="checkbox"/><label for="toctree-checkbox-30"><span class="icon"><svg><use href="#svg-arrow-right"></use></svg></span></label><ul>
411411
<li class="toctree-l4"><a class="reference internal" href="../tileop/gemm/gemm_base/index.html">tilelang.tileop.gemm.gemm_base</a></li>
412+
<li class="toctree-l4"><a class="reference internal" href="../tileop/gemm/gemm_mfma/index.html">tilelang.tileop.gemm.gemm_mfma</a></li>
412413
<li class="toctree-l4"><a class="reference internal" href="../tileop/gemm/gemm_mma/index.html">tilelang.tileop.gemm.gemm_mma</a></li>
413414
<li class="toctree-l4"><a class="reference internal" href="../tileop/gemm/gemm_wgmma/index.html">tilelang.tileop.gemm.gemm_wgmma</a></li>
414415
</ul>

autoapi/tilelang/autotuner/param/index.html

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -409,6 +409,7 @@
409409
<li class="toctree-l2 has-children"><a class="reference internal" href="../../tileop/index.html">tilelang.tileop</a><input aria-label="Toggle navigation of tilelang.tileop" class="toctree-checkbox" id="toctree-checkbox-29" name="toctree-checkbox-29" role="switch" type="checkbox"/><label for="toctree-checkbox-29"><span class="icon"><svg><use href="#svg-arrow-right"></use></svg></span></label><ul>
410410
<li class="toctree-l3 has-children"><a class="reference internal" href="../../tileop/gemm/index.html">tilelang.tileop.gemm</a><input aria-label="Toggle navigation of tilelang.tileop.gemm" class="toctree-checkbox" id="toctree-checkbox-30" name="toctree-checkbox-30" role="switch" type="checkbox"/><label for="toctree-checkbox-30"><span class="icon"><svg><use href="#svg-arrow-right"></use></svg></span></label><ul>
411411
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_base/index.html">tilelang.tileop.gemm.gemm_base</a></li>
412+
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_mfma/index.html">tilelang.tileop.gemm.gemm_mfma</a></li>
412413
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_mma/index.html">tilelang.tileop.gemm.gemm_mma</a></li>
413414
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_wgmma/index.html">tilelang.tileop.gemm.gemm_wgmma</a></li>
414415
</ul>

autoapi/tilelang/autotuner/tuner/index.html

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -409,6 +409,7 @@
409409
<li class="toctree-l2 has-children"><a class="reference internal" href="../../tileop/index.html">tilelang.tileop</a><input aria-label="Toggle navigation of tilelang.tileop" class="toctree-checkbox" id="toctree-checkbox-29" name="toctree-checkbox-29" role="switch" type="checkbox"/><label for="toctree-checkbox-29"><span class="icon"><svg><use href="#svg-arrow-right"></use></svg></span></label><ul>
410410
<li class="toctree-l3 has-children"><a class="reference internal" href="../../tileop/gemm/index.html">tilelang.tileop.gemm</a><input aria-label="Toggle navigation of tilelang.tileop.gemm" class="toctree-checkbox" id="toctree-checkbox-30" name="toctree-checkbox-30" role="switch" type="checkbox"/><label for="toctree-checkbox-30"><span class="icon"><svg><use href="#svg-arrow-right"></use></svg></span></label><ul>
411411
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_base/index.html">tilelang.tileop.gemm.gemm_base</a></li>
412+
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_mfma/index.html">tilelang.tileop.gemm.gemm_mfma</a></li>
412413
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_mma/index.html">tilelang.tileop.gemm.gemm_mma</a></li>
413414
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_wgmma/index.html">tilelang.tileop.gemm.gemm_wgmma</a></li>
414415
</ul>

autoapi/tilelang/cache/index.html

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -409,6 +409,7 @@
409409
<li class="toctree-l2 has-children"><a class="reference internal" href="../tileop/index.html">tilelang.tileop</a><input aria-label="Toggle navigation of tilelang.tileop" class="toctree-checkbox" id="toctree-checkbox-29" name="toctree-checkbox-29" role="switch" type="checkbox"/><label for="toctree-checkbox-29"><span class="icon"><svg><use href="#svg-arrow-right"></use></svg></span></label><ul>
410410
<li class="toctree-l3 has-children"><a class="reference internal" href="../tileop/gemm/index.html">tilelang.tileop.gemm</a><input aria-label="Toggle navigation of tilelang.tileop.gemm" class="toctree-checkbox" id="toctree-checkbox-30" name="toctree-checkbox-30" role="switch" type="checkbox"/><label for="toctree-checkbox-30"><span class="icon"><svg><use href="#svg-arrow-right"></use></svg></span></label><ul>
411411
<li class="toctree-l4"><a class="reference internal" href="../tileop/gemm/gemm_base/index.html">tilelang.tileop.gemm.gemm_base</a></li>
412+
<li class="toctree-l4"><a class="reference internal" href="../tileop/gemm/gemm_mfma/index.html">tilelang.tileop.gemm.gemm_mfma</a></li>
412413
<li class="toctree-l4"><a class="reference internal" href="../tileop/gemm/gemm_mma/index.html">tilelang.tileop.gemm.gemm_mma</a></li>
413414
<li class="toctree-l4"><a class="reference internal" href="../tileop/gemm/gemm_wgmma/index.html">tilelang.tileop.gemm.gemm_wgmma</a></li>
414415
</ul>

autoapi/tilelang/cache/kernel_cache/index.html

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -409,6 +409,7 @@
409409
<li class="toctree-l2 has-children"><a class="reference internal" href="../../tileop/index.html">tilelang.tileop</a><input aria-label="Toggle navigation of tilelang.tileop" class="toctree-checkbox" id="toctree-checkbox-29" name="toctree-checkbox-29" role="switch" type="checkbox"/><label for="toctree-checkbox-29"><span class="icon"><svg><use href="#svg-arrow-right"></use></svg></span></label><ul>
410410
<li class="toctree-l3 has-children"><a class="reference internal" href="../../tileop/gemm/index.html">tilelang.tileop.gemm</a><input aria-label="Toggle navigation of tilelang.tileop.gemm" class="toctree-checkbox" id="toctree-checkbox-30" name="toctree-checkbox-30" role="switch" type="checkbox"/><label for="toctree-checkbox-30"><span class="icon"><svg><use href="#svg-arrow-right"></use></svg></span></label><ul>
411411
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_base/index.html">tilelang.tileop.gemm.gemm_base</a></li>
412+
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_mfma/index.html">tilelang.tileop.gemm.gemm_mfma</a></li>
412413
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_mma/index.html">tilelang.tileop.gemm.gemm_mma</a></li>
413414
<li class="toctree-l4"><a class="reference internal" href="../../tileop/gemm/gemm_wgmma/index.html">tilelang.tileop.gemm.gemm_wgmma</a></li>
414415
</ul>

0 commit comments

Comments
 (0)