Exploring AI: Insights, Innovations and Applications – Diwakar Basnet

Self-Attention

CUDA

Transformer

Since its introduction via the original transformer paper “Attention is all you need”, self-attention has become the corner stone of many state-of-the-art deep learning…

Matrix Multiplication in Triton

triton

Matrix multiplication is defined for two matrices when the number of columns in the first matrix equals the number of rows in the second matrix. For example, if matrix (A)…