Tensor mathematics fundamentals and backpropagation theory with detailed mathematical derivations. Tensor Basics What is a Tensor? A tensor is a generalization of scalars, vectors, and matrices to higher dimensions: Scalar (0D tensor): $x \in \mathbb{R}$ Vector (1D tensor): $\mathbf{x} \in \mathbb{R}^n$ Matrix (2D …