Linear Algebra

17 problems

• Covariance matrixEasy
• Why nonlinearity — collapsing two linear layersMedium
• Efficient sparse window attentionMedium
• Euclidean distance matrixEasy
• Gaussian process regression (RBF)Hard
• Graph LaplacianMedium
• Linear regression — normal equationMedium
• Matmul backwardMedium
• MIPS -> L2 ReductionMedium
• Non-Max Suppression (NMS)Medium
• Orthonormal basis (Gram-Schmidt)Medium
• PageRank (power iteration)Medium
• Pegasos kernel SVMMedium
• Principal Component Analysis (PCA)Medium
• Singular Value Decomposition (2x2)Hard
• Sparse matrix multiplicationMedium
• Sparse mixture-of-experts layerHard