Sketching

A matrix, its singular values and a barplot comparing error of different diagonal estimators.

Combining XDiag with Hutch++

Derivation, comparison and combination of scalable stochastic diagonal estimators

OCT 21, 2025
categories: PROOFS
tags: ALGEBRA, PROBABILITY, PROOF, RANDOM MATRICES, SKERCH, SKETCHING

skerch: Sketched Linear Operations for PyTorch

Version 1.0 of the library is out!

OCT 15, 2025
categories: UTILITIES
tags: ALGEBRA, COMPRESSED SENSING, CONVEX OPTIMIZATION, DEEP LEARNING, NUMERICS, PYTORCH, RANDOM MATRICES, SKERCH, SKETCHING

Excerpt from our BJP 2023 paper.

Connecting Parameters and Hessian Eigenspaces in Deep Learning

Paper published in TMLR (2025)

MAR 21, 2025
categories: PUBLICATIONS
tags: ALGEBRA, COMPUTER VISION, MACHINE LEARNING, PRUNING, SKERCH, SKETCHING