When dealing with large matrices, it helps to have an algorithm to break multiplication into operations on matrix subblocks. Tens of thousands of indices add up to gigabytes, and you’re going to have trouble calling X.matmul on a matrix library backend. Here’s a simple implementation that plays to the tune of Major->Minor->Major to reassemble the… Continue reading Block Matrix Multiplication
Year: 2022
RRQR Factorization and Spanning Boxes
The famous QR factorization algorithm can be BLAS-3 optimized. Using the Woodbury matrix identity, we implement a block-based Rank-Revealing QR and point out a connection between pivot selection and object detection.
Searching for a switch: the Circuit Breaker Panel problem
You want to identify the breaker switch for a particular outlet. This problem inspired me to write an article on Medium one day as I was thinking about the electric wiring at home. As you’ll see, there are commonalities between decidely challenging tasks in Machine Learning and the problems you might encounter day to day.… Continue reading Searching for a switch: the Circuit Breaker Panel problem
Solution Space Techniques for Faster Convergence, an introduction
Many strategies in Machine Learning involve the iterative search of a solution space Ω. We begin with an initial solution ω₀ and update ωₙ to minimize an objective function f(x)