Abstract
A method for deriving bilinear algorithms for matrix multiplication is proposed. New estimates for the bilinear complexity of a number of problems of the exact and approximate multiplication of rectangular matrices are obtained. In particular, the estimate for the boundary rank of multiplying 3 × 3 matrices is improved and a practical algorithm for the exact multiplication of square n × n matrices is proposed. The asymptotic arithmetic complexity of this algorithm is O(n 2.7743).
Similar content being viewed by others
References
V. Strassen, “Gaussian elimination is not optimal,” Numer. Math. 13, 354–356 (1969).
D. Coppersmith and S. Winograd, “Matrix multiplication via arithmetic progressions,” J. Symbolic Comput. 9, 251–280 (1990).
S. Hunold, T. Rauber, and G. Runger, “Combining building blocks for parallel multi-level matrix multiplication,” Parallel Comput. 34, 411–426 (2008).
I. Kaporin, “The aggregation and cancellation techniques as a practical tool for faster matrix multiplication,” Theor. Comput. Sci. 315, 469–510 (2004).
J. Laderman, V. Y. Pan, and X.-H. Sha, “On practical algorithms for accelerated matrix multiplication,” Linear Algebra Appl. 162-164, 557–588 (1992).
A. Schönhage, “Partial and total matrix multiplication,” SIAM J. Comput. 10, 434–455 (1981).
S. K. Sen, “Open problems in computational linear algebra,” Nonlinear Anal. 63, 926–934 (2005).
“Complexity of matrix multiplication: An overview,” Kibern. Sb. 25, 139–236 (1988).
J. M. Landsberg, “Geometry and the complexity of matrix multiplication,” Bull. Am. Math. Soc. 45, 247–284 (2008).
R. P. Brent, “Algorithms for matrix multiplications,” Comput. Sci. Dept. Report CS 157 (Stanford Univ., 1970).
S. Winograd, “On multiplication of 2 × 2 matrices,” Linear Algebra Appl. 4, 381–388 (1971).
V. B. Alekseyev, “On the complexity of some algorithms of matrix multiplication,” J. Algorithms 6(1), 71–85 (1985).
J. Laderman, “A noncommutative algorithm for multiplying 3 × 3 matrices using 23 multiplications,” Bull. Am. Math. Soc. 82(1), 126–128 (1976).
R. W. Johnson and A. M. McLoughlin, “Noncommutative bilinear algorithms for 3 × 3 matrix multiplication,” SIAM J. Comput. 15, 595–603 (1986).
O. M. Makarov, “Nekommutativnyi algoritm umnozheniya kvadratnykh matrits pyatogo poryadka, ispol’zuyushchii sto umnozhenii,” Comput. Math. Math. Phys. 27(2), 311–315 (1987).
D. Bini, “Relations between exact and approximate bilinear algorithms: Applications,” Calcolo 17, 87–97 (1980).
N. S. Bakhvalov, Numerical Methods: Analysis, Algebra, Ordinary Differential Equations (Nauka, Moscow, 1975; Mir, Moscow, 1977).
D. Bini, M. Capovani, G. Lotti, and F. Romani, “O(n 2.7799) complexity for approximate matrix multiplication,” Inf. Process. Lett. 8(5), 234–235 (1979).
V. B. Alekseev and A. V. Smirnov, “On the exact and approximate bilinear complexities of multiplication of 4 × 2 and 2 × 2 matrices,” in Mathematics and Informatics 2, Dedicated to 75th Anniversary of Anatolii Alekseevich Karatsuba, Modern Problems in Mathematics (MIAN, Moscow, 2013), Vol. 17, pp. 135–152 [in Russian].
J. E. Hopcroft and L. R. Kerr, “On minimizing the number of multiplications necessary for matrix multiplication,” SIAM J. Appl. Math. 20, 30–36 (1971).
M. Bläser, “On the Complexity of the Multiplication of Matrices of Small Formats,” J. Complexity 19(1), 43–60 (2003).
D. Bini and G. Lotti, “Stability of fast algorithms for matrix multiplication,” Numer. Math. 36, 63–72 (1980).
Author information
Authors and Affiliations
Corresponding author
Additional information
Original Russian Text © A.V. Smirnov, 2013, published in Zhurnal Vychislitel’noi Matematiki i Matematicheskoi Fiziki, 2013, Vol. 53, No. 12, pp. 1970–1984.
Rights and permissions
About this article
Cite this article
Smirnov, A.V. The bilinear complexity and practical algorithms for matrix multiplication. Comput. Math. and Math. Phys. 53, 1781–1795 (2013). https://doi.org/10.1134/S0965542513120129
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0965542513120129