Skip to main content
Log in

The bilinear complexity and practical algorithms for matrix multiplication

  • Published:
Computational Mathematics and Mathematical Physics Aims and scope Submit manuscript

Abstract

A method for deriving bilinear algorithms for matrix multiplication is proposed. New estimates for the bilinear complexity of a number of problems of the exact and approximate multiplication of rectangular matrices are obtained. In particular, the estimate for the boundary rank of multiplying 3 × 3 matrices is improved and a practical algorithm for the exact multiplication of square n × n matrices is proposed. The asymptotic arithmetic complexity of this algorithm is O(n 2.7743).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. V. Strassen, “Gaussian elimination is not optimal,” Numer. Math. 13, 354–356 (1969).

    Article  MATH  MathSciNet  Google Scholar 

  2. D. Coppersmith and S. Winograd, “Matrix multiplication via arithmetic progressions,” J. Symbolic Comput. 9, 251–280 (1990).

    Article  MATH  MathSciNet  Google Scholar 

  3. S. Hunold, T. Rauber, and G. Runger, “Combining building blocks for parallel multi-level matrix multiplication,” Parallel Comput. 34, 411–426 (2008).

    Article  MathSciNet  Google Scholar 

  4. I. Kaporin, “The aggregation and cancellation techniques as a practical tool for faster matrix multiplication,” Theor. Comput. Sci. 315, 469–510 (2004).

    Article  MATH  MathSciNet  Google Scholar 

  5. J. Laderman, V. Y. Pan, and X.-H. Sha, “On practical algorithms for accelerated matrix multiplication,” Linear Algebra Appl. 162-164, 557–588 (1992).

    Article  MathSciNet  Google Scholar 

  6. A. Schönhage, “Partial and total matrix multiplication,” SIAM J. Comput. 10, 434–455 (1981).

    Article  MATH  MathSciNet  Google Scholar 

  7. S. K. Sen, “Open problems in computational linear algebra,” Nonlinear Anal. 63, 926–934 (2005).

    Article  MATH  MathSciNet  Google Scholar 

  8. “Complexity of matrix multiplication: An overview,” Kibern. Sb. 25, 139–236 (1988).

  9. J. M. Landsberg, “Geometry and the complexity of matrix multiplication,” Bull. Am. Math. Soc. 45, 247–284 (2008).

    Article  MATH  MathSciNet  Google Scholar 

  10. R. P. Brent, “Algorithms for matrix multiplications,” Comput. Sci. Dept. Report CS 157 (Stanford Univ., 1970).

    Google Scholar 

  11. S. Winograd, “On multiplication of 2 × 2 matrices,” Linear Algebra Appl. 4, 381–388 (1971).

    Article  MATH  MathSciNet  Google Scholar 

  12. V. B. Alekseyev, “On the complexity of some algorithms of matrix multiplication,” J. Algorithms 6(1), 71–85 (1985).

    Article  MATH  MathSciNet  Google Scholar 

  13. J. Laderman, “A noncommutative algorithm for multiplying 3 × 3 matrices using 23 multiplications,” Bull. Am. Math. Soc. 82(1), 126–128 (1976).

    Article  MATH  MathSciNet  Google Scholar 

  14. R. W. Johnson and A. M. McLoughlin, “Noncommutative bilinear algorithms for 3 × 3 matrix multiplication,” SIAM J. Comput. 15, 595–603 (1986).

    Article  MATH  MathSciNet  Google Scholar 

  15. O. M. Makarov, “Nekommutativnyi algoritm umnozheniya kvadratnykh matrits pyatogo poryadka, ispol’zuyushchii sto umnozhenii,” Comput. Math. Math. Phys. 27(2), 311–315 (1987).

    MATH  Google Scholar 

  16. D. Bini, “Relations between exact and approximate bilinear algorithms: Applications,” Calcolo 17, 87–97 (1980).

    Article  MATH  MathSciNet  Google Scholar 

  17. N. S. Bakhvalov, Numerical Methods: Analysis, Algebra, Ordinary Differential Equations (Nauka, Moscow, 1975; Mir, Moscow, 1977).

    Google Scholar 

  18. D. Bini, M. Capovani, G. Lotti, and F. Romani, “O(n 2.7799) complexity for approximate matrix multiplication,” Inf. Process. Lett. 8(5), 234–235 (1979).

    Article  MATH  MathSciNet  Google Scholar 

  19. V. B. Alekseev and A. V. Smirnov, “On the exact and approximate bilinear complexities of multiplication of 4 × 2 and 2 × 2 matrices,” in Mathematics and Informatics 2, Dedicated to 75th Anniversary of Anatolii Alekseevich Karatsuba, Modern Problems in Mathematics (MIAN, Moscow, 2013), Vol. 17, pp. 135–152 [in Russian].

    Google Scholar 

  20. J. E. Hopcroft and L. R. Kerr, “On minimizing the number of multiplications necessary for matrix multiplication,” SIAM J. Appl. Math. 20, 30–36 (1971).

    Article  MATH  MathSciNet  Google Scholar 

  21. M. Bläser, “On the Complexity of the Multiplication of Matrices of Small Formats,” J. Complexity 19(1), 43–60 (2003).

    Article  MATH  MathSciNet  Google Scholar 

  22. D. Bini and G. Lotti, “Stability of fast algorithms for matrix multiplication,” Numer. Math. 36, 63–72 (1980).

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to A. V. Smirnov.

Additional information

Original Russian Text © A.V. Smirnov, 2013, published in Zhurnal Vychislitel’noi Matematiki i Matematicheskoi Fiziki, 2013, Vol. 53, No. 12, pp. 1970–1984.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Smirnov, A.V. The bilinear complexity and practical algorithms for matrix multiplication. Comput. Math. and Math. Phys. 53, 1781–1795 (2013). https://doi.org/10.1134/S0965542513120129

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0965542513120129

Keywords

Navigation