Skip to main content
  • Book
  • © 2011

Matrix Tricks for Linear Statistical Models

Our Personal Top Twenty

  • A valuable source of information for graduate studies whenever the matrix analysis and/or linear statistics is involved

  • Useful to the researchers utilizing matrices to deal with problems originating in various sciences, not only statistics

  • Collected 'Top Twenty' favorite matrix tricks for linear statistical models

Buy it now

Buying options

eBook USD 109.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

This is a preview of subscription content, log in via an institution to check for access.

Table of contents (21 chapters)

  1. Front Matter

    Pages i-xvii
  2. Introduction

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 1-56
  3. Easy Column Space Tricks

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 57-70
  4. Easy Projector Tricks

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 71-90
  5. Easy Correlation Tricks

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 91-104
  6. Generalized Inverses in a Nutshell

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 105-120
  7. Rank of the Partitioned Matrix and the Matrix Product

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 121-144
  8. Rank Cancellation Rule

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 145-150
  9. Sum of Orthogonal Projectors

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 151-154
  10. A Decomposition of the Orthogonal Projector

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 155-190
  11. Minimizing cov(y - Fx)

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 191-214
  12. BLUE

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 215-266
  13. General Solution to AYB = C

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 267-282
  14. Invariance with Respect to the Choice of Generalized Inverse

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 283-290
  15. Block-Diagonalization and the Schur Complement

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 291-304
  16. Nonnegative Definiteness of a Partitioned Matrix

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 305-316
  17. The Matrix \(\dot{\rm M}\)

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 317-342
  18. Disjointness of Column Spaces

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 343-348
  19. Full Rank Decomposition

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 349-356
  20. Eigenvalue Decomposition

    • Simo Puntanen, George P. H. Styan, Jarkko Isotalo
    Pages 357-390

About this book

In teaching linear statistical models to first-year graduate students or to final-year undergraduate students there is no way to proceed smoothly without matrices and related concepts of linear algebra; their use is really essential. Our experience is that making some particular matrix tricks very familiar to students can substantially increase their insight into linear statistical models (and also multivariate statistical analysis). In matrix algebra, there are handy, sometimes even very simple “tricks” which simplify and clarify the treatment of a problem—both for the student and for the professor. Of course, the concept of a trick is not uniquely defined—by a trick we simply mean here a useful important handy result.
In this book we collect together our Top Twenty favourite matrix tricks for linear statistical models.

Reviews

From the reviews:

“It is for everyone who works on the properties of (multivariate) linear statistical models, especially for graduate students in statistics. Also, the book is … for experts who have had an introduction to multivariate models and have a big preference for matrix results. … book is full of recent results and advances of linear algebra related linear statistical models over the last decades. … book has the potential to become a major reference book for further developments of estimators of linear models in the future.” (Wolfgang Polasek, International Statistical Review, Vol. 81 (1), 2013)

“This new book is closely connected with matrices and linear models … . the authors extract from the matrix algebra and theory of linear models twenty key results or ideas which they call ‘tricks’. … This exceptional book can be recommended to all interested students who wish to improve their skills in linear models and matrix manipulations. It can be recommended also to professors teaching statistics who may utilize this book as a rich source of various exercises, references and interesting historical notes.” (Radosław Kala, IMAGE, Issue 48, Spring, 2012)

Authors and Affiliations

  • Dept. Mathematics, Statistics &, Philosophy, University of Tampere, Tampere, Finland

    Simo Puntanen, Jarkko Isotalo

  • Dept. Mathematics & Statistics, McGill University, Montreal, Canada

    George P. H. Styan

About the authors

Simo Puntanen earned his PhD in statistics from the University of Tampere (Tampere, Finland) in 1987, where he is now a Docent and Lecturer of Statistics. He has published over 110 research papers in matrix methods for statistics with particular emphasis on linear statistical models. He is currently the book review editor of the International Statistical Review.

George P. H. Styan earned his PhD in mathematical statistics from Columbia University in 1969 and received an Honorary PhD from the University of Tampere in 2000. He is now Professor Emeritus of Mathematics and Statistics at McGill University in  Montreal, Canada. He has published over 140 research papers, mostly in matrix methods for statistics, and since 2005, his main interests have focused on magic squares, and mathematical and statistical philately.

Jarkko Isotalo earned his PhD in statistics from the University of Tampere (Tampere, Finland) in 2007, where he is now a Lecturer of Statistics. His main research interests have been linear statistical models, matrix methods for statistics, and computational statistics. He is currently also doing applied research on statistical genetics.

Puntanen, Styan, and Isotalo, knowing just what is expected of authors, would like to agree with P. G. Wodehouse and apologize for childhoods that were as normal as rice-pudding and lives that consisted of little more than sitting in front of the laptop and cursing a bit.


Bibliographic Information

  • Book Title: Matrix Tricks for Linear Statistical Models

  • Book Subtitle: Our Personal Top Twenty

  • Authors: Simo Puntanen, George P. H. Styan, Jarkko Isotalo

  • DOI: https://doi.org/10.1007/978-3-642-10473-2

  • Publisher: Springer Berlin, Heidelberg

  • eBook Packages: Mathematics and Statistics, Mathematics and Statistics (R0)

  • Copyright Information: Springer-Verlag Berlin Heidelberg 2011

  • Hardcover ISBN: 978-3-642-10472-5Published: 24 August 2011

  • Softcover ISBN: 978-3-642-44759-4Published: 01 October 2014

  • eBook ISBN: 978-3-642-10473-2Published: 24 August 2011

  • Edition Number: 1

  • Number of Pages: XVII, 486

  • Number of Illustrations: 35 b/w illustrations, 35 illustrations in colour

  • Topics: Statistical Theory and Methods

Buy it now

Buying options

eBook USD 109.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access