Reference for matrix calculusWhere can I find a broad set of exercises on Matrix calculus?Good introductory...

How to find program name(s) of an installed package?

Can I make popcorn with any corn?

"to be prejudice towards/against someone" vs "to be prejudiced against/towards someone"

Fencing style for blades that can attack from a distance

How can bays and straits be determined in a procedurally generated map?

What are the differences between the usage of 'it' and 'they'?

Mathematical cryptic clues

Has the BBC provided arguments for saying Brexit being cancelled is unlikely?

Can divisibility rules for digits be generalized to sum of digits

Why are electrically insulating heatsinks so rare? Is it just cost?

What does it mean to describe someone as a butt steak?

Example of a continuous function that don't have a continuous extension

In Japanese, what’s the difference between “Tonari ni” (となりに) and “Tsugi” (つぎ)? When would you use one over the other?

Maximum likelihood parameters deviate from posterior distributions

Do I have a twin with permutated remainders?

Why not use SQL instead of GraphQL?

What typically incentivizes a professor to change jobs to a lower ranking university?

Why Is Death Allowed In the Matrix?

Why are 150k or 200k jobs considered good when there are 300k+ births a month?

Risk of getting Chronic Wasting Disease (CWD) in the United States?

How old can references or sources in a thesis be?

TGV timetables / schedules?

What do you call a Matrix-like slowdown and camera movement effect?

Why do I get two different answers for this counting problem?



Reference for matrix calculus


Where can I find a broad set of exercises on Matrix calculus?Good introductory book for matrix calculusCorrect method to differentiate a first order vector/matrixBook Reference for Calculus and Linear Algebra :: EngineerFormal Variational Calculus Reference RequestReference for Hasse-Witt invariantJoseph Kitchen's Calculus (reference)Reference Request for CalculusInteresting calculus problems for beginnerAdvanced / In-Depth Calculus Book for Self-EdificationReference Book for CalculusSuitable reference for learning symplectic geometryWhich course for deep learning?













3












$begingroup$


Could someone provide a good reference for learning matrix calculus? I've recently moved to a more engineering-oriented field where it's commonly used and don't have much experience with it.






calculus matrices reference-request







share|cite|improve this question









$endgroup$








  • 1




    $begingroup$
    Could you be a bit more specific? What exactly are you trying to learn and what do you already know? Do you want to understand things such as A = exp(Ct) solves dA/dt = CA for A, C matrices? Or perhaps even study matrix Lie groups and their differential properties (I can imagine this could have many engineering applications)?
    $endgroup$
    – Marek
    Nov 11 '10 at 19:46






  • 1




    $begingroup$
    Well, in linear regression, one can derive a closed-form solution in the form of the normal equations: en.wikipedia.org/wiki/Normal_equations#General_linear_model . The derivation uses results about the gradient of the trace of a matrix product. I guess I just wanted to feel comfortable with these ideas - maybe build up a geometric picture and get some insight as to how everything works.
    $endgroup$
    – Simon
    Nov 11 '10 at 19:55


















3












$begingroup$


Could someone provide a good reference for learning matrix calculus? I've recently moved to a more engineering-oriented field where it's commonly used and don't have much experience with it.






calculus matrices reference-request







share|cite|improve this question









$endgroup$








  • 1




    $begingroup$
    Could you be a bit more specific? What exactly are you trying to learn and what do you already know? Do you want to understand things such as A = exp(Ct) solves dA/dt = CA for A, C matrices? Or perhaps even study matrix Lie groups and their differential properties (I can imagine this could have many engineering applications)?
    $endgroup$
    – Marek
    Nov 11 '10 at 19:46






  • 1




    $begingroup$
    Well, in linear regression, one can derive a closed-form solution in the form of the normal equations: en.wikipedia.org/wiki/Normal_equations#General_linear_model . The derivation uses results about the gradient of the trace of a matrix product. I guess I just wanted to feel comfortable with these ideas - maybe build up a geometric picture and get some insight as to how everything works.
    $endgroup$
    – Simon
    Nov 11 '10 at 19:55
















3












3








3


6



$begingroup$


Could someone provide a good reference for learning matrix calculus? I've recently moved to a more engineering-oriented field where it's commonly used and don't have much experience with it.






calculus matrices reference-request







share|cite|improve this question









$endgroup$




Could someone provide a good reference for learning matrix calculus? I've recently moved to a more engineering-oriented field where it's commonly used and don't have much experience with it.






calculus matrices reference-request




calculus matrices reference-request






share|cite|improve this question













share|cite|improve this question











share|cite|improve this question




share|cite|improve this question










asked Nov 11 '10 at 19:34









SimonSimon

599414




599414








  • 1




    $begingroup$
    Could you be a bit more specific? What exactly are you trying to learn and what do you already know? Do you want to understand things such as A = exp(Ct) solves dA/dt = CA for A, C matrices? Or perhaps even study matrix Lie groups and their differential properties (I can imagine this could have many engineering applications)?
    $endgroup$
    – Marek
    Nov 11 '10 at 19:46






  • 1




    $begingroup$
    Well, in linear regression, one can derive a closed-form solution in the form of the normal equations: en.wikipedia.org/wiki/Normal_equations#General_linear_model . The derivation uses results about the gradient of the trace of a matrix product. I guess I just wanted to feel comfortable with these ideas - maybe build up a geometric picture and get some insight as to how everything works.
    $endgroup$
    – Simon
    Nov 11 '10 at 19:55
















  • 1




    $begingroup$
    Could you be a bit more specific? What exactly are you trying to learn and what do you already know? Do you want to understand things such as A = exp(Ct) solves dA/dt = CA for A, C matrices? Or perhaps even study matrix Lie groups and their differential properties (I can imagine this could have many engineering applications)?
    $endgroup$
    – Marek
    Nov 11 '10 at 19:46






  • 1




    $begingroup$
    Well, in linear regression, one can derive a closed-form solution in the form of the normal equations: en.wikipedia.org/wiki/Normal_equations#General_linear_model . The derivation uses results about the gradient of the trace of a matrix product. I guess I just wanted to feel comfortable with these ideas - maybe build up a geometric picture and get some insight as to how everything works.
    $endgroup$
    – Simon
    Nov 11 '10 at 19:55










1




1




$begingroup$
Could you be a bit more specific? What exactly are you trying to learn and what do you already know? Do you want to understand things such as A = exp(Ct) solves dA/dt = CA for A, C matrices? Or perhaps even study matrix Lie groups and their differential properties (I can imagine this could have many engineering applications)?
$endgroup$
– Marek
Nov 11 '10 at 19:46




$begingroup$
Could you be a bit more specific? What exactly are you trying to learn and what do you already know? Do you want to understand things such as A = exp(Ct) solves dA/dt = CA for A, C matrices? Or perhaps even study matrix Lie groups and their differential properties (I can imagine this could have many engineering applications)?
$endgroup$
– Marek
Nov 11 '10 at 19:46




1




1




$begingroup$
Well, in linear regression, one can derive a closed-form solution in the form of the normal equations: en.wikipedia.org/wiki/Normal_equations#General_linear_model . The derivation uses results about the gradient of the trace of a matrix product. I guess I just wanted to feel comfortable with these ideas - maybe build up a geometric picture and get some insight as to how everything works.
$endgroup$
– Simon
Nov 11 '10 at 19:55






$begingroup$
Well, in linear regression, one can derive a closed-form solution in the form of the normal equations: en.wikipedia.org/wiki/Normal_equations#General_linear_model . The derivation uses results about the gradient of the trace of a matrix product. I guess I just wanted to feel comfortable with these ideas - maybe build up a geometric picture and get some insight as to how everything works.
$endgroup$
– Simon
Nov 11 '10 at 19:55












2 Answers
2






active

oldest

votes


















6












$begingroup$

Actually the books cited above by Sivaram are excellent for numerical stuff. If you want "matrix calculus" then the following books might be helpful:




  1. Matrix Differential Calculus with Applications in Statistics and Econometrics by Magnus and Neudecker


  2. Functions of Matrices by N. Higham


  3. Calculus on Manifolds by Spivak



Some classic, but very useful material can also be found in




  1. Introduction to Matrix Analysis by Bellman.


As a simple example, the books will teach (unless you already know it) how to compute, say, the derivative of $f(X) = logdet(X)$ for an invertible matrix $X$.






share|cite|improve this answer









$endgroup$





















    1












    $begingroup$

    Gene Howard Golub, Charles F. Van Loan book on "Matrix Computations" is regarded as the "Bhagavad Gita" for Matrix Algorithms.



    http://books.google.com/books?id=mlOa7wPX6OYC&printsec=frontcover



    There is also another book by "Gene Howard Golub, Gerard Meurant" on "Matrices, moments, and quadrature with applications".



    http://books.google.com/books?id=IZvkFET3LlwC&printsec=frontcover



    Also, "Numerical Linear Algebra" by Trefethen and Bau is well-written and easy to read.



    http://books.google.com/books?id=bj-Lu6zjWbEC&printsec=frontcover



    I would highly recommend Trefethen and Bau since I have read it completely. I feel it is ideal for self-study or for a one quarter course. Once you are done with this you can take a look at Golubs' book. Golubs' book is really good for reference.






    share|cite|improve this answer











    $endgroup$














      Your Answer





      StackExchange.ifUsing("editor", function () {
      return StackExchange.using("mathjaxEditing", function () {
      StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
      StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
      });
      });
      }, "mathjax-editing");

      StackExchange.ready(function() {
      var channelOptions = {
      tags: "".split(" "),
      id: "69"
      };
      initTagRenderer("".split(" "), "".split(" "), channelOptions);

      StackExchange.using("externalEditor", function() {
      // Have to fire editor after snippets, if snippets enabled
      if (StackExchange.settings.snippets.snippetsEnabled) {
      StackExchange.using("snippets", function() {
      createEditor();
      });
      }
      else {
      createEditor();
      }
      });

      function createEditor() {
      StackExchange.prepareEditor({
      heartbeatType: 'answer',
      autoActivateHeartbeat: false,
      convertImagesToLinks: true,
      noModals: true,
      showLowRepImageUploadWarning: true,
      reputationToPostImages: 10,
      bindNavPrevention: true,
      postfix: "",
      imageUploader: {
      brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
      contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
      allowUrls: true
      },
      noCode: true, onDemand: true,
      discardSelector: ".discard-answer"
      ,immediatelyShowMarkdownHelp:true
      });


      }
      });














      draft saved

      draft discarded


















      StackExchange.ready(
      function () {
      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f9891%2freference-for-matrix-calculus%23new-answer', 'question_page');
      }
      );

      Post as a guest















      Required, but never shown

























      2 Answers
      2






      active

      oldest

      votes








      2 Answers
      2






      active

      oldest

      votes









      active

      oldest

      votes






      active

      oldest

      votes









      6












      $begingroup$

      Actually the books cited above by Sivaram are excellent for numerical stuff. If you want "matrix calculus" then the following books might be helpful:




      1. Matrix Differential Calculus with Applications in Statistics and Econometrics by Magnus and Neudecker


      2. Functions of Matrices by N. Higham


      3. Calculus on Manifolds by Spivak



      Some classic, but very useful material can also be found in




      1. Introduction to Matrix Analysis by Bellman.


      As a simple example, the books will teach (unless you already know it) how to compute, say, the derivative of $f(X) = logdet(X)$ for an invertible matrix $X$.






      share|cite|improve this answer









      $endgroup$


















        6












        $begingroup$

        Actually the books cited above by Sivaram are excellent for numerical stuff. If you want "matrix calculus" then the following books might be helpful:




        1. Matrix Differential Calculus with Applications in Statistics and Econometrics by Magnus and Neudecker


        2. Functions of Matrices by N. Higham


        3. Calculus on Manifolds by Spivak



        Some classic, but very useful material can also be found in




        1. Introduction to Matrix Analysis by Bellman.


        As a simple example, the books will teach (unless you already know it) how to compute, say, the derivative of $f(X) = logdet(X)$ for an invertible matrix $X$.






        share|cite|improve this answer









        $endgroup$
















          6












          6








          6





          $begingroup$

          Actually the books cited above by Sivaram are excellent for numerical stuff. If you want "matrix calculus" then the following books might be helpful:




          1. Matrix Differential Calculus with Applications in Statistics and Econometrics by Magnus and Neudecker


          2. Functions of Matrices by N. Higham


          3. Calculus on Manifolds by Spivak



          Some classic, but very useful material can also be found in




          1. Introduction to Matrix Analysis by Bellman.


          As a simple example, the books will teach (unless you already know it) how to compute, say, the derivative of $f(X) = logdet(X)$ for an invertible matrix $X$.






          share|cite|improve this answer









          $endgroup$



          Actually the books cited above by Sivaram are excellent for numerical stuff. If you want "matrix calculus" then the following books might be helpful:




          1. Matrix Differential Calculus with Applications in Statistics and Econometrics by Magnus and Neudecker


          2. Functions of Matrices by N. Higham


          3. Calculus on Manifolds by Spivak



          Some classic, but very useful material can also be found in




          1. Introduction to Matrix Analysis by Bellman.


          As a simple example, the books will teach (unless you already know it) how to compute, say, the derivative of $f(X) = logdet(X)$ for an invertible matrix $X$.







          share|cite|improve this answer












          share|cite|improve this answer



          share|cite|improve this answer










          answered Nov 12 '10 at 9:53







          user1709






























              1












              $begingroup$

              Gene Howard Golub, Charles F. Van Loan book on "Matrix Computations" is regarded as the "Bhagavad Gita" for Matrix Algorithms.



              http://books.google.com/books?id=mlOa7wPX6OYC&printsec=frontcover



              There is also another book by "Gene Howard Golub, Gerard Meurant" on "Matrices, moments, and quadrature with applications".



              http://books.google.com/books?id=IZvkFET3LlwC&printsec=frontcover



              Also, "Numerical Linear Algebra" by Trefethen and Bau is well-written and easy to read.



              http://books.google.com/books?id=bj-Lu6zjWbEC&printsec=frontcover



              I would highly recommend Trefethen and Bau since I have read it completely. I feel it is ideal for self-study or for a one quarter course. Once you are done with this you can take a look at Golubs' book. Golubs' book is really good for reference.






              share|cite|improve this answer











              $endgroup$


















                1












                $begingroup$

                Gene Howard Golub, Charles F. Van Loan book on "Matrix Computations" is regarded as the "Bhagavad Gita" for Matrix Algorithms.



                http://books.google.com/books?id=mlOa7wPX6OYC&printsec=frontcover



                There is also another book by "Gene Howard Golub, Gerard Meurant" on "Matrices, moments, and quadrature with applications".



                http://books.google.com/books?id=IZvkFET3LlwC&printsec=frontcover



                Also, "Numerical Linear Algebra" by Trefethen and Bau is well-written and easy to read.



                http://books.google.com/books?id=bj-Lu6zjWbEC&printsec=frontcover



                I would highly recommend Trefethen and Bau since I have read it completely. I feel it is ideal for self-study or for a one quarter course. Once you are done with this you can take a look at Golubs' book. Golubs' book is really good for reference.






                share|cite|improve this answer











                $endgroup$
















                  1












                  1








                  1





                  $begingroup$

                  Gene Howard Golub, Charles F. Van Loan book on "Matrix Computations" is regarded as the "Bhagavad Gita" for Matrix Algorithms.



                  http://books.google.com/books?id=mlOa7wPX6OYC&printsec=frontcover



                  There is also another book by "Gene Howard Golub, Gerard Meurant" on "Matrices, moments, and quadrature with applications".



                  http://books.google.com/books?id=IZvkFET3LlwC&printsec=frontcover



                  Also, "Numerical Linear Algebra" by Trefethen and Bau is well-written and easy to read.



                  http://books.google.com/books?id=bj-Lu6zjWbEC&printsec=frontcover



                  I would highly recommend Trefethen and Bau since I have read it completely. I feel it is ideal for self-study or for a one quarter course. Once you are done with this you can take a look at Golubs' book. Golubs' book is really good for reference.






                  share|cite|improve this answer











                  $endgroup$



                  Gene Howard Golub, Charles F. Van Loan book on "Matrix Computations" is regarded as the "Bhagavad Gita" for Matrix Algorithms.



                  http://books.google.com/books?id=mlOa7wPX6OYC&printsec=frontcover



                  There is also another book by "Gene Howard Golub, Gerard Meurant" on "Matrices, moments, and quadrature with applications".



                  http://books.google.com/books?id=IZvkFET3LlwC&printsec=frontcover



                  Also, "Numerical Linear Algebra" by Trefethen and Bau is well-written and easy to read.



                  http://books.google.com/books?id=bj-Lu6zjWbEC&printsec=frontcover



                  I would highly recommend Trefethen and Bau since I have read it completely. I feel it is ideal for self-study or for a one quarter course. Once you are done with this you can take a look at Golubs' book. Golubs' book is really good for reference.







                  share|cite|improve this answer














                  share|cite|improve this answer



                  share|cite|improve this answer








                  edited Nov 11 '10 at 19:44









                  Aryabhata

                  70.2k6157247




                  70.2k6157247










                  answered Nov 11 '10 at 19:41







                  user17762





































                      draft saved

                      draft discarded




















































                      Thanks for contributing an answer to Mathematics Stack Exchange!


                      • Please be sure to answer the question. Provide details and share your research!

                      But avoid …



                      • Asking for help, clarification, or responding to other answers.

                      • Making statements based on opinion; back them up with references or personal experience.


                      Use MathJax to format equations. MathJax reference.


                      To learn more, see our tips on writing great answers.




                      draft saved


                      draft discarded














                      StackExchange.ready(
                      function () {
                      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f9891%2freference-for-matrix-calculus%23new-answer', 'question_page');
                      }
                      );

                      Post as a guest















                      Required, but never shown





















































                      Required, but never shown














                      Required, but never shown












                      Required, but never shown







                      Required, but never shown

































                      Required, but never shown














                      Required, but never shown












                      Required, but never shown







                      Required, but never shown







                      -

                      Popular posts from this blog

                      Nidaros erkebispedøme

                      Image
                      For det lutherske bispedømet, sjå Nidaros bispedøme. Nidaros erkebispedøme var eit katolsk erkebispedøme med sete i Nidaros. Det vart oppretta av kong Olav Kyrre mellom 1070 og 1080 som bispedøme. Bispedømet vart opphøgd til erkebispedøme i 1153. Erkebispedømet vart innstifta av pave Anastasius IV i 1154, og var i funksjon fram til reformasjonen i 1537. Erkebiskopen sitt hovudsete var Erkebispegarden, rett ved domkyrkja Nidarosdomen. Frå 1152 til 1154 var Nicholas Breakspear i Skandinavia som paveleg utsending, og organiserte opprettinga av erkesetet. Innhaldsliste 1 Utbreiing og jurisdiksjon 2 Overhyrdar 2.1 Lydbiskopar 3 Biskopar 3.1 Biskopar 3.2 Erkebiskopar Utbreiing og jurisdiksjon | Kart over den nordiske kyrkjeprovinsen (1153-1387) Erkebispedømet omfatta i tillegg til Noreg øyane i vest i Noregsveldet. Nidaros var eit metropolitanerkebispedøme med fylgjande underliggjande bispedøme suffraganar: Bj...
                      Read more

                      Birsay

                      Image
                      Tettstaden Birsay på Orknøyane. Ruinane av jarleplasset om lag midt i biletet. (Fotografi frå 2012) Utsikt mot Birsay og Brough of Brisay (fotografi frå 2009) Birsay er ein tettstad i eit sokn (parish) med same namn, nordvest på øya Mainland [Note 1] på Orknøyane, om lag 31 km frå Kirkwall. Staden er omtala fleire stader i Orknøyingasoga [1] , der han er kalla «Byrgesherad» (norrønt: Birgisherað ). Namnet skriv seg truleg frå elvenamnet Birgisá [2] . Innhaldsliste 1 Den gamle hovudstaden 2 Bispesetet 3 Jarlepalasset 4 Kjelder og utfyllande opplysningar 4.1 Notar 4.2 Fotnotar 4.3 Bakgrunnsstoff Den gamle hovudstaden | Hovudartikkelen for dette emnet er Torfinn Sigurdsson . Soknet er i dag i hovudsak ei jordbrukskommune men er mest kjend for dei mange kulturminna i området. Tettstaden Birsay blir gjerne omtala som «den gamle hovudstaden på Orknøyane» [3] , og ein viser d...
                      Read more

                      Was Woodrow Wilson really a Liberal?Was World War I a war of liberals against authoritarians?Founding Fathers...

                      Image
                      Do VLANs within a subnet need to have their own subnet for router on a stick? What are the differences between the usage of 'it' and 'they'? Dragon forelimb placement How do we improve the relationship with a client software team that performs poorly and is becoming less collaborative? What typically incentivizes a professor to change jobs to a lower ranking university? How to write a macro that is braces sensitive? Modeling an IPv4 Address Writing rule stating superpower from different root cause is bad writing Can I ask the recruiters in my resume to put the reason why I am rejected? Approximately how much travel t...
                      Read more