How to understand that the solution to least squares problem transformed with Box-Cox Transformation, is a...

Can the Right Ascension and Argument of Perigee of a spacecraft's orbit keep varying by themselves with time?

Do working physicists consider Newtonian mechanics to be "falsified"?

Can a flute soloist sit?

Was credit for the black hole image misappropriated?

Windows 10: How to Lock (not sleep) laptop on lid close?

Store Dynamic-accessible hidden metadata in a cell

What is the padding with red substance inside of steak packaging?

Huge performance difference of the command find with and without using %M option to show permissions

Single author papers against my advisor's will?

How to determine omitted units in a publication

"is" operation returns false with ndarray.data attribute, even though two array objects have same id

The following signatures were invalid: EXPKEYSIG 1397BC53640DB551

How do you keep chess fun when your opponent constantly beats you?

Are there continuous functions who are the same in an interval but differ in at least one other point?

Why can't devices on different VLANs, but on the same subnet, communicate?

Do ℕ, mathbb{N}, BbbN, symbb{N} effectively differ, and is there a "canonical" specification of the naturals?

Is this wall load bearing? Blueprints and photos attached

US Healthcare consultation for visitors

What information about me do stores get via my credit card?

Drawing vertical/oblique lines in Metrical tree (tikz-qtree, tipa)

Word to describe a time interval

Intergalactic human space ship encounters another ship, character gets shunted off beyond known universe, reality starts collapsing

Can we generate random numbers using irrational numbers like π and e?

How do spell lists change if the party levels up without taking a long rest?



How to understand that the solution to least squares problem transformed with Box-Cox Transformation, is a generalized mean with $h(x)=x^lambda$?



The 2019 Stack Overflow Developer Survey Results Are In
Unicorn Meta Zoo #1: Why another podcast?
Announcing the arrival of Valued Associate #679: Cesar ManaraSolve a Tikhonov Regularized Least Squares Problem with Non Negative Constraints?Show that the least squares line must pass through the center of massBias of maximum likelihood estimator of an exponential distributionCorrelation of ProportionsStandard deviation for measurements with errors - least squares?Analytical solution to nonlinear least-squares problemLeast Squares with Euclidean ($ {L}_{2} $) Norm ConstraintDeriving least squares coefficients for curve of form $y=a/(x^2+b)$Bias adjustment for the Box-Cox back-transformationLinear Least-Squares Problem with Inequality Constraints on Residual












0












$begingroup$


The least squares problem $min_a sum_i^n (x_i-a)^2$ is sometimes solved using transformed variables, that is, solving $min_a sum_i^n [h(x_i)-h(a)]^2$. The solution to this latter problem is $a=h^{-1}(frac{1}{n}sum_i^n h(x_i))$.



If the least squares problem is transformed with the Box-Cox Transformation $$h_lambda(x)=left{begin{matrix}
frac{x^lambda -1}{lambda},text{ if }lambda neq 0\
log x,text{ if }lambda =0
end{matrix}right.$$

we can substitute $h$ by $h_lambda$ to the solution we obtained in the begining, and get $a=h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.



Furthermore, Berger and Casella (1992) say that for any monotone, continuous function $h$, it is easy to verify that if $g(x) = ah(x) + b$, where $a$ and $b$ are constants that do not depend on $x$ and $a neq 0$, then $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$. So, the solution is a generalized mean with $h(x)=x^lambda$, i.e. $$h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))=h^{-1}(frac{1}{n}sum_i^n h(x_i)), text{ where }h(x)=x^lambda.$$



In my opinion (to understand the process of Berger and Casella (1992)), using the notation in the last paragraph, we can let $a=b=frac{1}{lambda}$, $h(x)=x^lambda$, and then $g(x)=ah(x) + b$ is equal to $h_lambda(x)$. Further, the conclusion $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$ corresponds to $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.



However, what it have discussed is only the case of Box-Cox Transformation with $lambda neq 0$. How about the case with $lambda = 0$? Why does it omit that?



This is also the exercise 7.16(c) of the book Statistical Inference 2nd edition, where it gives the PROPOSITION that the solution is a generalized mean with $h(x)=x^lambda$. Again it omits the case with $lambda = 0$. So, is this PROPOSITION rigorous? Or, we don't need to discuss the case with $lambda = 0$?










share|cite|improve this question











$endgroup$

















    0












    $begingroup$


    The least squares problem $min_a sum_i^n (x_i-a)^2$ is sometimes solved using transformed variables, that is, solving $min_a sum_i^n [h(x_i)-h(a)]^2$. The solution to this latter problem is $a=h^{-1}(frac{1}{n}sum_i^n h(x_i))$.



    If the least squares problem is transformed with the Box-Cox Transformation $$h_lambda(x)=left{begin{matrix}
    frac{x^lambda -1}{lambda},text{ if }lambda neq 0\
    log x,text{ if }lambda =0
    end{matrix}right.$$

    we can substitute $h$ by $h_lambda$ to the solution we obtained in the begining, and get $a=h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.



    Furthermore, Berger and Casella (1992) say that for any monotone, continuous function $h$, it is easy to verify that if $g(x) = ah(x) + b$, where $a$ and $b$ are constants that do not depend on $x$ and $a neq 0$, then $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$. So, the solution is a generalized mean with $h(x)=x^lambda$, i.e. $$h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))=h^{-1}(frac{1}{n}sum_i^n h(x_i)), text{ where }h(x)=x^lambda.$$



    In my opinion (to understand the process of Berger and Casella (1992)), using the notation in the last paragraph, we can let $a=b=frac{1}{lambda}$, $h(x)=x^lambda$, and then $g(x)=ah(x) + b$ is equal to $h_lambda(x)$. Further, the conclusion $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$ corresponds to $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.



    However, what it have discussed is only the case of Box-Cox Transformation with $lambda neq 0$. How about the case with $lambda = 0$? Why does it omit that?



    This is also the exercise 7.16(c) of the book Statistical Inference 2nd edition, where it gives the PROPOSITION that the solution is a generalized mean with $h(x)=x^lambda$. Again it omits the case with $lambda = 0$. So, is this PROPOSITION rigorous? Or, we don't need to discuss the case with $lambda = 0$?










    share|cite|improve this question











    $endgroup$















      0












      0








      0





      $begingroup$


      The least squares problem $min_a sum_i^n (x_i-a)^2$ is sometimes solved using transformed variables, that is, solving $min_a sum_i^n [h(x_i)-h(a)]^2$. The solution to this latter problem is $a=h^{-1}(frac{1}{n}sum_i^n h(x_i))$.



      If the least squares problem is transformed with the Box-Cox Transformation $$h_lambda(x)=left{begin{matrix}
      frac{x^lambda -1}{lambda},text{ if }lambda neq 0\
      log x,text{ if }lambda =0
      end{matrix}right.$$

      we can substitute $h$ by $h_lambda$ to the solution we obtained in the begining, and get $a=h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.



      Furthermore, Berger and Casella (1992) say that for any monotone, continuous function $h$, it is easy to verify that if $g(x) = ah(x) + b$, where $a$ and $b$ are constants that do not depend on $x$ and $a neq 0$, then $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$. So, the solution is a generalized mean with $h(x)=x^lambda$, i.e. $$h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))=h^{-1}(frac{1}{n}sum_i^n h(x_i)), text{ where }h(x)=x^lambda.$$



      In my opinion (to understand the process of Berger and Casella (1992)), using the notation in the last paragraph, we can let $a=b=frac{1}{lambda}$, $h(x)=x^lambda$, and then $g(x)=ah(x) + b$ is equal to $h_lambda(x)$. Further, the conclusion $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$ corresponds to $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.



      However, what it have discussed is only the case of Box-Cox Transformation with $lambda neq 0$. How about the case with $lambda = 0$? Why does it omit that?



      This is also the exercise 7.16(c) of the book Statistical Inference 2nd edition, where it gives the PROPOSITION that the solution is a generalized mean with $h(x)=x^lambda$. Again it omits the case with $lambda = 0$. So, is this PROPOSITION rigorous? Or, we don't need to discuss the case with $lambda = 0$?










      share|cite|improve this question











      $endgroup$




      The least squares problem $min_a sum_i^n (x_i-a)^2$ is sometimes solved using transformed variables, that is, solving $min_a sum_i^n [h(x_i)-h(a)]^2$. The solution to this latter problem is $a=h^{-1}(frac{1}{n}sum_i^n h(x_i))$.



      If the least squares problem is transformed with the Box-Cox Transformation $$h_lambda(x)=left{begin{matrix}
      frac{x^lambda -1}{lambda},text{ if }lambda neq 0\
      log x,text{ if }lambda =0
      end{matrix}right.$$

      we can substitute $h$ by $h_lambda$ to the solution we obtained in the begining, and get $a=h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.



      Furthermore, Berger and Casella (1992) say that for any monotone, continuous function $h$, it is easy to verify that if $g(x) = ah(x) + b$, where $a$ and $b$ are constants that do not depend on $x$ and $a neq 0$, then $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$. So, the solution is a generalized mean with $h(x)=x^lambda$, i.e. $$h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))=h^{-1}(frac{1}{n}sum_i^n h(x_i)), text{ where }h(x)=x^lambda.$$



      In my opinion (to understand the process of Berger and Casella (1992)), using the notation in the last paragraph, we can let $a=b=frac{1}{lambda}$, $h(x)=x^lambda$, and then $g(x)=ah(x) + b$ is equal to $h_lambda(x)$. Further, the conclusion $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$ corresponds to $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.



      However, what it have discussed is only the case of Box-Cox Transformation with $lambda neq 0$. How about the case with $lambda = 0$? Why does it omit that?



      This is also the exercise 7.16(c) of the book Statistical Inference 2nd edition, where it gives the PROPOSITION that the solution is a generalized mean with $h(x)=x^lambda$. Again it omits the case with $lambda = 0$. So, is this PROPOSITION rigorous? Or, we don't need to discuss the case with $lambda = 0$?







      statistics transformation least-squares means maximum-likelihood






      share|cite|improve this question















      share|cite|improve this question













      share|cite|improve this question




      share|cite|improve this question








      edited Mar 22 at 12:25







      Tim Xu

















      asked Mar 22 at 12:20









      Tim XuTim Xu

      63




      63






















          0






          active

          oldest

          votes












          Your Answer








          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "69"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          noCode: true, onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3158069%2fhow-to-understand-that-the-solution-to-least-squares-problem-transformed-with-bo%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes
















          draft saved

          draft discarded




















































          Thanks for contributing an answer to Mathematics Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3158069%2fhow-to-understand-that-the-solution-to-least-squares-problem-transformed-with-bo%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          六本木駅

          Integral that is continuous and looks like it converges to a geometric seriesTesting if a geometric series converges by taking limit to infinitySummation of arithmetic-geometric series of higher orderGeometric series with polynomial exponentHow to Recognize a Geometric SeriesShowing an integral equality with series over the integersDiscontinuity of a series of continuous functionsReasons why a Series ConvergesSum of infinite geometric series with two terms in summationUsing geometric series for computing IntegralsLimit of geometric series sum when $r = 1$

          Joseph Lister