How to understand that the solution to least squares problem transformed with Box-Cox Transformation, is a...
Can the Right Ascension and Argument of Perigee of a spacecraft's orbit keep varying by themselves with time?
Do working physicists consider Newtonian mechanics to be "falsified"?
Can a flute soloist sit?
Was credit for the black hole image misappropriated?
Windows 10: How to Lock (not sleep) laptop on lid close?
Store Dynamic-accessible hidden metadata in a cell
What is the padding with red substance inside of steak packaging?
Huge performance difference of the command find with and without using %M option to show permissions
Single author papers against my advisor's will?
How to determine omitted units in a publication
"is" operation returns false with ndarray.data attribute, even though two array objects have same id
The following signatures were invalid: EXPKEYSIG 1397BC53640DB551
How do you keep chess fun when your opponent constantly beats you?
Are there continuous functions who are the same in an interval but differ in at least one other point?
Why can't devices on different VLANs, but on the same subnet, communicate?
Do ℕ, mathbb{N}, BbbN, symbb{N} effectively differ, and is there a "canonical" specification of the naturals?
Is this wall load bearing? Blueprints and photos attached
US Healthcare consultation for visitors
What information about me do stores get via my credit card?
Drawing vertical/oblique lines in Metrical tree (tikz-qtree, tipa)
Word to describe a time interval
Intergalactic human space ship encounters another ship, character gets shunted off beyond known universe, reality starts collapsing
Can we generate random numbers using irrational numbers like π and e?
How do spell lists change if the party levels up without taking a long rest?
How to understand that the solution to least squares problem transformed with Box-Cox Transformation, is a generalized mean with $h(x)=x^lambda$?
The 2019 Stack Overflow Developer Survey Results Are In
Unicorn Meta Zoo #1: Why another podcast?
Announcing the arrival of Valued Associate #679: Cesar ManaraSolve a Tikhonov Regularized Least Squares Problem with Non Negative Constraints?Show that the least squares line must pass through the center of massBias of maximum likelihood estimator of an exponential distributionCorrelation of ProportionsStandard deviation for measurements with errors - least squares?Analytical solution to nonlinear least-squares problemLeast Squares with Euclidean ($ {L}_{2} $) Norm ConstraintDeriving least squares coefficients for curve of form $y=a/(x^2+b)$Bias adjustment for the Box-Cox back-transformationLinear Least-Squares Problem with Inequality Constraints on Residual
$begingroup$
The least squares problem $min_a sum_i^n (x_i-a)^2$ is sometimes solved using transformed variables, that is, solving $min_a sum_i^n [h(x_i)-h(a)]^2$. The solution to this latter problem is $a=h^{-1}(frac{1}{n}sum_i^n h(x_i))$.
If the least squares problem is transformed with the Box-Cox Transformation $$h_lambda(x)=left{begin{matrix}
frac{x^lambda -1}{lambda},text{ if }lambda neq 0\
log x,text{ if }lambda =0
end{matrix}right.$$
we can substitute $h$ by $h_lambda$ to the solution we obtained in the begining, and get $a=h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.
Furthermore, Berger and Casella (1992) say that for any monotone, continuous function $h$, it is easy to verify that if $g(x) = ah(x) + b$, where $a$ and $b$ are constants that do not depend on $x$ and $a neq 0$, then $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$. So, the solution is a generalized mean with $h(x)=x^lambda$, i.e. $$h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))=h^{-1}(frac{1}{n}sum_i^n h(x_i)), text{ where }h(x)=x^lambda.$$
In my opinion (to understand the process of Berger and Casella (1992)), using the notation in the last paragraph, we can let $a=b=frac{1}{lambda}$, $h(x)=x^lambda$, and then $g(x)=ah(x) + b$ is equal to $h_lambda(x)$. Further, the conclusion $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$ corresponds to $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.
However, what it have discussed is only the case of Box-Cox Transformation with $lambda neq 0$. How about the case with $lambda = 0$? Why does it omit that?
This is also the exercise 7.16(c) of the book Statistical Inference 2nd edition, where it gives the PROPOSITION that the solution is a generalized mean with $h(x)=x^lambda$. Again it omits the case with $lambda = 0$. So, is this PROPOSITION rigorous? Or, we don't need to discuss the case with $lambda = 0$?
statistics transformation least-squares means maximum-likelihood
$endgroup$
add a comment |
$begingroup$
The least squares problem $min_a sum_i^n (x_i-a)^2$ is sometimes solved using transformed variables, that is, solving $min_a sum_i^n [h(x_i)-h(a)]^2$. The solution to this latter problem is $a=h^{-1}(frac{1}{n}sum_i^n h(x_i))$.
If the least squares problem is transformed with the Box-Cox Transformation $$h_lambda(x)=left{begin{matrix}
frac{x^lambda -1}{lambda},text{ if }lambda neq 0\
log x,text{ if }lambda =0
end{matrix}right.$$
we can substitute $h$ by $h_lambda$ to the solution we obtained in the begining, and get $a=h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.
Furthermore, Berger and Casella (1992) say that for any monotone, continuous function $h$, it is easy to verify that if $g(x) = ah(x) + b$, where $a$ and $b$ are constants that do not depend on $x$ and $a neq 0$, then $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$. So, the solution is a generalized mean with $h(x)=x^lambda$, i.e. $$h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))=h^{-1}(frac{1}{n}sum_i^n h(x_i)), text{ where }h(x)=x^lambda.$$
In my opinion (to understand the process of Berger and Casella (1992)), using the notation in the last paragraph, we can let $a=b=frac{1}{lambda}$, $h(x)=x^lambda$, and then $g(x)=ah(x) + b$ is equal to $h_lambda(x)$. Further, the conclusion $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$ corresponds to $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.
However, what it have discussed is only the case of Box-Cox Transformation with $lambda neq 0$. How about the case with $lambda = 0$? Why does it omit that?
This is also the exercise 7.16(c) of the book Statistical Inference 2nd edition, where it gives the PROPOSITION that the solution is a generalized mean with $h(x)=x^lambda$. Again it omits the case with $lambda = 0$. So, is this PROPOSITION rigorous? Or, we don't need to discuss the case with $lambda = 0$?
statistics transformation least-squares means maximum-likelihood
$endgroup$
add a comment |
$begingroup$
The least squares problem $min_a sum_i^n (x_i-a)^2$ is sometimes solved using transformed variables, that is, solving $min_a sum_i^n [h(x_i)-h(a)]^2$. The solution to this latter problem is $a=h^{-1}(frac{1}{n}sum_i^n h(x_i))$.
If the least squares problem is transformed with the Box-Cox Transformation $$h_lambda(x)=left{begin{matrix}
frac{x^lambda -1}{lambda},text{ if }lambda neq 0\
log x,text{ if }lambda =0
end{matrix}right.$$
we can substitute $h$ by $h_lambda$ to the solution we obtained in the begining, and get $a=h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.
Furthermore, Berger and Casella (1992) say that for any monotone, continuous function $h$, it is easy to verify that if $g(x) = ah(x) + b$, where $a$ and $b$ are constants that do not depend on $x$ and $a neq 0$, then $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$. So, the solution is a generalized mean with $h(x)=x^lambda$, i.e. $$h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))=h^{-1}(frac{1}{n}sum_i^n h(x_i)), text{ where }h(x)=x^lambda.$$
In my opinion (to understand the process of Berger and Casella (1992)), using the notation in the last paragraph, we can let $a=b=frac{1}{lambda}$, $h(x)=x^lambda$, and then $g(x)=ah(x) + b$ is equal to $h_lambda(x)$. Further, the conclusion $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$ corresponds to $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.
However, what it have discussed is only the case of Box-Cox Transformation with $lambda neq 0$. How about the case with $lambda = 0$? Why does it omit that?
This is also the exercise 7.16(c) of the book Statistical Inference 2nd edition, where it gives the PROPOSITION that the solution is a generalized mean with $h(x)=x^lambda$. Again it omits the case with $lambda = 0$. So, is this PROPOSITION rigorous? Or, we don't need to discuss the case with $lambda = 0$?
statistics transformation least-squares means maximum-likelihood
$endgroup$
The least squares problem $min_a sum_i^n (x_i-a)^2$ is sometimes solved using transformed variables, that is, solving $min_a sum_i^n [h(x_i)-h(a)]^2$. The solution to this latter problem is $a=h^{-1}(frac{1}{n}sum_i^n h(x_i))$.
If the least squares problem is transformed with the Box-Cox Transformation $$h_lambda(x)=left{begin{matrix}
frac{x^lambda -1}{lambda},text{ if }lambda neq 0\
log x,text{ if }lambda =0
end{matrix}right.$$
we can substitute $h$ by $h_lambda$ to the solution we obtained in the begining, and get $a=h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.
Furthermore, Berger and Casella (1992) say that for any monotone, continuous function $h$, it is easy to verify that if $g(x) = ah(x) + b$, where $a$ and $b$ are constants that do not depend on $x$ and $a neq 0$, then $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$. So, the solution is a generalized mean with $h(x)=x^lambda$, i.e. $$h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))=h^{-1}(frac{1}{n}sum_i^n h(x_i)), text{ where }h(x)=x^lambda.$$
In my opinion (to understand the process of Berger and Casella (1992)), using the notation in the last paragraph, we can let $a=b=frac{1}{lambda}$, $h(x)=x^lambda$, and then $g(x)=ah(x) + b$ is equal to $h_lambda(x)$. Further, the conclusion $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = g^{-1}(frac{1}{n}sum_i^n g(x_i))$ corresponds to $h^{-1}(frac{1}{n}sum_i^n h(x_i)) = h_lambda^{-1}(frac{1}{n}sum_i^n h_lambda(x_i))$.
However, what it have discussed is only the case of Box-Cox Transformation with $lambda neq 0$. How about the case with $lambda = 0$? Why does it omit that?
This is also the exercise 7.16(c) of the book Statistical Inference 2nd edition, where it gives the PROPOSITION that the solution is a generalized mean with $h(x)=x^lambda$. Again it omits the case with $lambda = 0$. So, is this PROPOSITION rigorous? Or, we don't need to discuss the case with $lambda = 0$?
statistics transformation least-squares means maximum-likelihood
statistics transformation least-squares means maximum-likelihood
edited Mar 22 at 12:25
Tim Xu
asked Mar 22 at 12:20
Tim XuTim Xu
63
63
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3158069%2fhow-to-understand-that-the-solution-to-least-squares-problem-transformed-with-bo%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3158069%2fhow-to-understand-that-the-solution-to-least-squares-problem-transformed-with-bo%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown