Sufficient condition for a point on the boundary of a feasible set to be a minimizerFirst-order condition for...
Air travel with refrigerated insulin
Homology of the fiber
What is the tangent at a sharp point on a curve?
Jem'Hadar, something strange about their life expectancy
CLI: Get information Ubuntu releases
Is xar preinstalled on macOS?
Friend wants my recommendation but I don't want to
Should I be concerned about student access to a test bank?
Why does Surtur say that Thor is Asgard's doom?
How to test the sharpness of a knife?
How can an organ that provides biological immortality be unable to regenerate?
How do you justify more code being written by following clean code practices?
Turning a hard to access nut?
Output visual diagram of picture
Why is indicated airspeed rather than ground speed used during the takeoff roll?
How to find the largest number(s) in a list of elements, possibly non-unique?
Exit shell with shortcut (not typing exit) that closes session properly
How are passwords stolen from companies if they only store hashes?
How to determine the greatest d orbital splitting?
How can a new country break out from a developed country without war?
Did Nintendo change its mind about 68000 SNES?
What (if any) is the reason to buy in small local stores?
Unfrosted light bulb
Should a narrator ever describe things based on a characters view instead of fact?
Sufficient condition for a point on the boundary of a feasible set to be a minimizer
First-order condition for one kind of optimizationKKT point of a constrained optimization problemInequality optimization, KKT condition.KKT Conditions and ConvexityWhy are the KKT conditions sufficient in this case?Is there only one set of KKT conditions for a given optimization problem?First order sufficient condition for minimumminimize $x_1$ subject to $ f_1(x_1,x_2) le C_1 $ $f_2(x_1,x_2) le C_2$Optimality condition for convex QCLPConfusion about KKT points
$begingroup$
Consider the optimization problem
minimize $-2x^2-y^2$ subject to
$x+y=2$
$xgeq0$
$ygeq0$
The global minimum of this problem is when $y=0$ and $x=2$. How can we check the second order sufficiency condition at this point?
The Lagrangian is
$$L=-2x^2-y^2+lambda_1 (x+y-2)+lambda_2(-y)$$
The KKT conditions are
$$-4x+lambda_1 =0$$
$$-2y+lambda_1-lambda_2=0$$
$$x+y-2=0,~~y=0$$
Then we get $x=2, y=0$ as valid stationary point with $lambda_1=8$ and $lambda_2=8>0$.
For second order sufficiency condition we need
$$z^T nabla^2_{x,y} L(x^star,y^star,lambda^star)z>0~~~ forall zin{thetain R^2|[1~1]theta=0,~[0~~-1]theta=0}={(0,0)}$$
The question is since the valid variation space does not exists, how to we carry out our second order analysis.
optimization
$endgroup$
add a comment |
$begingroup$
Consider the optimization problem
minimize $-2x^2-y^2$ subject to
$x+y=2$
$xgeq0$
$ygeq0$
The global minimum of this problem is when $y=0$ and $x=2$. How can we check the second order sufficiency condition at this point?
The Lagrangian is
$$L=-2x^2-y^2+lambda_1 (x+y-2)+lambda_2(-y)$$
The KKT conditions are
$$-4x+lambda_1 =0$$
$$-2y+lambda_1-lambda_2=0$$
$$x+y-2=0,~~y=0$$
Then we get $x=2, y=0$ as valid stationary point with $lambda_1=8$ and $lambda_2=8>0$.
For second order sufficiency condition we need
$$z^T nabla^2_{x,y} L(x^star,y^star,lambda^star)z>0~~~ forall zin{thetain R^2|[1~1]theta=0,~[0~~-1]theta=0}={(0,0)}$$
The question is since the valid variation space does not exists, how to we carry out our second order analysis.
optimization
$endgroup$
$begingroup$
The optimal point has to be on the boundary by the maximum principle (minimum of a concave function on a convex set).
$endgroup$
– LinAlg
Mar 6 at 17:46
1
$begingroup$
Yes the minimum point is in the boundary. But we assess the second order necessary condition that the Hessian of the Lagrangian over the valid variation space has to be positive definite, the valid variation space is just point zero and we cannot asses the second order sufficiency condition.
$endgroup$
– Eric Brown
Mar 7 at 1:41
$begingroup$
I added the KKT conditions
$endgroup$
– Eric Brown
Mar 12 at 4:45
$begingroup$
I do not understand why $y=0$ is a KKT condition. Should you not get $lambda_2y=0$, $xgeq 0$, $ygeq 0$? Since the KKT conditions are necessary, you can just enumerate all solutions to the KKT conditions and check whichs one is a minimum and which one is a maximum.
$endgroup$
– LinAlg
Mar 12 at 13:55
add a comment |
$begingroup$
Consider the optimization problem
minimize $-2x^2-y^2$ subject to
$x+y=2$
$xgeq0$
$ygeq0$
The global minimum of this problem is when $y=0$ and $x=2$. How can we check the second order sufficiency condition at this point?
The Lagrangian is
$$L=-2x^2-y^2+lambda_1 (x+y-2)+lambda_2(-y)$$
The KKT conditions are
$$-4x+lambda_1 =0$$
$$-2y+lambda_1-lambda_2=0$$
$$x+y-2=0,~~y=0$$
Then we get $x=2, y=0$ as valid stationary point with $lambda_1=8$ and $lambda_2=8>0$.
For second order sufficiency condition we need
$$z^T nabla^2_{x,y} L(x^star,y^star,lambda^star)z>0~~~ forall zin{thetain R^2|[1~1]theta=0,~[0~~-1]theta=0}={(0,0)}$$
The question is since the valid variation space does not exists, how to we carry out our second order analysis.
optimization
$endgroup$
Consider the optimization problem
minimize $-2x^2-y^2$ subject to
$x+y=2$
$xgeq0$
$ygeq0$
The global minimum of this problem is when $y=0$ and $x=2$. How can we check the second order sufficiency condition at this point?
The Lagrangian is
$$L=-2x^2-y^2+lambda_1 (x+y-2)+lambda_2(-y)$$
The KKT conditions are
$$-4x+lambda_1 =0$$
$$-2y+lambda_1-lambda_2=0$$
$$x+y-2=0,~~y=0$$
Then we get $x=2, y=0$ as valid stationary point with $lambda_1=8$ and $lambda_2=8>0$.
For second order sufficiency condition we need
$$z^T nabla^2_{x,y} L(x^star,y^star,lambda^star)z>0~~~ forall zin{thetain R^2|[1~1]theta=0,~[0~~-1]theta=0}={(0,0)}$$
The question is since the valid variation space does not exists, how to we carry out our second order analysis.
optimization
optimization
edited Mar 12 at 4:45
Eric Brown
asked Mar 6 at 4:12
Eric BrownEric Brown
435211
435211
$begingroup$
The optimal point has to be on the boundary by the maximum principle (minimum of a concave function on a convex set).
$endgroup$
– LinAlg
Mar 6 at 17:46
1
$begingroup$
Yes the minimum point is in the boundary. But we assess the second order necessary condition that the Hessian of the Lagrangian over the valid variation space has to be positive definite, the valid variation space is just point zero and we cannot asses the second order sufficiency condition.
$endgroup$
– Eric Brown
Mar 7 at 1:41
$begingroup$
I added the KKT conditions
$endgroup$
– Eric Brown
Mar 12 at 4:45
$begingroup$
I do not understand why $y=0$ is a KKT condition. Should you not get $lambda_2y=0$, $xgeq 0$, $ygeq 0$? Since the KKT conditions are necessary, you can just enumerate all solutions to the KKT conditions and check whichs one is a minimum and which one is a maximum.
$endgroup$
– LinAlg
Mar 12 at 13:55
add a comment |
$begingroup$
The optimal point has to be on the boundary by the maximum principle (minimum of a concave function on a convex set).
$endgroup$
– LinAlg
Mar 6 at 17:46
1
$begingroup$
Yes the minimum point is in the boundary. But we assess the second order necessary condition that the Hessian of the Lagrangian over the valid variation space has to be positive definite, the valid variation space is just point zero and we cannot asses the second order sufficiency condition.
$endgroup$
– Eric Brown
Mar 7 at 1:41
$begingroup$
I added the KKT conditions
$endgroup$
– Eric Brown
Mar 12 at 4:45
$begingroup$
I do not understand why $y=0$ is a KKT condition. Should you not get $lambda_2y=0$, $xgeq 0$, $ygeq 0$? Since the KKT conditions are necessary, you can just enumerate all solutions to the KKT conditions and check whichs one is a minimum and which one is a maximum.
$endgroup$
– LinAlg
Mar 12 at 13:55
$begingroup$
The optimal point has to be on the boundary by the maximum principle (minimum of a concave function on a convex set).
$endgroup$
– LinAlg
Mar 6 at 17:46
$begingroup$
The optimal point has to be on the boundary by the maximum principle (minimum of a concave function on a convex set).
$endgroup$
– LinAlg
Mar 6 at 17:46
1
1
$begingroup$
Yes the minimum point is in the boundary. But we assess the second order necessary condition that the Hessian of the Lagrangian over the valid variation space has to be positive definite, the valid variation space is just point zero and we cannot asses the second order sufficiency condition.
$endgroup$
– Eric Brown
Mar 7 at 1:41
$begingroup$
Yes the minimum point is in the boundary. But we assess the second order necessary condition that the Hessian of the Lagrangian over the valid variation space has to be positive definite, the valid variation space is just point zero and we cannot asses the second order sufficiency condition.
$endgroup$
– Eric Brown
Mar 7 at 1:41
$begingroup$
I added the KKT conditions
$endgroup$
– Eric Brown
Mar 12 at 4:45
$begingroup$
I added the KKT conditions
$endgroup$
– Eric Brown
Mar 12 at 4:45
$begingroup$
I do not understand why $y=0$ is a KKT condition. Should you not get $lambda_2y=0$, $xgeq 0$, $ygeq 0$? Since the KKT conditions are necessary, you can just enumerate all solutions to the KKT conditions and check whichs one is a minimum and which one is a maximum.
$endgroup$
– LinAlg
Mar 12 at 13:55
$begingroup$
I do not understand why $y=0$ is a KKT condition. Should you not get $lambda_2y=0$, $xgeq 0$, $ygeq 0$? Since the KKT conditions are necessary, you can just enumerate all solutions to the KKT conditions and check whichs one is a minimum and which one is a maximum.
$endgroup$
– LinAlg
Mar 12 at 13:55
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3137059%2fsufficient-condition-for-a-point-on-the-boundary-of-a-feasible-set-to-be-a-minim%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3137059%2fsufficient-condition-for-a-point-on-the-boundary-of-a-feasible-set-to-be-a-minim%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
The optimal point has to be on the boundary by the maximum principle (minimum of a concave function on a convex set).
$endgroup$
– LinAlg
Mar 6 at 17:46
1
$begingroup$
Yes the minimum point is in the boundary. But we assess the second order necessary condition that the Hessian of the Lagrangian over the valid variation space has to be positive definite, the valid variation space is just point zero and we cannot asses the second order sufficiency condition.
$endgroup$
– Eric Brown
Mar 7 at 1:41
$begingroup$
I added the KKT conditions
$endgroup$
– Eric Brown
Mar 12 at 4:45
$begingroup$
I do not understand why $y=0$ is a KKT condition. Should you not get $lambda_2y=0$, $xgeq 0$, $ygeq 0$? Since the KKT conditions are necessary, you can just enumerate all solutions to the KKT conditions and check whichs one is a minimum and which one is a maximum.
$endgroup$
– LinAlg
Mar 12 at 13:55