Intuition Sobolev spaces and smoothing splines Announcing the arrival of Valued Associate...

Can a USB port passively 'listen only'?

How to tell that you are a giant?

2001: A Space Odyssey's use of the song "Daisy Bell" (Bicycle Built for Two); life imitates art or vice-versa?

Overriding an object in memory with placement new

Fundamental Solution of the Pell Equation

Why did the rest of the Eastern Bloc not invade Yugoslavia?

If a contract sometimes uses the wrong name, is it still valid?

Storing hydrofluoric acid before the invention of plastics

Output the ŋarâþ crîþ alphabet song without using (m)any letters

How do I stop a creek from eroding my steep embankment?

Why was the term "discrete" used in discrete logarithm?

What is the logic behind the Maharil's explanation of why we don't say שעשה ניסים on Pesach?

Check which numbers satisfy the condition [A*B*C = A! + B! + C!]

Using audio cues to encourage good posture

How to react to hostile behavior from a senior developer?

List of Python versions

What does "fit" mean in this sentence?

Is the Standard Deduction better than Itemized when both are the same amount?

How does debian/ubuntu knows a package has a updated version

How do pianists reach extremely loud dynamics?

What is the meaning of the new sigil in Game of Thrones Season 8 intro?

Why didn't this character "real die" when they blew their stack out in Altered Carbon?

Echoing a tail command produces unexpected output?

How to Merge Multiple Columns in to Two Columns based on Column 1 Value?



Intuition Sobolev spaces and smoothing splines



Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)How do the different ancillary conditions for splines differ?What do quadratic smoothing splines minimize?Linear regression of B-splines with terms inside an integral?Continuous embedding of magnetic Sobolev space into regular Sobolev spaceConvexity of a functional on a Sobolev spaceAbout the penalty matrix in smoothing splinesCubic Smoothing Splines and EigenvaluesAdmissible test functioneigenfunction representation with spline: show that coefficients fall faster than order of eigenvaluesConvergence Rate of Smoothing Splines












0












$begingroup$


With inputs $X_1, dots, X_n$ in a closed interval $[a,b]$ and $a<b$ the smoothing spline estimate $hat{f}$ of a given odd order $k$ is given by minimizing the following penalized residual sum of squares problem with $lambda geq 0$
begin{equation}
sum_{i=1}^{n}(Y_i - f(X_i))^2 + lambda int_{a}^{b}(f^{(r)}(x))^2dx quad text{ with $r=(k+1)/2$} quad (1)
end{equation}

over all functions $f$ in the so-called Sobolev space
$$
mathcal{W}_2^{(r)} = {f: f (r-1) text{-times continuously differentiable and} int_a^b[f^{(r)}(x)]^2 dx < infty }.
$$



Question:



Is there any intuition why $f$ must be taken from this function space? Can I say that this function space guarantees that the regularization term in (1) is well-defined and the estimated function is sufficiently smooth (measured by the continuous differentiability)?










share|cite|improve this question









$endgroup$

















    0












    $begingroup$


    With inputs $X_1, dots, X_n$ in a closed interval $[a,b]$ and $a<b$ the smoothing spline estimate $hat{f}$ of a given odd order $k$ is given by minimizing the following penalized residual sum of squares problem with $lambda geq 0$
    begin{equation}
    sum_{i=1}^{n}(Y_i - f(X_i))^2 + lambda int_{a}^{b}(f^{(r)}(x))^2dx quad text{ with $r=(k+1)/2$} quad (1)
    end{equation}

    over all functions $f$ in the so-called Sobolev space
    $$
    mathcal{W}_2^{(r)} = {f: f (r-1) text{-times continuously differentiable and} int_a^b[f^{(r)}(x)]^2 dx < infty }.
    $$



    Question:



    Is there any intuition why $f$ must be taken from this function space? Can I say that this function space guarantees that the regularization term in (1) is well-defined and the estimated function is sufficiently smooth (measured by the continuous differentiability)?










    share|cite|improve this question









    $endgroup$















      0












      0








      0





      $begingroup$


      With inputs $X_1, dots, X_n$ in a closed interval $[a,b]$ and $a<b$ the smoothing spline estimate $hat{f}$ of a given odd order $k$ is given by minimizing the following penalized residual sum of squares problem with $lambda geq 0$
      begin{equation}
      sum_{i=1}^{n}(Y_i - f(X_i))^2 + lambda int_{a}^{b}(f^{(r)}(x))^2dx quad text{ with $r=(k+1)/2$} quad (1)
      end{equation}

      over all functions $f$ in the so-called Sobolev space
      $$
      mathcal{W}_2^{(r)} = {f: f (r-1) text{-times continuously differentiable and} int_a^b[f^{(r)}(x)]^2 dx < infty }.
      $$



      Question:



      Is there any intuition why $f$ must be taken from this function space? Can I say that this function space guarantees that the regularization term in (1) is well-defined and the estimated function is sufficiently smooth (measured by the continuous differentiability)?










      share|cite|improve this question









      $endgroup$




      With inputs $X_1, dots, X_n$ in a closed interval $[a,b]$ and $a<b$ the smoothing spline estimate $hat{f}$ of a given odd order $k$ is given by minimizing the following penalized residual sum of squares problem with $lambda geq 0$
      begin{equation}
      sum_{i=1}^{n}(Y_i - f(X_i))^2 + lambda int_{a}^{b}(f^{(r)}(x))^2dx quad text{ with $r=(k+1)/2$} quad (1)
      end{equation}

      over all functions $f$ in the so-called Sobolev space
      $$
      mathcal{W}_2^{(r)} = {f: f (r-1) text{-times continuously differentiable and} int_a^b[f^{(r)}(x)]^2 dx < infty }.
      $$



      Question:



      Is there any intuition why $f$ must be taken from this function space? Can I say that this function space guarantees that the regularization term in (1) is well-defined and the estimated function is sufficiently smooth (measured by the continuous differentiability)?







      functional-analysis statistics sobolev-spaces spline






      share|cite|improve this question













      share|cite|improve this question











      share|cite|improve this question




      share|cite|improve this question










      asked Mar 24 at 10:57









      user483161user483161

      617




      617






















          0






          active

          oldest

          votes












          Your Answer








          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "69"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          noCode: true, onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3160396%2fintuition-sobolev-spaces-and-smoothing-splines%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes
















          draft saved

          draft discarded




















































          Thanks for contributing an answer to Mathematics Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3160396%2fintuition-sobolev-spaces-and-smoothing-splines%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          六本木駅

          Integral that is continuous and looks like it converges to a geometric seriesTesting if a geometric series converges by taking limit to infinitySummation of arithmetic-geometric series of higher orderGeometric series with polynomial exponentHow to Recognize a Geometric SeriesShowing an integral equality with series over the integersDiscontinuity of a series of continuous functionsReasons why a Series ConvergesSum of infinite geometric series with two terms in summationUsing geometric series for computing IntegralsLimit of geometric series sum when $r = 1$

          Joseph Lister