Mathematics of imaging the black hole The 2019 Stack Overflow Developer Survey Results Are In Unicorn Meta Zoo #1: Why another podcast? Announcing the arrival of Valued Associate #679: Cesar ManaraEstimating the derivative of a noisy, non-uniformly sampled functionMathematics TV clipsSwitching from pure mathematics (e.g. geometry) to more applied areas (e.g imaging) after Ph.D., as postdoc and chance of getting such a postdoc?Choosing the order of Tikhonov regularization of an inverse problemSample based inversion of the Radon transformWhen is a mapping the proximity operator of some convex function?The jump set of $SBV$ function for different value of parameter in image denoising problemCan the wavelet bispectrum be normalised so that its integral “gives the right answer”?Is there any paper which summarizes the mathematical foundation of deep learning?Strategies to make the sum operation bijective in a contribution problem

Mathematics of imaging the black hole



The 2019 Stack Overflow Developer Survey Results Are In
Unicorn Meta Zoo #1: Why another podcast?
Announcing the arrival of Valued Associate #679: Cesar ManaraEstimating the derivative of a noisy, non-uniformly sampled functionMathematics TV clipsSwitching from pure mathematics (e.g. geometry) to more applied areas (e.g imaging) after Ph.D., as postdoc and chance of getting such a postdoc?Choosing the order of Tikhonov regularization of an inverse problemSample based inversion of the Radon transformWhen is a mapping the proximity operator of some convex function?The jump set of $SBV$ function for different value of parameter in image denoising problemCan the wavelet bispectrum be normalised so that its integral “gives the right answer”?Is there any paper which summarizes the mathematical foundation of deep learning?Strategies to make the sum operation bijective in a contribution problem










45












$begingroup$


The first ever black hole was "pictured" recently, per an announcement made on 10th April, 2019. See for example: https://www.bbc.com/news/science-environment-47873592 .



It has been claimed that state-of-the-art imaging algorithms were an enabler for this historic success. Does anybody care to describe the difficulties, and (quite certainly non-trivial) mathematics that went into this effort ?










share|cite|improve this question











$endgroup$







  • 7




    $begingroup$
    For reference here is the paper where the collaboration described data processing: iopscience.iop.org/article/10.3847/2041-8213/ab0c57/meta
    $endgroup$
    – Neal
    yesterday










  • $begingroup$
    Katie Bouman's work might shed some light here!
    $endgroup$
    – yousuf soliman
    yesterday






  • 3




    $begingroup$
    But, @yousuf, will that light be able to escape from the black hole?
    $endgroup$
    – Gerry Myerson
    yesterday






  • 5




    $begingroup$
    The actual image reconstruction is described in paper IV: iopscience.iop.org/article/10.3847/2041-8213/ab0e85. In a nutshell, they formulated a baker's dozen of data misfit (for all the different acquired data as described in paper III) and regularization (including total variation and sparsity) functionals, and then minimized their weighted sum using L-BFGS. Not quite state-of-the-art from a mathematical point of view (especially using BFGS for a non-differentiable functional), but close enough.
    $endgroup$
    – Christian Clason
    yesterday







  • 4




    $begingroup$
    Great post and answer. For those also interested on the physics side of the discussions, here's a recent post: physics.stackexchange.com/questions/471972/…
    $endgroup$
    – user929304
    yesterday















45












$begingroup$


The first ever black hole was "pictured" recently, per an announcement made on 10th April, 2019. See for example: https://www.bbc.com/news/science-environment-47873592 .



It has been claimed that state-of-the-art imaging algorithms were an enabler for this historic success. Does anybody care to describe the difficulties, and (quite certainly non-trivial) mathematics that went into this effort ?










share|cite|improve this question











$endgroup$







  • 7




    $begingroup$
    For reference here is the paper where the collaboration described data processing: iopscience.iop.org/article/10.3847/2041-8213/ab0c57/meta
    $endgroup$
    – Neal
    yesterday










  • $begingroup$
    Katie Bouman's work might shed some light here!
    $endgroup$
    – yousuf soliman
    yesterday






  • 3




    $begingroup$
    But, @yousuf, will that light be able to escape from the black hole?
    $endgroup$
    – Gerry Myerson
    yesterday






  • 5




    $begingroup$
    The actual image reconstruction is described in paper IV: iopscience.iop.org/article/10.3847/2041-8213/ab0e85. In a nutshell, they formulated a baker's dozen of data misfit (for all the different acquired data as described in paper III) and regularization (including total variation and sparsity) functionals, and then minimized their weighted sum using L-BFGS. Not quite state-of-the-art from a mathematical point of view (especially using BFGS for a non-differentiable functional), but close enough.
    $endgroup$
    – Christian Clason
    yesterday







  • 4




    $begingroup$
    Great post and answer. For those also interested on the physics side of the discussions, here's a recent post: physics.stackexchange.com/questions/471972/…
    $endgroup$
    – user929304
    yesterday













45












45








45


5



$begingroup$


The first ever black hole was "pictured" recently, per an announcement made on 10th April, 2019. See for example: https://www.bbc.com/news/science-environment-47873592 .



It has been claimed that state-of-the-art imaging algorithms were an enabler for this historic success. Does anybody care to describe the difficulties, and (quite certainly non-trivial) mathematics that went into this effort ?










share|cite|improve this question











$endgroup$




The first ever black hole was "pictured" recently, per an announcement made on 10th April, 2019. See for example: https://www.bbc.com/news/science-environment-47873592 .



It has been claimed that state-of-the-art imaging algorithms were an enabler for this historic success. Does anybody care to describe the difficulties, and (quite certainly non-trivial) mathematics that went into this effort ?







signal-analysis inverse-problems machine-learning image-processing popularization






share|cite|improve this question















share|cite|improve this question













share|cite|improve this question




share|cite|improve this question








edited 23 hours ago









Rodrigo de Azevedo

1,8422820




1,8422820










asked yesterday









Piyush GroverPiyush Grover

1,63511328




1,63511328







  • 7




    $begingroup$
    For reference here is the paper where the collaboration described data processing: iopscience.iop.org/article/10.3847/2041-8213/ab0c57/meta
    $endgroup$
    – Neal
    yesterday










  • $begingroup$
    Katie Bouman's work might shed some light here!
    $endgroup$
    – yousuf soliman
    yesterday






  • 3




    $begingroup$
    But, @yousuf, will that light be able to escape from the black hole?
    $endgroup$
    – Gerry Myerson
    yesterday






  • 5




    $begingroup$
    The actual image reconstruction is described in paper IV: iopscience.iop.org/article/10.3847/2041-8213/ab0e85. In a nutshell, they formulated a baker's dozen of data misfit (for all the different acquired data as described in paper III) and regularization (including total variation and sparsity) functionals, and then minimized their weighted sum using L-BFGS. Not quite state-of-the-art from a mathematical point of view (especially using BFGS for a non-differentiable functional), but close enough.
    $endgroup$
    – Christian Clason
    yesterday







  • 4




    $begingroup$
    Great post and answer. For those also interested on the physics side of the discussions, here's a recent post: physics.stackexchange.com/questions/471972/…
    $endgroup$
    – user929304
    yesterday












  • 7




    $begingroup$
    For reference here is the paper where the collaboration described data processing: iopscience.iop.org/article/10.3847/2041-8213/ab0c57/meta
    $endgroup$
    – Neal
    yesterday










  • $begingroup$
    Katie Bouman's work might shed some light here!
    $endgroup$
    – yousuf soliman
    yesterday






  • 3




    $begingroup$
    But, @yousuf, will that light be able to escape from the black hole?
    $endgroup$
    – Gerry Myerson
    yesterday






  • 5




    $begingroup$
    The actual image reconstruction is described in paper IV: iopscience.iop.org/article/10.3847/2041-8213/ab0e85. In a nutshell, they formulated a baker's dozen of data misfit (for all the different acquired data as described in paper III) and regularization (including total variation and sparsity) functionals, and then minimized their weighted sum using L-BFGS. Not quite state-of-the-art from a mathematical point of view (especially using BFGS for a non-differentiable functional), but close enough.
    $endgroup$
    – Christian Clason
    yesterday







  • 4




    $begingroup$
    Great post and answer. For those also interested on the physics side of the discussions, here's a recent post: physics.stackexchange.com/questions/471972/…
    $endgroup$
    – user929304
    yesterday







7




7




$begingroup$
For reference here is the paper where the collaboration described data processing: iopscience.iop.org/article/10.3847/2041-8213/ab0c57/meta
$endgroup$
– Neal
yesterday




$begingroup$
For reference here is the paper where the collaboration described data processing: iopscience.iop.org/article/10.3847/2041-8213/ab0c57/meta
$endgroup$
– Neal
yesterday












$begingroup$
Katie Bouman's work might shed some light here!
$endgroup$
– yousuf soliman
yesterday




$begingroup$
Katie Bouman's work might shed some light here!
$endgroup$
– yousuf soliman
yesterday




3




3




$begingroup$
But, @yousuf, will that light be able to escape from the black hole?
$endgroup$
– Gerry Myerson
yesterday




$begingroup$
But, @yousuf, will that light be able to escape from the black hole?
$endgroup$
– Gerry Myerson
yesterday




5




5




$begingroup$
The actual image reconstruction is described in paper IV: iopscience.iop.org/article/10.3847/2041-8213/ab0e85. In a nutshell, they formulated a baker's dozen of data misfit (for all the different acquired data as described in paper III) and regularization (including total variation and sparsity) functionals, and then minimized their weighted sum using L-BFGS. Not quite state-of-the-art from a mathematical point of view (especially using BFGS for a non-differentiable functional), but close enough.
$endgroup$
– Christian Clason
yesterday





$begingroup$
The actual image reconstruction is described in paper IV: iopscience.iop.org/article/10.3847/2041-8213/ab0e85. In a nutshell, they formulated a baker's dozen of data misfit (for all the different acquired data as described in paper III) and regularization (including total variation and sparsity) functionals, and then minimized their weighted sum using L-BFGS. Not quite state-of-the-art from a mathematical point of view (especially using BFGS for a non-differentiable functional), but close enough.
$endgroup$
– Christian Clason
yesterday





4




4




$begingroup$
Great post and answer. For those also interested on the physics side of the discussions, here's a recent post: physics.stackexchange.com/questions/471972/…
$endgroup$
– user929304
yesterday




$begingroup$
Great post and answer. For those also interested on the physics side of the discussions, here's a recent post: physics.stackexchange.com/questions/471972/…
$endgroup$
– user929304
yesterday










1 Answer
1






active

oldest

votes


















35












$begingroup$

Essential elements of the reconstruction algorithm were developed at MIT under the name CHIRP = Continuous High-resolution Image Reconstruction using Patch priors, as described in Computational Imaging for VLBI Image Reconstruction (2015).



The difficulty of VLBI (Very Long Baseline Interferometry Image) reconstruction is that the inversion problem is highly-ill posed, there are many images that explain the data. The challenge is to find an explanation that respects our prior assumptions about the “visual” universe while still satisfying the observed data. Bayesian approaches are generally employed for that purpose, in CHIRP machine learning is used to automatically identify visual patterns --- obviating the need for hand training of the algorithm.



A key technical innovation is a way to correct for the delays in the signal received from the various telescopes. The delays are difficult to predict, since they depend the local variations in the speed of the radio waves through the noisy atmosphere. CHIRP adopts an algebraic solution known as phase closure to this problem: If the measurements from three telescopes are multiplied, the extra delays caused by atmospheric noise cancel each other out.



One test case that shows the resolving power of CHIRP, compared to a competing algorithm (BU) is shown below (taken from the MIT paper). Notice how CHIRP is able to resolve 2 separate, previously unresolved, bright emissions in the blazar OJ287.








share|cite|improve this answer











$endgroup$













    Your Answer








    StackExchange.ready(function()
    var channelOptions =
    tags: "".split(" "),
    id: "504"
    ;
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function()
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled)
    StackExchange.using("snippets", function()
    createEditor();
    );

    else
    createEditor();

    );

    function createEditor()
    StackExchange.prepareEditor(
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: true,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: 10,
    bindNavPrevention: true,
    postfix: "",
    imageUploader:
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    ,
    noCode: true, onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    );



    );













    draft saved

    draft discarded


















    StackExchange.ready(
    function ()
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmathoverflow.net%2fquestions%2f327733%2fmathematics-of-imaging-the-black-hole%23new-answer', 'question_page');

    );

    Post as a guest















    Required, but never shown

























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    35












    $begingroup$

    Essential elements of the reconstruction algorithm were developed at MIT under the name CHIRP = Continuous High-resolution Image Reconstruction using Patch priors, as described in Computational Imaging for VLBI Image Reconstruction (2015).



    The difficulty of VLBI (Very Long Baseline Interferometry Image) reconstruction is that the inversion problem is highly-ill posed, there are many images that explain the data. The challenge is to find an explanation that respects our prior assumptions about the “visual” universe while still satisfying the observed data. Bayesian approaches are generally employed for that purpose, in CHIRP machine learning is used to automatically identify visual patterns --- obviating the need for hand training of the algorithm.



    A key technical innovation is a way to correct for the delays in the signal received from the various telescopes. The delays are difficult to predict, since they depend the local variations in the speed of the radio waves through the noisy atmosphere. CHIRP adopts an algebraic solution known as phase closure to this problem: If the measurements from three telescopes are multiplied, the extra delays caused by atmospheric noise cancel each other out.



    One test case that shows the resolving power of CHIRP, compared to a competing algorithm (BU) is shown below (taken from the MIT paper). Notice how CHIRP is able to resolve 2 separate, previously unresolved, bright emissions in the blazar OJ287.








    share|cite|improve this answer











    $endgroup$

















      35












      $begingroup$

      Essential elements of the reconstruction algorithm were developed at MIT under the name CHIRP = Continuous High-resolution Image Reconstruction using Patch priors, as described in Computational Imaging for VLBI Image Reconstruction (2015).



      The difficulty of VLBI (Very Long Baseline Interferometry Image) reconstruction is that the inversion problem is highly-ill posed, there are many images that explain the data. The challenge is to find an explanation that respects our prior assumptions about the “visual” universe while still satisfying the observed data. Bayesian approaches are generally employed for that purpose, in CHIRP machine learning is used to automatically identify visual patterns --- obviating the need for hand training of the algorithm.



      A key technical innovation is a way to correct for the delays in the signal received from the various telescopes. The delays are difficult to predict, since they depend the local variations in the speed of the radio waves through the noisy atmosphere. CHIRP adopts an algebraic solution known as phase closure to this problem: If the measurements from three telescopes are multiplied, the extra delays caused by atmospheric noise cancel each other out.



      One test case that shows the resolving power of CHIRP, compared to a competing algorithm (BU) is shown below (taken from the MIT paper). Notice how CHIRP is able to resolve 2 separate, previously unresolved, bright emissions in the blazar OJ287.








      share|cite|improve this answer











      $endgroup$















        35












        35








        35





        $begingroup$

        Essential elements of the reconstruction algorithm were developed at MIT under the name CHIRP = Continuous High-resolution Image Reconstruction using Patch priors, as described in Computational Imaging for VLBI Image Reconstruction (2015).



        The difficulty of VLBI (Very Long Baseline Interferometry Image) reconstruction is that the inversion problem is highly-ill posed, there are many images that explain the data. The challenge is to find an explanation that respects our prior assumptions about the “visual” universe while still satisfying the observed data. Bayesian approaches are generally employed for that purpose, in CHIRP machine learning is used to automatically identify visual patterns --- obviating the need for hand training of the algorithm.



        A key technical innovation is a way to correct for the delays in the signal received from the various telescopes. The delays are difficult to predict, since they depend the local variations in the speed of the radio waves through the noisy atmosphere. CHIRP adopts an algebraic solution known as phase closure to this problem: If the measurements from three telescopes are multiplied, the extra delays caused by atmospheric noise cancel each other out.



        One test case that shows the resolving power of CHIRP, compared to a competing algorithm (BU) is shown below (taken from the MIT paper). Notice how CHIRP is able to resolve 2 separate, previously unresolved, bright emissions in the blazar OJ287.








        share|cite|improve this answer











        $endgroup$



        Essential elements of the reconstruction algorithm were developed at MIT under the name CHIRP = Continuous High-resolution Image Reconstruction using Patch priors, as described in Computational Imaging for VLBI Image Reconstruction (2015).



        The difficulty of VLBI (Very Long Baseline Interferometry Image) reconstruction is that the inversion problem is highly-ill posed, there are many images that explain the data. The challenge is to find an explanation that respects our prior assumptions about the “visual” universe while still satisfying the observed data. Bayesian approaches are generally employed for that purpose, in CHIRP machine learning is used to automatically identify visual patterns --- obviating the need for hand training of the algorithm.



        A key technical innovation is a way to correct for the delays in the signal received from the various telescopes. The delays are difficult to predict, since they depend the local variations in the speed of the radio waves through the noisy atmosphere. CHIRP adopts an algebraic solution known as phase closure to this problem: If the measurements from three telescopes are multiplied, the extra delays caused by atmospheric noise cancel each other out.



        One test case that shows the resolving power of CHIRP, compared to a competing algorithm (BU) is shown below (taken from the MIT paper). Notice how CHIRP is able to resolve 2 separate, previously unresolved, bright emissions in the blazar OJ287.









        share|cite|improve this answer














        share|cite|improve this answer



        share|cite|improve this answer








        edited yesterday

























        answered yesterday









        Carlo BeenakkerCarlo Beenakker

        80.4k9193295




        80.4k9193295



























            draft saved

            draft discarded
















































            Thanks for contributing an answer to MathOverflow!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid


            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.

            Use MathJax to format equations. MathJax reference.


            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmathoverflow.net%2fquestions%2f327733%2fmathematics-of-imaging-the-black-hole%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            -image-processing, inverse-problems, machine-learning, popularization, signal-analysis

            Popular posts from this blog

            Word for a person who has no opinion about whether god existsWord for having a definite opinion while simultaneously withholding judgment?What's the opposite of “newcomer? Is ”veteran" OK?What do you call an “atheist” who might believe in an afterlife?What's a word for someone who wants to voice opinions but not have them challenged?Word for someone who dismisses contrary opinions as irrational?Somone who thinks they are overly special/out of the ordinaryIs there a word, phrase or idiom for “a person who is incapable of thinking about the future”?The belief that a god is human-likeA word for a non-famous person/thing you have heard a lot aboutAdjective for a person who enjoys taking care of their appearance

            2017 IndyCar Series Contents Series news Teams and drivers Schedule Season summary Footnotes References External links Navigation menu"INDYCAR: Initial 2018 bodywork concepts unveiled"the original"IndyCar confirms switch to Performance Friction brakes in 2017""AJ Foyt Racing will switch to Chevy"the original"Carlos Munoz, Conor Daly will drive for AJ Foyt Racing""Zach Veach's Indy 500 Debut Confirmed with Foyt""No mass exodus from Honda after Ganassi switch""Ex-F1 driver Sato joins Andretti Autosport for 2017 IndyCar season""IndyCar's Ryan Hunter-Reay, sponsor DHL paired through 2020""hhgregg and Andretti Autosport announce partnership for key races in 2016""INDYCAR: Rossi re-signs with Andretti"the original"McLaren Formula 1 - Fernando Alonso to race at Indy 500 with McLaren, Honda and Andretti Autosport""Shank will finally take part in Indy 500 with Harvey, Andretti | MotorSportsTalk""Andretti adds Jack Harvey to Indy 500 field""Ganassi switches to Honda power for 2017""INDYCAR: Chilton returns to Ganassi"the original"IndyCar silly season: Who's going where in 2017?""INDYCAR: Kanaan, NTT Data return to Ganassi"the original"Kimball to remain at Ganassi for 2017""Coyne confirms Bourdais for 2017 IndyCar season""Davison to sub for Bourdais in Indy 500"the original"Gutierrez confirmed for Detroit IndyCar debut""Gutierrez returns with Coyne for rest of 2017 season""Vautier to drive for Coyne at Texas"the original"INDYCAR: Coyne confirms Jones for 2017"the original"Pippa Mann returns to Coyne for Indy 500""Karam, Dreyer & Reinbold teaming up again for Indianapolis 500""Pigot to return to Ed Carpenter Racing""Hildebrand confirmed as full-time Ed Carpenter driver""Veach to replace injured Hildebrand at Barber"the originalNew Team Harding Racing Enters Chaves for 101st Indianapolis 500"Juncos Racing Announces Entry in 101st Running of the Indianapolis 500 :: Juncos Racing""Juncos confirms Pigot for Indy 500""Saavedra confirmed in Juncos' second 500 entry"the original"Lazier confirms Indy 500 run after son's USF2000 debut"the original"Claman DeMelo to race for RLLR at Sonoma"the original"Rahal signs Servia and ace engineer for 2017""IndyCar: Aleshin returns with Schmidt"the original"Aleshin replaced by Saavedra for Toronto""Jack Harvey will pilot SPM No. 7 car at Watkins Glen, Sonoma""Jay Howard confirmed in Tony Stewart's supported SPM Indy entry""INDYCAR: Newgarden to wave the flag at Penske"the original"Pagenaud opts for No. 1 in 2017"the original"Penske confirms Newgarden for 2017""Montoya to stay with Team Penske in 2017""Target leaving IndyCar after 27 seasons with Chip Ganassi""Cavin: IndyCar could see complete driver/team shakeup in 2017""End of the road for KV Racing?""KV Racing confirms closure, equipment sold to Juncos""Juncos confirms IndyCar Series entry"the original"Juncos readies IndyCar program, aims for '17 500"the original"Harding Racing to add Texas, Pocono to schedule"the original"Sato signs with Andretti Autosport for 2017""INDYCAR: Aleshin in Doubt at SPM"the original"Long Beach notebook: JR Hildebrand breaks hand""Hildebrand cleared to return at Phoenix"the original"Bourdais to undergo surgery on multiple fractures""Aleshin loses Schmidt Peterson IndyCar ride""Saavedra in at SPM for Pocono, Gateway"the original"Bourdais to make return at Gateway"the original"The IndyCar Grand Prix no longer is sponsored by Angie's List""2017 IndyCar Series rulebook""2017 Verizon IndyCar Series Official Rulebook"Official websiteeeeee

            What was this official D&D 3.5e Lovecraft-flavored rulebook?What was this set of RPG tools called?As a first-time DM should I let my players play complex character classes and roles?Nymph's Kiss and the RelationshipWhat was the name of this Cleric Prestige Class that shapes metal with its bare hands?Are the 3.5e Dragonlance books third party or official works?What's up with the domain Vile Darkness?What was this 80s book about RPGs?What was the name of this Werewolf band?What book had Rituals to “upgrade” animal companions to keep them viable at higher levels?What was this RPG that had rules for player-owned businesses?