Sampling from Gaussian mixture models, when are the sampled data independent?Central moments of a gaussian mixture density?Whitening a mixture of GaussiansGaussian mixture regression in higher dimensionsGMM weighting change during marginalizationdoubt regarding the gaussian mixture model definitionDecompose/split a single multivariate gauss into random gaussian mixtureConditional distribution for Gibbs sampling for Gaussian mixturePractical considerations on a mixture of Multivariate Normals, with many termsCan we apply Gaussian mixture model to all kinds of scensrios where some variables are unobserved?Why use a Gaussian mixture model?
Having the player face themselves after the mid-game
How to open new window on center of screen
Finding the minimum value of a function without using Calculus
Use Mercury as quenching liquid for swords?
School performs periodic password audits. Is my password compromised?
Can I negotiate a patent idea for a raise, under French law?
Was it really inappropriate to write a pull request for the company I interviewed with?
Rationale to prefer local variables over instance variables?
Doublet with ladder line vs coax w.r.t. noise
Strange opamp's output impedance in spice
Has a sovereign Communist government ever run, and conceded loss, on a fair election?
What would be the most expensive material to an intergalactic society?
Difference between `nmap local-IP-address` and `nmap localhost`
How to install round brake pads
Is this Paypal Github SDK reference really a dangerous site?
Is it appropriate to ask a former professor to order a book for me through an inter-library loan?
How do I increase the number of TTY consoles?
Why does Central Limit Theorem break down in my simulation?
Does an unused member variable take up memory?
Why restrict private health insurance?
Too soon for a plot twist?
What will happen if my luggage gets delayed?
What is the purpose of a disclaimer like "this is not legal advice"?
What to do if my university does not offer any advanced math courses?
Sampling from Gaussian mixture models, when are the sampled data independent?
Central moments of a gaussian mixture density?Whitening a mixture of GaussiansGaussian mixture regression in higher dimensionsGMM weighting change during marginalizationdoubt regarding the gaussian mixture model definitionDecompose/split a single multivariate gauss into random gaussian mixtureConditional distribution for Gibbs sampling for Gaussian mixturePractical considerations on a mixture of Multivariate Normals, with many termsCan we apply Gaussian mixture model to all kinds of scensrios where some variables are unobserved?Why use a Gaussian mixture model?
$begingroup$
Suppose I generate a Gaussian mixture model with $N$ Gaussian distributions
$p(x) = sumlimits_i = 1^N w_i mathcalN(x;mu_i, Sigma_i)$
where $w_i$ are the weights.
Now I sample some points $x_n$ from $p(x)$
What condition is needed to ensure that the points are independent from each other?
Is it sufficient to assume that each component $mathcalN(x;mu_i, Sigma_i)$ have diagonal covariance matrix $Sigma_i$?
normal-distribution mixed-model random-variable independence gaussian-mixture
asked 4 hours ago
Shamisen ExpertShamisen Expert
126111
$endgroup$
add a comment |
$begingroup$
Suppose I generate a Gaussian mixture model with $N$ Gaussian distributions
$p(x) = sumlimits_i = 1^N w_i mathcalN(x;mu_i, Sigma_i)$
where $w_i$ are the weights.
Now I sample some points $x_n$ from $p(x)$
What condition is needed to ensure that the points are independent from each other?
Is it sufficient to assume that each component $mathcalN(x;mu_i, Sigma_i)$ have diagonal covariance matrix $Sigma_i$?
normal-distribution mixed-model random-variable independence gaussian-mixture
asked 4 hours ago
Shamisen ExpertShamisen Expert
126111
$endgroup$
add a comment |
$begingroup$
Suppose I generate a Gaussian mixture model with $N$ Gaussian distributions
$p(x) = sumlimits_i = 1^N w_i mathcalN(x;mu_i, Sigma_i)$
where $w_i$ are the weights.
Now I sample some points $x_n$ from $p(x)$
What condition is needed to ensure that the points are independent from each other?
Is it sufficient to assume that each component $mathcalN(x;mu_i, Sigma_i)$ have diagonal covariance matrix $Sigma_i$?
normal-distribution mixed-model random-variable independence gaussian-mixture
asked 4 hours ago
Shamisen ExpertShamisen Expert
126111
$endgroup$
Suppose I generate a Gaussian mixture model with $N$ Gaussian distributions
$p(x) = sumlimits_i = 1^N w_i mathcalN(x;mu_i, Sigma_i)$
where $w_i$ are the weights.
Now I sample some points $x_n$ from $p(x)$
What condition is needed to ensure that the points are independent from each other?
Is it sufficient to assume that each component $mathcalN(x;mu_i, Sigma_i)$ have diagonal covariance matrix $Sigma_i$?
normal-distribution mixed-model random-variable independence gaussian-mixture
normal-distribution mixed-model random-variable independence gaussian-mixture
asked 4 hours ago
Shamisen ExpertShamisen Expert
126111
asked 4 hours ago
Shamisen ExpertShamisen Expert
126111
asked 4 hours ago
Shamisen ExpertShamisen Expert
126111
asked 4 hours ago
Shamisen ExpertShamisen Expert
126111
asked 4 hours ago
Shamisen ExpertShamisen Expert
126111
126111
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
You are confusing independence between the simulated vectors and independence between the components of a single vector. Unless otherwise stated, two simulations $X_1,X_2$ from$$sumlimits_i = 1^N w_i mathcalN(x;mu_i, Sigma_i)tag1$$will be independent, while the components of the vector $X_1$ will most likely be dependent, even when the matrices $Sigma_i$ are diagonal. (The intuition about that last point is that if $X_11$ is closer to $mu_1k$ than to the other Normal means, then the other components of $X_1$ are also more likely to originate from this same $k$-th element of the mixture.) For instance a most standard way to simulate from (1) is to simulate
$$Z_1simmathcal M(1;w_1,ldots,w_N)qquad X_1|Z_1=k sim mathcalN(x;mu_k, Sigma_k)$$and$$Z_2simmathcal M(1;w_1,ldots,w_N)qquad X_2|Z_2=k sim mathcalN(x;mu_k, Sigma_k)$$If the four variables are mutually independent then $X_1$ and $X_2$ are independent.
answered 4 hours ago
Xi'anXi'an
57.9k897360
$endgroup$
$begingroup$
Thanks for your answer. What is the meaning of $mathcalM$? Can you justify intuitively why the $X_1, X_2$ will most likely to be independent (this is clearer to me), whereas the components of $X_1$ will be dependent (this is not as clear to me)?
$endgroup$
– Shamisen Expert
3 hours ago
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "65"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f396582%2fsampling-from-gaussian-mixture-models-when-are-the-sampled-data-independent%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
You are confusing independence between the simulated vectors and independence between the components of a single vector. Unless otherwise stated, two simulations $X_1,X_2$ from$$sumlimits_i = 1^N w_i mathcalN(x;mu_i, Sigma_i)tag1$$will be independent, while the components of the vector $X_1$ will most likely be dependent, even when the matrices $Sigma_i$ are diagonal. (The intuition about that last point is that if $X_11$ is closer to $mu_1k$ than to the other Normal means, then the other components of $X_1$ are also more likely to originate from this same $k$-th element of the mixture.) For instance a most standard way to simulate from (1) is to simulate
$$Z_1simmathcal M(1;w_1,ldots,w_N)qquad X_1|Z_1=k sim mathcalN(x;mu_k, Sigma_k)$$and$$Z_2simmathcal M(1;w_1,ldots,w_N)qquad X_2|Z_2=k sim mathcalN(x;mu_k, Sigma_k)$$If the four variables are mutually independent then $X_1$ and $X_2$ are independent.
answered 4 hours ago
Xi'anXi'an
57.9k897360
$endgroup$
$begingroup$
Thanks for your answer. What is the meaning of $mathcalM$? Can you justify intuitively why the $X_1, X_2$ will most likely to be independent (this is clearer to me), whereas the components of $X_1$ will be dependent (this is not as clear to me)?
$endgroup$
– Shamisen Expert
3 hours ago
add a comment |
$begingroup$
You are confusing independence between the simulated vectors and independence between the components of a single vector. Unless otherwise stated, two simulations $X_1,X_2$ from$$sumlimits_i = 1^N w_i mathcalN(x;mu_i, Sigma_i)tag1$$will be independent, while the components of the vector $X_1$ will most likely be dependent, even when the matrices $Sigma_i$ are diagonal. (The intuition about that last point is that if $X_11$ is closer to $mu_1k$ than to the other Normal means, then the other components of $X_1$ are also more likely to originate from this same $k$-th element of the mixture.) For instance a most standard way to simulate from (1) is to simulate
$$Z_1simmathcal M(1;w_1,ldots,w_N)qquad X_1|Z_1=k sim mathcalN(x;mu_k, Sigma_k)$$and$$Z_2simmathcal M(1;w_1,ldots,w_N)qquad X_2|Z_2=k sim mathcalN(x;mu_k, Sigma_k)$$If the four variables are mutually independent then $X_1$ and $X_2$ are independent.
answered 4 hours ago
Xi'anXi'an
57.9k897360
$endgroup$
$begingroup$
Thanks for your answer. What is the meaning of $mathcalM$? Can you justify intuitively why the $X_1, X_2$ will most likely to be independent (this is clearer to me), whereas the components of $X_1$ will be dependent (this is not as clear to me)?
$endgroup$
– Shamisen Expert
3 hours ago
add a comment |
$begingroup$
You are confusing independence between the simulated vectors and independence between the components of a single vector. Unless otherwise stated, two simulations $X_1,X_2$ from$$sumlimits_i = 1^N w_i mathcalN(x;mu_i, Sigma_i)tag1$$will be independent, while the components of the vector $X_1$ will most likely be dependent, even when the matrices $Sigma_i$ are diagonal. (The intuition about that last point is that if $X_11$ is closer to $mu_1k$ than to the other Normal means, then the other components of $X_1$ are also more likely to originate from this same $k$-th element of the mixture.) For instance a most standard way to simulate from (1) is to simulate
$$Z_1simmathcal M(1;w_1,ldots,w_N)qquad X_1|Z_1=k sim mathcalN(x;mu_k, Sigma_k)$$and$$Z_2simmathcal M(1;w_1,ldots,w_N)qquad X_2|Z_2=k sim mathcalN(x;mu_k, Sigma_k)$$If the four variables are mutually independent then $X_1$ and $X_2$ are independent.
answered 4 hours ago
Xi'anXi'an
57.9k897360
$endgroup$
You are confusing independence between the simulated vectors and independence between the components of a single vector. Unless otherwise stated, two simulations $X_1,X_2$ from$$sumlimits_i = 1^N w_i mathcalN(x;mu_i, Sigma_i)tag1$$will be independent, while the components of the vector $X_1$ will most likely be dependent, even when the matrices $Sigma_i$ are diagonal. (The intuition about that last point is that if $X_11$ is closer to $mu_1k$ than to the other Normal means, then the other components of $X_1$ are also more likely to originate from this same $k$-th element of the mixture.) For instance a most standard way to simulate from (1) is to simulate
$$Z_1simmathcal M(1;w_1,ldots,w_N)qquad X_1|Z_1=k sim mathcalN(x;mu_k, Sigma_k)$$and$$Z_2simmathcal M(1;w_1,ldots,w_N)qquad X_2|Z_2=k sim mathcalN(x;mu_k, Sigma_k)$$If the four variables are mutually independent then $X_1$ and $X_2$ are independent.
answered 4 hours ago
Xi'anXi'an
57.9k897360
edited 3 hours ago
answered 4 hours ago
Xi'anXi'an
57.9k897360
answered 4 hours ago
Xi'anXi'an
57.9k897360
answered 4 hours ago
Xi'anXi'an
57.9k897360
57.9k897360
$begingroup$
Thanks for your answer. What is the meaning of $mathcalM$? Can you justify intuitively why the $X_1, X_2$ will most likely to be independent (this is clearer to me), whereas the components of $X_1$ will be dependent (this is not as clear to me)?
$endgroup$
– Shamisen Expert
3 hours ago
add a comment |
$begingroup$
Thanks for your answer. What is the meaning of $mathcalM$? Can you justify intuitively why the $X_1, X_2$ will most likely to be independent (this is clearer to me), whereas the components of $X_1$ will be dependent (this is not as clear to me)?
$endgroup$
– Shamisen Expert
3 hours ago
$begingroup$
Thanks for your answer. What is the meaning of $mathcalM$? Can you justify intuitively why the $X_1, X_2$ will most likely to be independent (this is clearer to me), whereas the components of $X_1$ will be dependent (this is not as clear to me)?
$endgroup$
– Shamisen Expert
3 hours ago
$begingroup$
Thanks for your answer. What is the meaning of $mathcalM$? Can you justify intuitively why the $X_1, X_2$ will most likely to be independent (this is clearer to me), whereas the components of $X_1$ will be dependent (this is not as clear to me)?
$endgroup$
– Shamisen Expert
3 hours ago
add a comment |
Thanks for contributing an answer to Cross Validated!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f396582%2fsampling-from-gaussian-mixture-models-when-are-the-sampled-data-independent%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
