Talk:Standard error

(Redirected from Talk:Standard error (statistics))
Latest comment: 2 years ago by Kodiologist in topic Relative standard error

See also: http://mathworld.wolfram.com/StandardError.html William M. Connolley 22:45, 2004 Mar 25 (UTC)

Just think about the needs of the reader of an encyclopaedia. Cutler 00:37, 26 Mar 2004 (UTC)

Notation

edit

A standard convention for standard error (y, SE, or otherwise) should be used in the equations throughout this article.

BailesB 19:30, 2 October 2007 (UTC)Reply


(User:Joeydream by 4 July 2006)

Stantard Error was used commonly in report of science/physics experiment.

the result was always written as x + (delta)x,

where (delta)x was called standard error.


The physical meaning of standard error is:

if the measurement was repeated, there is 68.2 % that the result was be measured in the range x + (delta)x

The sentence--

"In other words the standard error is the standard deviation of the sampling distribution of the sample statistic (such as sample mean, sample proportion or sample correlation)."

--is incorrect. The SE is an *estimate* of the SD of the sampling distribution. I'm changing this sentence to make it correct in the article.

See the section "Formerly disputed" below. RVS (talk) 20:52, 3 January 2009 (UTC)Reply

standard error an estimate

edit

The sentence--

"In other words the standard error is the standard deviation of the sampling distribution of the sample statistic (such as sample mean, sample proportion or sample correlation)."

--is incorrect. The SE is an *estimate* of the SD of the sampling distribution. Someone should change this sentence (and all other instances of the same mistake) in the article.

See the section "Formerly disputed" below. RVS (talk) 20:52, 3 January 2009 (UTC)Reply

?

edit

In the section: standard error of the mean, shouldn't the definition of sigma be "sample standard deviation" instead of "the mean" —Preceding unsigned comment added by 80.127.79.3 (talk) 13:41, 2 November 2007 (UTC)Reply

Standard Error and Students t-distribution

edit

The standard error is only an estimate of the standard deviation. If you know a sample to come from a normal distribution, you cannot use the standard error as if it were the standard deviation. An additional uncertainty is added to the stochastic nature of the probalistic variable when using an estimate instead of the true standrard deviation. To overcome this problem when dealing with normally distributed variable student's t-distribution is used. Someone should write something about this, or else the section about using the standard error together with the normal distribution should be deleted. —Preceding unsigned comment added by 130.239.3.3 (talk) 17:30, 12 March 2008 (UTC)Reply

Moved to end to follow convention. Melcombe (talk) 18:05, 12 March 2008 (UTC)Reply

Added something to article intro to start to cover above point. Possibly better elsewhere if article extended. Melcombe (talk) 18:05, 12 March 2008 (UTC)Reply

== Standard Error of Estimate? == ok

Misunderstood between Standard Error and Standard Error of Estimate.

This the same thing, because in the litterature we talk about "Standard Error of Estimate" and no "Standard Error"

That somebody can resolve this misunderstood? —Preceding unsigned comment added by Philogik (talkcontribs) 20:43, 16 March 2008 (UTC)Reply

But I think it is common to see some thing like "the estimate is ... and its standrard error is ..." Melcombe (talk) 10:01, 17 March 2008 (UTC)Reply

huh?

edit

The sentence: "The standard error of the mean (SEM), an unbiased estimate of expected error in the sample estimate of a population mean, is the sample estimate of the population standard deviation (sample standard deviation) divided by the square root of the sample size (assuming statistical independence of the values in the sample)"

is a run-on and difficult for the lay reader to understand. It needs to be split into two sentences (one defining SEOM and the other introducing the equation) and "dummed down" & cleaned up grammatically (sorta like this sentence). 129.110.197.120 (talk) 03:56, 3 September 2008 (UTC)Reply

Try to provide a better sentence, so that it can be inserted in the article. --Cyclopia (talk) 15:17, 3 September 2008 (UTC)Reply

Another "huh?"

edit

In the "Standard error of the mean" section, the article says "  is the sample standard deviation (i.e. the sample based estimate of the standard deviation of the population)." Or from the formula,  )

In the "Assumptions and usage" section, the article says "s is equal to the standard error for the sample mean."

Isn't this inconsistency a problem? --K keith (talk) 21:31, 24 September 2008 (UTC)Reply

Formerly disputed

edit

Inasmuch as this page is one of the 100 most frequently viewed math articles, it ought to be made correct. This talk page shows there's a lot of confusion and inconsistency. In my opinion, the problem is that the primary definition of standard error is the standard deviation of the sampling distribution of a statistic. This is the definition at, for example, Sampling distribution, Encyclopedia Britannica, and most other readily found references on the web. A secondary definition would be an estimate of that standard deviation calculated for a particular sample. This definition is given at, e.g., Wolfram MathWorld. (I have no doubt that the term is sometimes used this way as well, equivocally.) This article tries to take the secondary definition as primary, leading to confusion and inconsistency. The article should be rewritten to clearly distinguish between the quantity (which depends only on the population) and its estimate (which depends also on a particular sample). RVS (talk) 01:06, 24 December 2008 (UTC)Reply

I have tried to revise the intro appropriately and I have added a reference. However, feel free to join in and make changes. You might like to look at the activity at WP:WPSTAT . Melcombe (talk) 10:44, 29 December 2008 (UTC)Reply
Changed "Disputed" to "Formerly disputed" in the talk page, and removed Disputed template from main page. RVS (talk) 20:52, 3 January 2009 (UTC)Reply
Made further revisions to intro as well as "Standard error of the mean" to more clearly distinguish between the the two usages. RVS (talk) 02:49, 6 January 2009 (UTC)Reply

Estimate of error versus variation in distribution

edit

One paragraph of the intro tries to distinguish between the standard error as standard deviation of error in the estimation method, and standard error as expressing the distribution of the estimated values. My feeling is that this is probably a false distinction and that these concepts are essentially identical, or at least numerically identical. This also impacts the section on "Standard error of the mean", where in the course of rewriting I stated this more explicitly than was originally present. I'll try to analyze this eventually, but I hope someone more expert than I can beat me to it. RVS (talk) 02:49, 6 January 2009 (UTC)Reply

Rewrote this paragraph to say that the two concepts are numerically identical if the estimator is unbiased. (It would follow that if the estimator is biased, the standard error -- defined, properly, as on this page -- is not the same as the standard deviation of the error.) RVS (talk) 02:56, 8 January 2009 (UTC)Reply


Correction for correlation

edit

I find this section confusing and inadequate. Is this a standard, accepted result, or somebody's recent research? No citations or examples, etc.

nMSE? NMSE?

edit

nMSE redirects here though I have not been able to find anything related to it here. I am not sure if what I was looking for is this NMSE. Or if there is another measure called nMSE for time series forecating error. Arauzo (talk) 11:20, 11 April 2009 (UTC)Reply

interpretation of the term "standard error"

edit

this article says

The term "standard error" is derived from the fact that, as long as the estimator is unbiased, the standard deviation of the error (the difference between the estimate and the true value) is the same as the standard deviation of the estimates themselves;

i think a more intuitive interpretation is that, as stated in the [mean squared error] article,

for an unbiased estimator, the [root mean square error] is ... known as the standard error.

Moderatemax (talk) 21:12, 10 May 2009 (UTC)Reply

Seems like these two quotes are saying the pretty much the same thing, or at least are two sides of the same coin. RVS (talk) 00:18, 20 May 2009 (UTC)Reply
I can almost guarentee that for 99% of the non electrical engineers on wikipedia, RMS is pretty darn confusing. — Preceding unsigned comment added by 68.236.121.54 (talk) 18:57, 23 November 2011 (UTC)Reply

Image and caption check

edit

Can someone sanity check whether the caption I wrote for the image makes sense, or if there's a simpler way of depicting it? It feels like a wordy caption for a relatively simple concept. —AySz88\^-^ 23:58, 2 November 2009 (UTC)Reply

"Standard Error of the Difference Between the Means of Two Samples"

edit

Hi all,

I think this article also needs to address "Standard Error of the Difference Between the Means of Two Samples"

What do you think ?

Talgalili (talk) 16:52, 15 February 2010 (UTC)Reply

Quantiles of the normal distribution

edit

In

"If the data are assumed to be normally distributed, quantiles of the normal distribution and the sample mean and standard error can be used to calculate approximate confidence intervals for the mean. The following expressions can be used to calculate the upper and lower 95% confidence limits, where is equal to the sample mean, SE is equal to the standard error for the sample mean, and 1.96 is the .975 quantile of the normal distribution:"

,why does the 95% confidence level correspond with the 0.975 quantile of the normal distribution? Perhaps this could be explained more clearly. Also, it would be very useful to have the multiples of the SE multiple for a range of quantiles, for example, (90, 95, 99, 99.9). I'd appreciate it if a knowledgeable editor could look into making these changes. Doug (talk) 13:14, 12 April 2010 (UTC)Reply

Regarding the first question - It is because it the CI is for two sided test. This is actually a quite deep subject to go into since CI (a.k.a: confidence intervals), can be made in various ways. I also hope someone more knowledgeable then me will expend on it. Talgalili (talk) 14:38, 12 April 2010 (UTC)Reply

Requested move

edit
The following discussion is an archived discussion of a requested move. Please do not modify it. Subsequent comments should be made in a new section on the talk page. No further edits should be made to this section.

The result of the move request was: moved to Standard error. Favonian (talk) 18:06, 22 February 2012 (UTC)Reply


Standard error (statistics)Standard error – Most common usage, disambiguation to the Unix Standard Error can be put on top of page with no loss of information. 86.143.74.161 (talk) 14:59, 15 February 2012 (UTC)Reply

The above discussion is preserved as an archive of a requested move. Please do not modify it. Subsequent comments should be made in a new section on this talk page. No further edits should be made to this section.


Section comparing and contrasting with Standard Deviation is needed

edit

What makes the standard error of the mean confusing is that it is commonly used in scientific articles as a replacement for the standard deviation. This leads the naive reader to expect that the SEM is a statistic that measures variability. But it is not a statistic, it is an equation that provides a rough bound to the size of the error when estimating a population mean by sampling from the population. THis is a distinction of kind; the statistic is descriptive, this is analytic and is a weak estimate of how sampling error fades in light of the the central limit theorem. THe article should take some time to clarify this misconception. It is a common one because scientists often use the SEM so as to minimize the size of error bars in their figures. Mrdthree (talk) 13:52, 23 February 2012 (UTC)Reply


==I was about to post somthing like this, please do so. Also, the image should be changed. Though it works, it would mislead the casual read to think SD and SE are the same. Thank you! 91.203.34.14 (talk) 12:40, 5 April 2012 (UTC)Reply

== Here's a source contrasting standard error with standard deviation: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3148365/ Briancady413 (talk) 23:29, 19 February 2015 (UTC)Reply

Recent long (and possibly tedious) additions to this article

edit

Recently, Michaelg2015 introduced some very long and, I suggest, tedious material to the article: [1]. I propose that this material be removed. Isambard Kingdom (talk) 17:13, 14 January 2017 (UTC)Reply


Isambard Kingdom has proposed deletion of introductory material on the Standard error. I would point out the frequent criticism that Wikipedia statistics articles are not understandable to non-statisticians. Here are examples from some statistics article Talk pages:

  • "Please, somebody, take pity on those of us who need more fundamental understanding, and write an introduction to this subject that would be useful and graspable by anybody with the basic interest to look it up. That's how to make Wikipedia better; make it useful."
  • "Would it be possible to write an introductory section that gives just a conceptual description…?"
  • "This article is quite technical. It would be nice to have a simpler layman's description too."

That said, there are readers with more advanced knowledge, such as Kingdom, who find the introductory material too detailed and tedious. To address this issue, I have moved the introductory material to the end of the article. The material is now in the section with the title "Introduction to the standard error for the novice".

Readers who wish for a brief, mathematical, highly technical explanation can get that first, while readers who wish for a more comprehensible lay-oriented explanation can find it at the end.

Michaelg2015 (talk) 20:59, 14 January 2017 (UTC)Reply

Reason for removing paragraph

edit

The section Standard error#Correction for finite population says without citation

When sampling biological populations in particular, the population size N must be carefully expressed in "sample units". For example, a biologist counts beach clams in 1 square-metre quadrats along a 1000 m long sandy ocean beach. The biologist samples 10 random locations from a grid with 10 m intervals and calculates the FPC = √{(100 − 10)/(100 - 1)} = 0.95. Alternatively, the sampling interval could have been 20 m and FPC = √{(50 − 10)/(50 - 1)} = 0.90. Both of these corrections are wrong because the sampling frames are arbitrary. The correct N = 1000/1 = 1000 and the correct FPC = √{(1000 − 10)/(1000 - 1)} = 0.995. If the biologist were to perform a complete count of 1000 quadrats then every clam has been counted (in theory, at least), the sum of the quadrat counts equals the true population size, not an estimate, and the FPC = √{(1000 − 1000)/(1000 - 1)} = 0, so that the standard error of the mean count (and true population size) is zero.

Both finite-sample correction calculations are right since they apply to different sampling scenarios. In the first case, the biologist has counted clams along 100 meters of beachfront. In the second case, he has counted clams along 200 meters of beachfront. So of course in the latter case the standard error calculation has to be adjusted down more, since more of the finite population has been sampled. So I'm deleting this passage. Loraof (talk) 19:10, 3 July 2017 (UTC)Reply

Is standard error an estimate or not? This is still causing confusion.

edit

The section "Standard error of the mean" is clearly ambiguous -- the text says that standard error of the mean is the standard deviation of the sample mean, but the equations describe standard error of the mean as an estimate of that statistic. I can see that several people discussed this problem here on the Talk page and attempted to fix it about 10 years ago. Nevertheless, the ambiguity persists. I'm a novice on this subject, but I think I can at least remove the inconsistency in the article. I will attempt to do so and rely on experts to clean up any mistakes I may make. 47.142.130.130 (talk) 19:08, 8 September 2017 (UTC)Reply

Correction for autocorrelation

edit

The article has two conflicting pieces of information about the autocorrelation; In the main text a correction of sqrt((1+rho)/(1-rho)) is proposed. Reading the paper that is given as a reference, I understand that this is only the case when we compare our data with an AR1 process. The graph on the right proposes a different correction referring to a PhD thesis, which is not easily accessible. Does anyone know under what circumstances the graph is correct? Femkemilene (talk) 16:20, 7 February 2018 (UTC)Reply

I also stumbled at this point, because this only one very particular type of correlation discussed here. Moreover, I am also aware of other techniques such as bootstrapping, clustering, and Eicke-Huber-White Standard Errors that are different fixes for correlated standard errors. Sadly though, I am not an expert on the issue.--Merkasso (talk) 07:07, 31 July 2018 (UTC)Reply

Relative standard error

edit

Relative standard error redirects here, but isn't defined on the page. This page suggests it's just the standard error divided by the estimate. Has anybody seen this term in a textbook? —Kodiologist (t) 16:41, 24 August 2022 (UTC)Reply