Statistics: Multiple Regression

X

the "independent" or "predictor" variable

Y

the "response" or "dependent" variable

indicator variable

takes the value 0 or 1 to indicate the absence or presence of some categorical effect that may be expected to shift the outcome

Explained variance/Unexplained variance

how to find the f-statistic

correlation coefficient

A measure of the strength of the linear relationship between two variables

p-value

the probability of computing a value of the test statistic at least as extreme as the one found in the sample data when the null hypothesis is true

alternate hypothesis

is the conclusion we accept when we demonstrate that the null hypothesis is false (aka the research hypothesis)

null hypothesis

a statement about the value of a population parameter that is developed for testing in the face of numerical evidence

hypothesis testing

a statistical procedure, based on sample evidence and probability theory, used to determine whether the statement about the population parameter is reasonable.

significance level

the probability of rejecting the null hypothesis when it is true

regression analysis

Developing an equation that estimates the value of a dependent variable based on the value of an independent variable

least squares principle

A mathematical procedure that uses the data to position a line with the objective of minimizing the sum of the squares of the vertical distances between the actual Y values and the predicted values of Y

standard error of the estimate

A measure of the dispersion, or scatter, of the observed values around the line of regression for given values of ??1, ??2, ?, ????

coefficient of determination

The proportion of the total variation in the dependent variable ?? that is explained, or accounted for, by the regression

confidence interval

an interval estimate for the mean value of Y for given values of the independent variables

prediction interval

an interval estimate for an individual value of Y for given values of the independent variables

interpolation

the use of a formula to estimate an intermediate data value

extrapolation

the use of a formula, deduced from an initial set of data, for data values outside the range of the initial data set