Egwald Statistics: Multiple Regression Linear and Restricted Multiple Regression Researchers in the physical and social sciences often want to determine a relationship among a number of variables based on a set of data that are observations or measurements of these variables over a number of instances. Usually, one variable is called the dependent variable while the other variables are independent variables. A linear regression tries to determine the dependent variable as a linear function of the independent variables. Often researchers transform the variables, as in the CobbDouglas example below, before they estimate the linear function. While this terminology suggests a causal link from the independent variables to the dependent variable, this can not be inferred by the linear regression techniques alone. Linear regression is also called multiple regression, or least squares estimation. I suggest you step through my examples before you use my package for your own regression study. A. Multiple regression analysis package. a. Linear multiple regression.
1. Example: Predicting Canadian Elections using the equation:
ii. Example: Predicting Canadian Elections using data for the years 19492000. These 17 elections yield the equation:
iii. Example: Predicting Canadian Elections using data for the years 19492004. These 18 elections yield the equation: 2. Do your own regression study. b. Restricted linear regression. 1. Example: Cobb Douglas Production Function 2. Do your own restricted regression study B. 1. Check out the derivation of the regression model 2. Statistics, multiple regression, and numerical analysis references. 3. Linear Algebra background to least squares (multiple regression). C. Learn key concepts from the theory of probability used in statistics and regression analysis: Probability and Stochastic Processes. D. In my internet essay on government enterprises and democracy, I use the regression equation from A. to analyze how the Canadian Government handles its Crown corporations.E. For a blackbox advanced package checkout: SHAZAM: Econometrics Software. (I know the online documentation is a bit incomprehensible.) F. The American Economics Association's Resources for Economists on the Internet Table of Contents contains links to data sources, journals, software, consulting services, etc. G. Do you take everything with a grain of salt? Toys in the hands of boys can be dangerous! See Myths of Murder and Multiple Regression by Ted Goertzel of Rutgers University.
