Hexa Scholar

Regression

Least squares, regression diagnostics, regularization, logistic regression and generalized linear models.

14 planned

No page in this subject is open yet. The planned list below shows what is coming, in learning order.

Planned

In learning order. These are not pages yet.

  1. Least squares: which line, and why squaresIntro
  2. Regression to the meanIntro
  3. OLS as a projection: the geometry of regressionAdvanced undergrad
  4. Omitted variable biasAdvanced undergrad
  5. Leverage and influential pointsAdvanced undergrad
  6. Fitting curves with linear regression: basis functionsAdvanced undergrad
  7. Analysis of variance: splitting variation between and within groupsAdvanced undergrad
  8. Logistic regression: fitting probabilities to 0/1 dataAdvanced undergrad
  9. Standard errors of regression coefficientsAdvanced undergrad
  10. Generalized linear models: link functions and Poisson regressionAdvanced undergrad
  11. Multicollinearity: why coefficients go wild when predictors agreeAdvanced undergrad
  12. Heteroskedasticity and robust standard errorsAdvanced undergrad
  13. The Gauss-Markov theorem: when OLS is the best linear estimatorAdvanced undergrad
  14. Ridge and lasso: shrinking coefficients with a penaltyAdvanced undergrad