Linear regression and logistic regression are statistical modeling techniques. Linear regression predicts continuous dependent variables using independent variables, while logistic regression predicts binary dependent variables. Both aim to model relationships between variables by estimating coefficients. Logistic regression models the log odds of the dependent variable rather than the variable directly. Key evaluation metrics for regression include accuracy, precision, recall, and F1 score, which are calculated using a confusion matrix.