SU-CS205L JAN092025

Key Sequence

Review

• data interpolation
• regularization

Notation

New Concepts

• Train-Test Split
• Robustness
  • well-posedness
• Numerical Stability
  • numerically stable vector norms
  • numerically stable quadratic formula
• polynomial interpolation
  • Vandermonde matrix + monomial basis
  • Lagrange Basis
  • Newton Basis

Important Results / Claims

• near-singular matrix problem

Questions

Interesting Factoids

• “optimization is a wrong way to train a neural network” (because you can’t hope to sample a trajectory in \(\mathbb{R}^{n}\) at large \(n\))