Week 1 synthesis

Real samples reveal the data distribution indirectly. A generator turns random latent inputs into model samples. We want the model distribution to approach the real one, and f-divergences give mathematical comparisons. Convexity and convex conjugates transform divergence expressions into optimizations over functions, whose expectations can be estimated from samples.