Data Science #14 - The original k-means algorithm paper review (1957)

At the 14th episode we go over the Stuart Lloyd's 1957 paper, "Least Squares Quantization in PCM," (which was published only at 1982)

The k-means algorithm can be traced back to this paper.

Loyd introduces an approach to quantization in pulse-code modulation (PCM). Which is like a 1-D k means clustering.

Lloyd discusses how quantization intervals and corresponding quantum values should be adjusted based on signal amplitude distributions to minimize noise, improving efficiency in PCM systems.

He derives an optimization framework that minimizes quantization noise under finite quantization…