feed/tags/fundamentals
fundamentals
4 glossary terms, and one reading ordered as a path, each with one line on why it earns your time.
glossary/ 4 terms
- Roofline model
A chart with arithmetic intensity on the x axis and attainable performance on the y, bounded by a sloped line from memory bandwidth and a flat line from peak compute.
- Arithmetic intensity
Floating-point operations performed per byte moved from memory.
- Ridge point
The arithmetic intensity at which a machine's memory ceiling and compute ceiling meet: peak FLOPS divided by bandwidth.
- OpenAI-compatible API
The HTTP interface every serving engine exposes: chat completions with a list of messages, streaming over server-sent events, the same request and response shapes OpenAI defined.
beginner/ 1 entry
Start here. No serving experience assumed.