Dictionary AI Technology
Inference cost
What it means
The ongoing cost of running a model per use. Tiny per request, but at millions of users per day it becomes the AI company's biggest bill.
An everyday example
A car after purchase: buying it (training) happened once; fuel for every single trip (inference) is what drains your wallet forever.