Running AI on the edge could push inferencing (and training) costs to the user.
Hosted AI Model
Local AI Model
Inferencing Cost
With the release of Web GPU for major browsers, even some large models can be run "on the edge" (e.g. Stable Diffusion and Meta's LlaMA). As hardware improves and models become more efficient, some of the inferencing and finetuning will be done on device and thus reducing cloud costs.
21 Heartcore Capital – AI & Productivity Report
heartcore.com