Cost per task is the number to watch | nikvdp
A few months ago I wrote about “good enough” models, arguing that cheap models had gotten smart enough for most coding work, and that the expensive frontier models were best saved for the tasks that actually need them. That’s mostly played out as expected. Which leaves a new question: once you’re sure you don’t need the smartest model for a task, how do you find the cheapest one that’s still smart enough?
Topics: Models
Entities: Models