That’s pretty interesting. And I totally agree with your last part. One counterpoint I would have is that local models are often more efficient though, and there’s very little checking you can do on how much your query actually costs in the cloud, while using it at home you can monitor your GPU usage and your power bill, and that information creates a sense of responsibility if you overuse it, like the amount of gas station stops a 10 hour joyride would require. But yeah at the end of the day using it as little as possible is a good habit.
That’s pretty interesting. And I totally agree with your last part. One counterpoint I would have is that local models are often more efficient though, and there’s very little checking you can do on how much your query actually costs in the cloud, while using it at home you can monitor your GPU usage and your power bill, and that information creates a sense of responsibility if you overuse it, like the amount of gas station stops a 10 hour joyride would require. But yeah at the end of the day using it as little as possible is a good habit.