I'm still leeching off the free tier, so it's going to be hard to beat the price.
But yes, I intend to support several models, to handle the overload situation (automatic failover). And switch to a cheap paid plan, though it seems like that'll mostly improve rate limits, which barely matters for my usage.
Faster is always good, though. I do care about latency.
> once I get the business going I'd likely begin to buy my own machines
only when it's cheaper than to continue renting it in your calculations
same goes for renting vs buying a house, or anything.
the breakeven point here would come when they stop subsidizing the subscriptions, or when local ai gets to run on basically everything, making it ~free (sans electricity)
if you care for some feedback about the writing, dropping the link and saying "PR's are open!" would land probably equal or better, and would reduce noise on the message. as sibling said, substance and noise
To be honest, my literal thought process initially when writing was:
- I think this is cool, I should probably open source this
- No wait, I'm again over planning, no one's gonna read this and the problem is probably too specific to me for anyone to care.
So I just mentioned "lets compare notes if anyone else trying".
Hence you can see from the comment above, I immediately realized I made a mistake when the parent asked for the Skill file. Should've had the link ready. Pleasant surprise.
and if it goes fast enough, it can fail and you can prompt again before you need to worry about if it's going in the wrong direction. or, it will try multiple directions!
anecdotally, a lot of argentina's apps that have a similar system "had" to develop an interop with brazil's PIX as a feature, ideally an endgame would be for these systems (wero, pix, other countries') to all standardize and integrate each other. would love something like that.
Didn't we get this with Harry Potter back in like gpt3.5? I'm sure I saw some news about it, someone getting it to output a book's intro word by word, couple pages?
The Neo's targetting a different market. The MacBook was a premium ultraportable product. If you were buying it, you were willing to make all kinds of sacrifices for a thin and light laptop. The Neo is a general purpose consumer laptop that just happens to be fairly small.