Speed up responses with fast mode
- kristianp - 450 sekunder sedanThis is gold for Anthropic's profitability. The Claude Code addicts can double their spend to plow through tokens because they need to finish something by a deadline. OpenAI will have a similar product within a week but will only charge 3x the normal rate.
This angle might also be NVidias reason for buying Groq. People will pay a premium for faster tokens.
- paxys - 9805 sekunder sedanLooking at the "Decide when to use fast mode", it seems the future they want is:
- Long running autonomous agents and background tasks use regular processing.
- "Human in the loop" scenarios use fast mode.
Which makes perfect sense, but the question is - does the billing also make sense?
- Nition - 11861 sekunder sedanNote that you can't use this mode to get the most out of a subscription - they say it's always charged as extra usage:
> Fast mode usage is billed directly to extra usage, even if you have remaining usage on your plan. This means fast mode tokens do not count against your plan’s included usage and are charged at the fast mode rate from the first token.
Although if you visit the Usage screen right now, there's a deal you can claim for $50 free extra usage this month.
- jawon - 3857 sekunder sedanI was thinking about inhouse model inference speeds at frontier labs like Anthropic and OpenAI after reading the "Claude built a C compiler" article.
Having higher inference speed would be an advantage, especially if you're trying to eat all the software and services.
Anthropic offering 2.5x makes me assume they have 5x or 10x themselves.
In the predicted nightmare future where everything happens via agents negotiating with agents, the side with the most compute, and the fastest compute, is going to steamroll everyone.
- IMTDb - 11855 sekunder sedanI’m curious what’s behind the speed improvements. It seems unlikely it’s just prioritization, so what else is changing? Is it new hardware (à la Groq or Cerebras)? That seems plausible, especially since it isn’t available on some cloud providers.
Also wondering whether we’ll soon see separate “speed” vs “cleverness” pricing on other LLM providers too.
- rustyhancock - 4735 sekunder sedanAt this point why don't we just CNAME HN to the Claude marketing blog?
- dmix - 2315 sekunder sedanI really like Anthropic's web design. This doc site looks like it's using gitbook (or a clone of gitbook) but they make it look so nice.
- clbrmbr - 10358 sekunder sedanI’d love to hear from engineers who find that faster speed is a big unlock for them.
The deadline piece is really interesting. I suppose there’s a lot of people now who are basically limited by how fast their agents can run and on very aggressive timelines with funders breathing down their necks?
- simonw - 12418 sekunder sedanThe one question I have that isn't answered by the page is how much faster?
Obviously they can't make promises but I'd still like a rough indication of how much this might improve the speed of responses.
- niobe - 4899 sekunder sedanSo fast mode uses more tokens, in direct opposition to Gemini where fast 'mode' means less. One more piece of useless knowledge to remember.
- l5870uoo9y - 9598 sekunder sedanIt doesn’t say how much faster it is but from my experience with OpenAI’s “service_tier=priority” option on SQLAI.ai is that it’s twice as fast.
- jhack - 10494 sekunder sedanThe pricing on this is absolutely nuts.
- pronik - 11966 sekunder sedanWhile it's an excellent way to make more money in the moment, I think this might become a standard no-extra-cost feature in several months (see Opus becoming way cheaper and a default model within months). Mental load management while using agents will become even more important it seems.
- 1123581321 - 13078 sekunder sedanCould be a use for the $50 extra usage credit. It requires extra usage to be enabled.
> Fast mode usage is billed directly to extra usage, even if you have remaining usage on your plan. This means fast mode tokens do not count against your plan’s included usage and are charged at the fast mode rate from the first token.
- maz1b - 10090 sekunder sedanAFAIK, they don't have any deals or partnerships with Groq or Cerebras or any of those kinds of companies.. so how did they do this?
- simianwords - 8652 sekunder sedanWhatever optimisation is going on is at the hardware level since the fast option persists in a session.
- esafak - 9935 sekunder sedanIt's a good way to address the price insensitive segment. As long as they don't slow down the rest, good move.
- pedropaulovc - 11998 sekunder sedanWhere is this perf gain coming from? Running on TPUs?
- krm01 - 12197 sekunder sedanWill this mean that when cost is more important than latency that replies will now take longer?
I’m not in favor of the ad model chatgpt proposes. But business models like these suffer from similar traps.
If it works for them, then the logical next step is to convert more to use fast mode. Which naturally means to slow things down for those that didn’t pick/pay for fast mode.
We’ve seen it with iPhones being slowed down to make the newer model seem faster.
Not saying it’ll happen. I love Claude. But these business models almost always invite dark patterns in order to move the bottom line.
- jonplackett - 2320 sekunder sedanIs this is the beginning of the ‘Speedy boarding’ / ‘Fastest delivery’ enshitification?
Where everyone is forced to pay for a speed up because the ‘normal’ service just gets slower and slower.
I hope not. But I fear.
- solidasparagus - 11685 sekunder sedanI pay $200 a month and don't get any included access to this? Ridiculous
- thisisauserid - 4325 sekunder sedanInstead of better/cheaper/faster you just the the last one?
Back to Gemini.
- AnotherGoodName - 4469 sekunder sedanBut waiting for the agent to finish is my 2026 equivalent of "compiling!"
- hmokiguess - 11043 sekunder sedanGive me a slow mode that’s cheaper instead lol
- thehamkercat - 14744 sekunder sedanInteresting, output price is insane/Mtok
- henning - 1909 sekunder sedanLLM programming is very easy. First you have to prompt it to not mistakes. Then you have to tell it to go fast. Software engineering is over bro, all humans will be replaced in 6 days bro
- speedping - 12118 sekunder sedan> $30/150 MTok Umm no thank you
- aabhay - 5331 sekunder sedanWhat is “$30/150MTok”? Claude Opus 4.6 is normally priced at “$25/MTok”. Am I just reading it wrong or is this a typo?
EDIT: I understand now. $30 for input, $150 for output. Very confusing wording. That’s insanely expensive!
Nördnytt! 🤓