pythonofftopic | Unsorted

Telegram-канал pythonofftopic - Offtopic

12466

Offtopic group for casual talking about anything. @rules_for_python still apply (except for the ontopic rule)

Subscribe to a channel

Offtopic

That’s how we are. Makes sense totally

Читать полностью…

Offtopic

My computer crashed today. I was lucky enough to have been able to open htop before it stopped reacting completely.

Читать полностью…

Offtopic

To understand repo. It’s like complaints of diminishing returns is being improved

Читать полностью…

Offtopic

And cause it’s due to caching.

Читать полностью…

Offtopic

I’ve seen significant less token usage by Claude cli. Extension is useless.

Читать полностью…

Offtopic

Comparing Opus with GPT-5 isn't a fair comparison.

Читать полностью…

Offtopic

Token efficiency matters for cost. Independent testing found Claude Code uses 5.5x fewer tokens than Cursor for identical tasks. Claude Code (Opus) completed a benchmark task with 33K tokens and no errors. The Cursor agent (GPT-5) used 188K tokens and hit errors along the way. Fewer tokens means lower per-task cost even at higher subscription prices.

https://www.builder.io/blog/cursor-vs-claude-code

Читать полностью…

Offtopic

Claude models are good at coding so they gatekeep. No wonder. Their claims

Читать полностью…

Offtopic

It does not seem to be the case for vscode.

Читать полностью…

Offtopic

That is surely true... worst part is if you "switch" in the middle, God it eats up all your tokens... but 90% of the time I'm using Kimi 2.5...

Читать полностью…

Offtopic

I'm not sure if it's still true, but cursor was using 5 times more tokens for the same task than the CLI.

Читать полностью…

Offtopic

There’s some sauce everywhere. I need that sauce

Читать полностью…

Offtopic

Though, it seems to be more efficient with tokens than Cursor IDE is.

Читать полностью…

Offtopic

Thank you for the feedback!

Читать полностью…

Offtopic

@space_soup may I ask for your opinion

Читать полностью…

Offtopic

All cores were fully busy, but that was a side effect of the memory being full. As if was doing something special. But somehow I managed to get it full.

Читать полностью…

Offtopic

100%, there is something called Caching. When you first talk to the LLM, it needs to know everything about your project.

The context window size doesn't change when you change the model, but most of the context for the first LLM is already cached on the server. When the next LLM is called, the whole thing has to be sent again, and the LLM has to know the proper context.

This is why you see that the amount of tokens used for the newer model is much higher.

Читать полностью…

Offtopic

Maybe fair amount of token gets burned in the beginning

Читать полностью…

Offtopic

Or to say it politely, doesn’t work for me.

Читать полностью…

Offtopic

They should have compared Claude Code CLI with Claude Code in Cursor.

Читать полностью…

Offtopic

I see. And that makes sense.

Читать полностью…

Offtopic

No, not really... if you switch from one model to another, you have to send that new model all the context, while if you stick with a single model, it uses loads of cache.

Читать полностью…

Offtopic

I mean there's an overhead I'd assume, but it's not 5 times as much.

Читать полностью…

Offtopic

That’s for monopoly reasons.

Читать полностью…

Offtopic

They know how to talk to their servers best.

Читать полностью…

Offtopic

It is, but the advantage with the cursor is that I can use almost any model in the world, switch to Opus when I really need to.

Читать полностью…

Offtopic

Their model best work with cli.

Читать полностью…

Offtopic

They wrote a TUI because it is lightweight and can be compiled for anything, including server-side Linux.

It is nothing special at all... even LLM itself is simple, if you see the code, it is not something complex at all, the problem is DATA...

Читать полностью…

Offtopic

I bow thee black coffee

Читать полностью…

Offtopic

Python (the snake) does not actully use poison.
It strangles the victim crushing lungs and other bones in the proccess...

Читать полностью…
Subscribe to a channel