Skip to main content
Collectible Avatar background card tirtha_s u/tirtha_s avatar

tirtha_s

u/tirtha_s

Feed options
Hot
New
Top
View
Card
Compact

Cool, will read this. Thanks for sharing bro.


Red flag indeed.


The other game looks appealing until you start playing it.


This is a game.

It has both costs and rewards.

You are getting rewarded hence you are still playing even when you are tired of it.

And you love that reward so much.


It is, I am focusing on finding existing pattern solutions from trad engg principles that can be mapped into the existing LLM Stack challenges.


How would you design prefix caching if you treated KV cache like a buffer pool ?

What Databases Knew All Along About LLM Serving

For a moment, lets imagine it does spit out the perfect binary, can you imagine the output token cost ? You would actually need to be a billionaire to use stuff like that. Here people are trying to learn chinese kanji characters, cause some say they require lesser tokens than English, binaries are counter intuitive cost wise as well.