Good point , i don't know how to calculate that. Any pointers for me to learn more ?

You forgot to add the space for the KV-Caches, which can get extremely large for the new…
71
2
Andreas Kunar
Karan Singh
·Follow
Sep 12, 2024
--
Good point , i don't know how to calculate that. Any pointers for me to learn more ?
--
--
Written by Karan Singh307 Followers
·14 Following
Co-Founder & CTO @ Scogo AI ♦ I Love to solve problems using Tech
No responses yet
Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams