sanitation@lemmy.todayBanned from community to Technology@lemmy.worldEnglish · 3 months agoCompanies Are Throttling Employees’ AI Use Because It’s Too Expensivewww.404media.coexternal-linkmessage-square143linkfedilinkarrow-up1613arrow-down15cross-posted to: news@lemmy.world
arrow-up1608arrow-down1external-linkCompanies Are Throttling Employees’ AI Use Because It’s Too Expensivewww.404media.cosanitation@lemmy.todayBanned from community to Technology@lemmy.worldEnglish · 3 months agomessage-square143linkfedilinkcross-posted to: news@lemmy.world
minus-squarehubobes@sh.itjust.workslinkfedilinkEnglisharrow-up10·3 months agoThat doesn’t make much sense. When Anthropic moved to Sonnet 5 they introduced a new tokenizer which increased token use up to 35%. If these would be unrelated kinds of tokens why would the usage go up when the process of tokenization changes?
That doesn’t make much sense. When Anthropic moved to Sonnet 5 they introduced a new tokenizer which increased token use up to 35%. If these would be unrelated kinds of tokens why would the usage go up when the process of tokenization changes?