zlacker

[parent] [thread] 2 comments
1. p0w3n3+(OP)[view] [source] 2026-01-11 14:23:22
I've checked and you get 36->30 tokens decreasal but no human readability. sounds like a poor trade
replies(1): >>goose0+WD2
2. goose0+WD2[view] [source] 2026-01-12 09:42:13
>>p0w3n3+(OP)
Looks like my tokenization review method was incorrect - honestly a little embarrassing on my part. I think it would have been a lot longer before I discovered it, so thanks for the comment!

I did just go through and ran equivalent code samples in the GlyphLang repo (vs the sample code I posted that I'm assuming you ran) through tiktoken and found slightly lower percentages, but still not insignificant: on average 35% fewer than Python and 56% fewer than Java. I've updated the README with the corrected figures and methodology if you want to check: https://github.com/GlyphLang/GlyphLang/blob/main/README.md#a...

replies(1): >>p0w3n3+tW5
◧◩
3. p0w3n3+tW5[view] [source] [discussion] 2026-01-13 09:25:32
>>goose0+WD2
Yeah Java IS verbose. Thanks!
[go to top]