Acamon@lemmy.world to No Stupid Questions@lemmy.world · 1 year agoDo any languages have words for left & right that start with the same letter?message-squaremessage-square53fedilinkarrow-up1115arrow-down12file-text
arrow-up1113arrow-down1message-squareDo any languages have words for left & right that start with the same letter?Acamon@lemmy.world to No Stupid Questions@lemmy.world · 1 year agomessage-square53fedilinkfile-text
minus-squarenandeEbisu@lemmy.worldlinkfedilinkarrow-up1·1 year agoThey don't process words as unified tokens for something like an LLM, but they do process them as multi-letter encoding, like byte-pair encoding or more advanced techniques.
They don't process words as unified tokens for something like an LLM, but they do process them as multi-letter encoding, like byte-pair encoding or more advanced techniques.