Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
dangerlibrary
6 months ago
|
parent
|
context
|
favorite
| on:
Probably pay attention to tokenizers
The point of the GP post is that the "w-4" token had very different results from ["w", "-4"] or similar algorithms where the "w" and "4" wound up in separate tokens.
Join us for
AI Startup School
this June 16-17 in San Francisco!
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: