Hi
Can I access the idx (from the tokenizer) of the next token some how?
Thanks!
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
|
CoT content for deepseek-r1-671b
|
0 | 21 | April 16, 2025 | |
| Tensor Book factory reset | 0 | 1878 | April 10, 2019 | |
| Tensorbook recovery iso download access - please | 1 | 73 | November 17, 2024 | |
|
Qwen 3 Models Support
|
0 | 45 | April 30, 2025 | |
| Did inference api change recently? | 0 | 84 | March 20, 2025 |