https://rizkynotes.com/en/tags/llm/Recent content in Llm on Rizky Note'sHugoen-USFri, 06 Nov 2026 16:00:00 +0700https://rizkynotes.com/en/posts/understanding-tokens-in-llms/Fri, 06 Nov 2026 16:00:00 +0700https://rizkynotes.com/en/posts/understanding-tokens-in-llms/<h5 id="photo-by-egor-komarov-on-unsplash">Photo by <a href="https://unsplash.com/@egorkomarov?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText">Egor Komarov</a> on <a href="https://unsplash.com/photos/abstract-glitch-art-with-pink-and-black-patterns-uWH8siGaGck?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText">Unsplash</a></h5> <p>The word <em>token</em> comes up all the time these days, especially if you use AI in your daily work. But a lot of us don&rsquo;t really know what a <em>token</em> actually is. What are tokens used for when an AI processes our prompt? And behind all that AI <em>magic</em>, how are tokens counted, and why do we keep running into those &ldquo;you&rsquo;ve reached your limit&rdquo; warnings?</p>