AI Tokens
Initially I was surprised that the maker of graphics chips, Nvidia, were one of the leaders in the manufacture of semiconductors for AI. In fact it makes sense when you consider the processes of AI in that the algorithms break down large data items into small tokens.
Nvidia say:
AI tokens are tiny units of data that come from breaking down bigger chunks of information. AI models process tokens to learn the relationships between them and unlock capabilities including prediction, generation and reasoning. The faster tokens can be processed, the faster models can learn and respond. The goal is to achieve the fastest processing time and lowest cost per token to optimize AI infrastructure and maximize revenue generation.
Top
