v1.4.0

This release introduces several enhancements to improve tokenization workflows for LLMs:

New Features:

1. Map Tokens to String Values:

   • Added the mapTokens option to tokenize and count functions, allowing mapping of token IDs to their string values.
   • Introduced the standalone MapTokens function for independent token mapping.
   • Added mapTokens support to the CLI.

2. Default Model Update:

   • The default model for all functions and CLI operations is now "gpt-4o".

3. CLI Enhancements:

   • Added an --output option to save results to a JSON file.
   • Introduced colored logging for better visibility of CLI outputs.

4. Expanded Model and Encoding Support:

   • Added support for more models and encodings, ensuring compatibility with a wider range of LLMs.

For questions or feedback, feel free to open an issue.