Qwen model lineage (mlx_lm.models.qwen2)

[uogbuji]

Notes, considerations, etc. around models derived from the Qwen foundation model.

[uogbuji]

Arcee-Agent-8bit got confused with the Usain Bolt example.

❯ python test/quick_check.py mlx-community/Arcee-Agent-8bit
Model type: qwen2
<|im_start|>assistant
Hello! As an AI, I don't have feelings, but I'm here and ready to assist you with any questions or tasks you have. How can I help you today?
 ======================================== Country extraction
<|im_start|>assistant
[{"name": "Nigeria", "continent": "Africa"}]
 ======================================== Square root of 256, pt 1
⚙️ Calling tool square_root with args {'square': 256}
⚙️ Tool call result: 16.0
<|endoftext|>Human beings have been using numbers for thousands of years. The earliest known evidence of the use of numbers dates back to the ancient Sumerians, who developed a system of counting using tokens and clay tablets around 3400 BC. This system was later refined by the Babylonians, who developed a sexagesimal (base-60) number system that is still used today in measuring time and angles.

The ancient Egyptians also developed a system of numerals, which they used for trade, construction, and other purposes. They used hieroglyphs to represent numbers, and their system was based on powers of 10
 ======================================== Square root of 256, pt 2
⚙️ Calling tool square_root with args {'square': 256}
⚙️ Tool call result: 16.0
<|endoftext|>Human beings have been using numbers for thousands of years. They are an essential part of our daily lives, from counting objects to measuring distances and time. One of the most fundamental concepts in mathematics is the square root. In this article, we will explore what the square root of 256 is and how it is calculated.

## What is the Square Root of 256?

The square root of 256 is the number that, when multiplied by itself, gives the result of 256. In mathematical notation, this is represented as:

√256 = x

where x is the square root
 ======================================== Usain bolt
⚙️ Calling tool calculator with args {'expr': '9.58 * 100 / 1000'}
⚙️ Tool call result: 0.958
To calculate Usain Bolt's average velocity, we need to know the distance he covered and the time it took him to cover that distance. In this case, the distance is 100 meters and the time is 9.58 seconds.

Average velocity is defined as the displacement (change in position) divided by the time taken. Since Usain Bolt ran a straight 100m race, his displacement is equal to the distance he covered, which is 100 meters.

So, his average velocity (v) can be calculated as:

v = displacement / time
v = 100 meters /
 ======================================== END CHECK

[uogbuji]

Followed the buzz & tried Qwen2.5-Coder-32B-4bit, and it works OK for the "nigeria" data extraction example and the square root of 256 example, but on Usain Bolt it gets confused right after 🔧 Calling tool calculator with args {'expr': '100/9.58'} and spirals into a loop of roughly coherent response that's repeated until curtailed for length.

This sounds like a problem I've seen reported with it, so there might be tokenization fixes on the way to address this soon.