昨天拿 mlx_lm.server 和 litellm 加了几个 hack 让这个能跑起来给 codex 当后端. 不过 24G 的 M3 跑起来体验很差, 出 token 很慢, 中间等着无聊去找人聊天, 回来发现电脑完全卡死. 目前离日常编程使用还有一定距离.
即使不当做日常编程使用, 我问母鸡为什么要过马路, 也花了近十分钟才告诉我答案.
```
{~/vllm}grep -i wait resp
* *Wait, let's recall the specific Chinese version:* There isn't one single "standard" joke like "Why did the chicken cross the road?" in English. However, there are common humorous responses used in Chinese internet culture or casual conversation.
* *Option 8 (Wait, is there a specific pun?)* Let's think about "Hen" (鸡). "Ji" (Chicken) sounds like "Ji" (Machine/Record/Instant).
* *Wait, let's look for the most "standard" humorous response.*
* *Wait, I recall a specific pun:*
* *Wait, there's a specific meme:* "因为它是**去相亲**。" (Because it's going on a blind date.)
* *Wait, one more possibility:* Is this a reference to a specific movie or song?
*Wait, I found a specific "Cold Joke" database entry:*
*(Self-Correction during drafting)*: Wait, there is a specific joke where the answer is "Because it's a **Hen** (Mu Ji), not a **Rooster** (Gong Ji)." No, that doesn't make sense.
*Wait, one more check:* Is there a specific meme involving "Hen crossing the road"?
*Wait, I want to make sure I don't sound like a search engine.* I should sound conversational.
*Wait, is there a deeper meaning?* No, just a joke.
*Wait, is there a political metaphor?* Sometimes "Crossing the road" implies risk. But for a hen, it's usually just a joke.
*Wait, is there a reference to the game "Egg Dash"?* No.
*Wait, one more thing:* There is a joke: "因为它是**去** **相亲** **。**" (Because it's going on a blind date.) This is very cute. I'll include this.
*Wait, I need to check if there is a specific "Standard Answer" in China.*
*Wait, I found a very popular one:*
*(Wait, one last thought)*: Is there a reference to the song "Why Does the Hen Cross the Road"?
*Wait, I recall a specific joke:*
*Wait, is there a chance the user is testing my ability to detect "nonsense questions"?*
{~/vllm}grep -ic wait resp
19
```
人在澳大利亚, 随手测试了几个源, 访问起来没有任何问题, 感谢!
几个月后回头看这个帖子, 感触良多, dsh 很厉害, 很喜欢!