Translation quality of self hosted models

[Som-anon]

So since I (again) created an issue #284 and listed as reason for the timeout problem my workflow using my laptop (32GB ram no GPU) I thought I would contribute something small that I've been missing up until now. A list of models and a preview of how they perform.

I myself have a hand full of models and I know for which language I should use what, but I haven't found actually good resources online that give a list of local models you can use for translation.
Since I'm a bit tired right now (I feel every word fighting against me while typing and I know it's probably hard follow my train of thought right now) I will start with a simple example.
This projects uses an excerpt of "The Walking Practice"(보행 연습) by Dolki Min(돌기민) as an example why language models are great for translation and I threw for testing the same passage through a few of my local models. Prompt is always the same "Translate this:" and then the text. I won't comment on the results. I think it's best if everybody forms their own opinion. Note that this is just one excerpt and maybe does not represent the ability of the model faithfully. (one shot for everything)

Here are the results
Qwen3-30B-A3B-128K-UD-Q6_K_XL.gguf (unsloth)
35 seconds

I'm on the way to that place by subway. I'm sitting quietly in my seat. I'm so lucky. I'm so happy I might start crying.
Being squeezed among a crowd of people like bees, hanging onto the handlebars, I feel nauseating no matter how I look at it.
On days when I'm feeling this unwell, it's even harder to keep my balance with just my two legs.
Still, the subway is much better than the bus. On the bus, not falling over is a miracle. The bus locks me in a cage and shakes me around recklessly.

Mistral-Small-3.1-24B-Instruct-2503-UD-Q6_K_XL.gguf (unsloth)
133 seconds

I am on my way there by subway. I am sitting quietly in my seat. I don't know how lucky I am. I might shed a tear of joy.
Being among the swarming crowds, hanging onto the handrails, is disgusting no matter how you look at it.
On days like today, when my condition is poor, it's even harder to maintain my balance on two legs.
Still, the subway is much better than the bus. Not falling on the bus is a miracle. The bus locks me in a cage and shakes me around recklessly.

kakaocorp.kanana-1.5-8b-instruct-2505.Q6_K.gguf (DevQuasar)
48 seconds

I'm on my way there by subway right now. I'm sitting quietly in my seat—what a relief! I'm so happy I could almost tear up.
Being packed in among all those people, swinging from the handrail as I'm carried along, is disgusting no matter how I look at it.
On days when I'm feeling this unwell, it's even harder to keep my balance on my own two feet.
Still, the subway is way better than a bus. On a bus, not falling over feels like a miracle. The bus just cages me in and shakes me around roughly.

aya-23-35B-IQ4_XS.gguf
It took more than half an hour to generate this and I wasn't impressed by the result. Maybe some time in the future I will check what went wrong here (actually get the right parameter and maybe a better gguf)

I'm taking the subway to get there. I'm sitting calmly in my seat. I can't tell you how relieved I am. I'm so happy that I might cry.
It's much better than being packed like a sardine, hanging onto the handrail as the train rocks back and forth.
On days when I'm feeling this low, it's even harder to keep my

gemma-3-27b-it-UD-Q6_K_XL.gguf (unsloth)
600s half that time was spend on a useless explanation, because my prompt was too simple.

I'm heading there by subway right now. I'm sitting quietly in my seat. I can't tell you how relieved I am. I'm so happy I feel like I might tear up a little.
Being jostled around amongst a swarm of people, clinging to the handrail like a dangling object… even trying to think positively about it, it’s just disgusting, you know?
On days when I'm feeling this unwell, it's even harder to maintain my balance on my own two feet.
Still, the subway is much better than the bus. On the bus, just not falling is a miracle. The bus feels like it locks me in a cage and shakes me around relentlessly.

aya-expanse-32b-Q6_K_L.gguf (bartowski)

TBD

I got those models as well, but I was using the official playground for those translations, because I got lazy. I will maybe later update it with the actual quant, translation and time.
command a

I'm on the subway, heading there. I'm sitting quietly in my seat. I don't know how fortunate I am. I'm so happy I might shed a tear.
Being crammed among swarms of people like a bee hive, dangling from the handrail as I'm carried along—no matter how positively I think about it, it's disgusting.
On days like today when my condition is low, it's even harder to maintain balance on just two legs.
Still, the subway is much better than the bus. On the bus, not falling over is a miracle. The bus traps me in a cage and shakes me around recklessly.

command r plus

I'm on my way there by subway. I'm sitting quietly in my seat, and I can't tell you how relieved I am. I'm so happy I could cry.
Being crammed among a swarm of people, hanging onto the handrails for dear life, is disgusting no matter how you look at it.
On days like today when I'm not feeling my best, it's even harder to keep my balance on just two legs.
Still, the subway is much better than the bus. Staying upright on a bus is a miracle. Buses enclose me in a cage and shake me around mercilessly.

aya expanse 32b

I'm on the subway on my way there. I'm sitting quietly in my seat. I feel so lucky! I'm so happy I could cry.
Being squeezed among a swarming mass of people, hanging onto the strap like a bunch of grapes, is never a pleasant experience, no matter how you look at it.
On days like today when I'm feeling off, it's even harder to keep my balance just using my two legs.
Still, the subway is much better than the bus. It's a miracle I don't fall over on the bus. The bus confines me within its metal cage and shakes me mercilessly.