Incomplete output running locally on low spec hardware

[TudorDuca]

Hello there,

This is my first time posting here, but keeping it short: I'm having issues with fabric's outputs and I don't know if it's because of my hardware or some installation problem.

I also haven't tried with models that run on the cloud (I'm trying to use this for free). But I have tested neus-hermes2, llama3.1, gemma2 and other models with different patterns and they all finish abruptly, usually like 1-3 lines of output.

I'd appreciate any help you can provide me.