You are viewing a single comment's thread:
Well, I was finally successful in getting Qwen3.6 35B-A3B APEX IQuality to run using both ik_llama.cpp and llama-cpp-turboquant. Now I just need to tweak and refine the flags a bit more. A totally offline model is not feasible for me, as it needs to be able to do web searches and synthesis, and to connect and transact within multiple blockchain ecosystems, Hive included. 😁🙏💚✨🤙
!ALIVE
!BBH
!PIZZA
!PIXY
!UNICOIN
For those who prioritize security, such LLMs should be used on a separate computer (which may be expensive) or in a virtual machine (which will reduce its efficiency) !INDEED. 🤔🤯🤓
!WEIRD
!HOPE
!PIZZA
View more