You are viewing a single comment's thread:
RE: I Am #AliveAndThriving Today! || #IAmAliveChallenge || Daily Off-Grid Jungle Journal Entry: Day #1421 - Preparing to Run and Test Qwen3.6 35B A3B on 8GB of VRAM and 64GB RAM - Lower Puna, Far East Big Island, Hawai'i - Tuesday, June 9, 2026
Let's !HOPE that such LLM has less security risks over time !INDEED! 🤗😊 One way for a user to reduce such risks is to make the chatbot completely offline, though it would reduce the effectiveness of the model. 🤔🤯🤓
!WEIRD
!WINEX
0.00000000 CASHMAP
Well, I was finally successful in getting Qwen3.6 35B-A3B APEX IQuality to run using both ik_llama.cpp and llama-cpp-turboquant. Now I just need to tweak and refine the flags a bit more. A totally offline model is not feasible for me, as it needs to be able to do web searches and synthesis, and to connect and transact within multiple blockchain ecosystems, Hive included. 😁🙏💚✨🤙
!ALIVE
!BBH
!PIZZA
!PIXY
!UNICOIN
View more