• If you would like to get your account Verified, read this thread
  • The TMF is sponsored by Clips4sale - By supporting them, you're supporting us.
  • Reminder - We have a ZERO TOLERANCE policy regarding content involving minors, regardless of intent. Any content containing minors will result in an immediate ban. If you see any such content, please report it using the "report" button on the bottom left of the post.
  • >>> If you cannot get into your account email me at [email protected] <<<
    Don't forget to include your username

Running AI models locally on a Mac for writing stories

joptimus

Registered User
Joined
Mar 18, 2024
Messages
1
Points
1
Hi guys,

I've been using perchance AI story generator for a while and usually it's great. Sometimes when I accidentally close my browser, all non saved progress is lost. And also sometimes, generation is slow or won't happen at all.

Therefore I'd like to run these models locally. Any tips for software or LLM models? I'm on a Mac.
Thanks!
 
Ollama is going to be your best (only?) bet. It is going to be really slow and the models you’ll be able to run are going to be way shittier.

I would recommend just using openrouter (saves everything in cookies so you can’t do it in incognito). If you’re computer savvy then set up OpenWebUI and hook it up to openrouter and use that. I run an OpenWebUI container on my home server so I can easily access it. Everything is saved and it comes with account management out of the box too.
 
What's New
1/22/26
Stop by the TMF Links Forum, and see what is up on other tickling sites!

Door 44
Live Camgirls!
Live Camgirls
Streaming Videos
Pic of the Week
Pic of the Week
Congratulations to
*** brad1701 ***
The winner of our weekly Trivia, held every Sunday night at 11PM EST in our Chat Room
Top