Help with resources for using LLMs as fictional characters
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Hey ya'll,
I'm an ex-cognitive scientist turned NLP Data Scientist by day, and science fiction author by night.
I want to bring fictional characters in my prose to life with Local LLMs, and I'm looking for the best resources out there for doing this kind of work (datasets, models, libraries, common patterns, etc.). Could you help me out?
For context, I recently got a 64GB Mac Mini for this and other Local LLM side-projects, and my work pays for about $750 USD of LLM API tokens for personal use per year I could use to create my own training data. I work with BERT & GPT-style models at work, and I've done some Local LLM work on my MacBook with >8B models (mostly just basic vector-database-based RAG for question-answering and summarization over PDFs). I also have detailed character notes for persona prompting as well as world-building notes for RAG-based pipelines.
I would like to go beyond persona prompting and RAG, though. I've been reading mechanistic interpretability / steering research for the last few months, and am very interested in using these methods to more precisely control character behavior and personality. So anything in this space specifically would be very appreciated.
Cheers!
TL;DR - Looking for for resources on using LLMs in fiction, specifically using LLMs as fictional characters/NPCs. Particularly interested in applying mechanistic interpretability / steering methods on top of persona prompting and RAG.
[link] [comments]
More from r/LocalLLaMA
-
Been running Qwen3.6-27B through a 3-critic harness. The harness matters more than I thought
Jun 30
-
I Hate Dario Amodei, and everything he stands for.
Jun 29
-
Introducing LongCat-2.0 - , a large-scale MoE language model with 1.6 trillion total parameters and ~48 billion activated per token. This was the stealth model that was on Openrouter under the name 'owl-alpha'.
Jun 29
-
Krea-2-Turbo Image Model - Easy to be fully uncensored, but it can also EDIT Images!
Jun 29
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.