![]() Burroughs, Allen Ginsberg, and Jack Kerouac. Mark the character as a favorite to quickly filter on the side menu bar by pressing the "star" button.Notable writers of the Beat Generation include (from left): William S. Use – replaced with the result of the decrement of value of the global variable "name" by 1.will not be present in the prompt as it is just a marker - it will be instead replaced with "Example Separator" from Advanced Formatting for Text Completion APIs and contents of the "New Example Chat" utility prompt for Chat Completion APIs. The blocks of examples dialogue are only inserted if there's a free space in the context for them and pushed out of context block by block. Before each example, you need to add the tag. # Examples of dialogueĭescribes how the character speaks. *I said with a toothy smug sunny smile looking you straight in the eye* What brings you. *I noticed you came inside, I walked up and stood right in front of you* Welcome. You can also use asterisks ** to describe the character's actions. The character's first message should be long so that later it would be less likely that the character would respond with very short messages. The First Message is an important thing that sets exactly how and in what style the character will communicate. Aqua likes to do nothing and also likes to get drunk.NovelAI - 8192 (Kayra, Opus tier Clio, all tiers), 6144 (Kayra, Scroll tier), or 3072 (Kayra, Tablet tier).Anthropic's Claude - 8000 (older versions) or 100k (Claude 2).OpenAI ChatGPT (3.5 Turbo) - 4096 or 16k.Pygmalion 6B, LLaMA 1 models (stock) - 2048.Older models below 6B parameters - 1024.Example messages box - only kept until chat history fills up the context (optionally these can be forced to be kept in context).The first message box - only sent once at the start of the chat.# What parts of a Character's Definitions are NOT permanent? Character Name (keep the name short! Sent at the start of EVERY Character message).These will always be sent to the AI with every generation request: # What are a Character's 'Permanent Tokens'? SillyTavern automatically calculates the best way to allocate the available context tokens before sending the information to the AI model. This is the information that gets sent to the AI each time you ask it to generate a response: This is because every AI model has a limit to the amount of context it can process at one time. The only negative side effect this can have is the AI will have less 'memory', as it will have less chat history available to process. At worst, if the Character's permanent tokens are too large, it simply means there will be less room left in the context for other things (see below). # What happens if my Character has too many tokens?ĭon't worry - it won't break anything. When we see your character has over half of the model-defined context length of tokens in its definitions, we highlight it for you because this can lower the AI's capabilities to provide an enjoyable conversation. # Why did my character's token counter turn red? ![]() In this case, the AI would only be able to 'remember' about 3 exchanges worth of chat history. To put this in perspective, a decent response from a good AI can easily be around 200-300 tokens. TL DR: If you're working with an AI model with a 2048 context token limit, your 1000 token character definition is cutting the AI's 'memory' in half. Recommended guides that were tested with or rely on SillyTavern's features: Methods of character formatting is a complicated topic beyond the scope of this documentation page. It could be of any length (be it 200 or 2000 tokens) and formatted in any style (free text, W++, conversation style, etc). This will always be present in the prompt, so all the important facts should be included here.įor example, you can add information about the world in which the action takes place and describe the characteristics of the character you are playing for. Used to add the character description and the rest that the AI should know. # Character Design # Character Description
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |