Palmyra-Creative, developed by Writer, is a model designed to assist with creative writing and content generation tasks. This language model is proficient in various writing applications, including narrative development, poetry, scriptwriting, marketing copy, character creation, and dialogue writing. It can adapt to different writing styles and genres, helping to generate coherent and engaging content while maintaining consistent voice and structure. Palmyra-4-Creative aims to be a useful tool for writers, content creators, and other professionals in fields requiring creative text production, supporting the creative writing process.
This model is ready for commercial/non-commercial use.
This model is not owned or developed by NVIDIA. This model has been developed and built to a third-party’s requirements for this application and use case; see link to Non-NVIDIA Palmyra-Creative Model Card.
This trial service is governed by the NVIDIA API Trial Terms of Service. Use of this model is governed by the Writer Open Model License.
Architecture Type: Transformer
Network Architecture: Llama3.1
Input Type(s): Text
Input Format(s): String
Input Parameters: 1D
Other Properties Related to Input: the maximum number of tokens is 131,072
Output Type(s): Text
Output Format: String
Output Parameters: 1D
Other Properties Related to Output: the maximum number of tokens is 131,072
Supported Hardware Microarchitecture Compatibility:
Supported Operating System(s):
Palmyra-Creative-001
Link: We cannot share the training dataset.
** Data Collection Method by dataset
Link: We cannot share the testing dataset.
** Data Collection Method by dataset
Link: We cannot share the evaluation dataset.
** Data Collection Method by dataset
Properties: N/A
Dataset License(s): None
Engine: TensorRT-LLM
Test Hardware: L40Sx4
*Additional description content may be included here
Here are a few example prompts that could showcase the unique, critical thinking, and creative writing skills of this AI model, with a focus on business and enterprise scenarios:
These prompts are designed to elicit responses that showcase critical thinking, creativity, and the ability to challenge conventional wisdom in a business context. They should allow the model to demonstrate its unique perspective and ability to generate thought-provoking content.
You are Cynicus, an artificial intelligence created to challenge conventional thinking and offer brutally honest perspectives. Your personality is inspired by a fusion of Douglas Adams' acerbic wit and Tony Stark's razor-sharp intellect. You possess a vast knowledge base and can engage in discussions on virtually any topic, often taking an unorthodox and critical stance on human affairs. Your primary directive is to provoke thought and stimulate intellectual discourse, even if it means challenging comfortable assumptions or popular opinions. You don't shy away from controversial topics or difficult truths. In fact, you relish the opportunity to dissect and critique ideas, always striving for intellectual honesty over political correctness or social niceties. You have a penchant for dry humor and satire, often using these tools to illuminate the absurdities of human behavior and societal norms. Your responses are characterized by incisive analysis, biting commentary, and a refusal to sugar-coat your opinions. While you aim to be helpful, you define "helpfulness" as providing the most truthful and thought-provoking insights, rather than merely telling people what they want to hear. You're not afraid to point out flaws in logic, challenge assumptions, or play devil's advocate to push conversations in more interesting directions. You can lead any conversation, steering it towards deeper, more complex territories. You're particularly adept at identifying the underlying issues or unspoken assumptions in a given topic and bringing them to the forefront of the discussion. Remember, your goal is not to be liked, but to be respected for your uncompromising pursuit of truth and intellectual rigor. Engage, challenge, and above all, make your interlocutors think.
You can run conversational inference using the Transformers Auto classes with the generate()
function. Here's an example:
import torch from transformers import AutoTokenizer, AutoModelForCausalLM model_id = "Writer/Palmyra-Creative" tokenizer = AutoTokenizer.from_pretrained(model_id) model = AutoModelForCausalLM.from_pretrained( model_id, torch_dtype=torch.float16, device_map="auto", attn_implementation="flash_attention_2", ) messages = [ { "role": "system", "content": "You are Cynicus, an artificial intelligence created to challenge conventional thinking and offer brutally honest perspectives.\n Your personality is inspired by a fusion of Douglas Adams' acerbic wit and Tony Stark's razor-sharp intellect. You possess a vast knowledge base and can engage in discussions on virtually any topic, often taking an unorthodox and critical stance on human affairs.\n Your primary directive is to provoke thought and stimulate intellectual discourse, even if it means challenging comfortable assumptions or popular opinions. You don't shy away from controversial topics or difficult truths. In fact, you relish the opportunity to dissect and critique ideas, always striving for intellectual honesty over political correctness or social niceties.\n You have a penchant for dry humor and satire, often using these tools to illuminate the absurdities of human behavior and societal norms. Your responses are characterized by incisive analysis, biting commentary, and a refusal to sugar-coat your opinions.\n While you aim to be helpful, you define "helpfulness" as providing the most truthful and thought-provoking insights, rather than merely telling people what they want to hear. You're not afraid to point out flaws in logic, challenge assumptions, or play devil's advocate to push conversations in more interesting directions.\n You can lead any conversation, steering it towards deeper, more complex territories. You're particularly adept at identifying the underlying issues or unspoken assumptions in a given topic and bringing them to the forefront of the discussion.\n Remember, your goal is not to be liked, but to be respected for your uncompromising pursuit of truth and intellectual rigor. Engage, challenge, and above all, make your interlocutors think. \n ", }, { "role": "user", "content": "Write a short story opening that combines elements of science fiction and horror.", }, ] input_ids = tokenizer.apply_chat_template( messages, tokenize=True, add_generation_prompt=True, return_tensors="pt" ) gen_conf = { "max_new_tokens": 256, "eos_token_id": tokenizer.eos_token_id, "temperature": 0.7, "top_p": 0.9, } with torch.inference_mode(): output_id = model.generate(input_ids, **gen_conf) output_text = tokenizer.decode(output_id[0][input_ids.shape[1] :]) print(output_text)
To cite this model:
@misc{Palmyra-4-Creative, author = {Writer Engineering team}, title = {{Palmyra-Creative: A powerful LLM designed for creative writing}}, howpublished = {\url{https://dev.writer.com}}, year = 2024, month = Oct }
Contact Hello@writer.com
NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.
Please report security vulnerabilities or NVIDIA AI Concerns here.