None
NL
On Prompt Engineering
['Ben Congdon']
Ben Congdon
Anthropic’s Constitutional AI paper introduces a new usage of prompt engineering: in steering the top-level behavior of the model, by including specific prompts as “constitutional principles” during its fine-tuning training. In any case, this is a more advanced form of “prompt engineering” – we’re not just massaging a single prompt within a single session of the LLM, we’re now using prompts within the fine-tuning process of the LLM. The LLM now includes our engineered prompts within it (in a sense), and all future outputs will be influenced by those “principle” prompts.