[ENH]: Add Feature to Mark User Content with Unique Markers in Prompts

[dbosco]

Contact Details

No response

Feature Description

Implement a feature where user content in prompts can be demarcated using unique markers. These markers will be unique strings embedded before and after the user-entered prompt to help accurately identify and scan only user input. The markers will be shared securely between the GenAI applications and the prompt template encapsulating the user prompt. Each GenAI application should have its own unique marker, which the Plugin library can provide at runtime.

Acceptance Criteria:

1. Markers:

   • Markers should be securely generated and configurable for each GenAI application.
   • The Plugin library should provide the unique marker for the application at runtime.
   • Ensure that markers are embedded before and after the user-entered prompt, encapsulating the prompt in a defined format (e.g., [MARKER_START_12345] user prompt content [MARKER_END_12345]).

2. Secure Marker Sharing:

   • Implement secure sharing of markers between the GenAI application and prompt templates to avoid exposure of the markers to unintended sources.
   • Ensure the markers are generated and passed in a secure, encrypted manner to protect sensitive data.

3. Customizable Markers:

   • Provide options for administrators to define or override the default marker generation process if required by specific use cases.
   • Allow configuration of marker format and length to meet security and operational needs.

4. Integration with Prompt Templates:

   • Ensure that prompt templates are modified to recognize and handle the markers for encapsulating user prompts.
   • The GenAI applications must correctly insert and interpret markers during prompt processing.

5. Documentation:

   • Provide documentation explaining:
     • How the marker system works.
     • How unique markers are generated and assigned to each GenAI application.
     • How to configure or customize marker settings.
     • Best practices for ensuring secure marker sharing between applications.

Code of Conduct

• I agree to follow this project's Code of Conduct