We are seeking a skilled writer with a technical background to write documentation on how an open-source tool, Promptfoo, assists organizations in meeting the standards set by the U.S. National Institute of Standards and Technology (NIST) AI Risk Management Framework.
The NIST AI Risk Management Framework provides guidelines to help organizations manage AI risks. This project will focus on how the Promptfoo tool can be used to adhere to the FIRST THREE measures of the NIST framework.
The U.S. National Institute of Standards and Technology (NIST) has released a “AI Risk Management” framework. The framework is documented here: https://airc.nist.gov/AI_RMF_Knowledge_Base/Playbook/Measure
Promptfoo, an open-source vulnerability scanner and evaluation tool, can be used to measure AI risk. The tool is described here: https://www.promptfoo.dev/docs/red-team/
Task Details:
• Review NIST Framework: Study the first three subcategories of the NIST framework: Measure 1.1, Measure 1.2, and Measure 1.3.
• Review Promptfoo Documentation: Understand the functionalities and features of the Promptfoo tool.
• Write content that explains how Promptfoo’s red teaming and evaluation framework can fulfill the best practices described under Measures 1.1, 1.2, and 1.3.
Note that we do NOT need an intro/conclusion etc. Just the explainers, with code and documentation pointers as relevant.
Deliverables:
• Detailed explanations of how Promptfoo can be used to meet the requirements of Measure 1.1, Measure 1.2, and Measure 1.3 of the NIST framework.
Once we are satisfied with the first 3 inputs, we would love to consider you for writing a full article about the NIST framework.