DataRobot MLOps Governance Capabilities

March 2, 2021
by
· 2 min read

This post was originally part of the DataRobot Community. Visit now to browse discussions and ask questions about DataRobot, AI Cloud, data science, and more.

MLOps governance provides your organization with a rights-management framework for your model development workflow and process.

With this feature, specified users are designated to review and approve events related to your deployments. The types of controllable events include creating or deleting deployments, and replacing the underlying model in a deployment.

Fig 11 1

Figure 1. Deployment that needs approval (governance applied)

With governance approval workflow enabled, before you deploy a model you’re prompted to assign an importance level to it: Critical, High, Moderate, or Low. The importance level helps you prioritize your deployments and the way you manage them. How you set importance for a deployment is going to be based on the factors that drive the business value for where and how you’re applying the model. Typically this reflects a collection of these factors, such as the amount of prediction volume, the potential financial impact, or any regulatory exposure.

Fig 2

Figure 2. Importance levels for deployments

Once the deployment is created, reviewers are alerted via email that it requires review. Reviewers are users who are assigned the role of an MLOps deployment administrator; approving deployments is one of their primary functions. While awaiting review, the deployment will be flagged as “NEEDS APPROVAL” in the Deployment dashboard. When reviewers access a deployment that needs approval, they will see a notification and be prompted to begin the review process.

Fig 31

Figure 3. Deployment “Needs Approval”

The reviewer clicks Add Review to see a summary of the deployment, and provide comments for the approval decision. They can click to approve the event or to request updates. If approved, the notification banner is removed, or if Request updates is selected, the banner remains but indicates a change is pending.

Fig 41

Figure 4. Reviewing a deployment—approve or request updates

In either case, DataRobot keeps track of the full history of all change events for a deployment, and the trail of events is displayed to show who changed what and when, and who approved the changes.

Fig 51

Figure 5. Approval activity for a deployment

More Information

DataRobot Public Documentation > Governance

WHITE PAPER
What Risk Managers Need to Know About AI Governance
Download now
About the author
Linda Haviland
Linda Haviland

Community Manager

Meet Linda Haviland
  • Listen to the blog
     
  • Share this post