Take the Route to AI Success with DataOps and MLOps
If you’ve been keeping up with business literature lately, you know that adopting artificial intelligence (AI) strategies can increase company revenue, improve efficiency, and keep customers happy. But even the best models cannot improve performance until they are put into production.
What are companies actually doing today?
Alexander Rode and Timm Grosser, analysts at the Business Application Research Center (BARC), decided to find out by surveying 248 companies from a variety of industries about this question.
The companies ranged in size from under 500 (35%) employees to 5000 (34%) or more. In terms of location, 66% were in Europe, 27% were in North America, and 6% were in Asia and the Pacific.
The survey asked companies how they used two overlapping types of tools to deploy analytical models:
- Data operations (DataOps) tools, which focus on creating a manageable, maintainable, automated flow of quality-assured data.
- Machine learning operations (MLOps) tools, which handle model retraining, testing, metrics tracking, versioning, and management.
Deploying Models Today
Developing models was clearly easier than deploying them. More than half the survey participants (55%) had not yet put a model into operation, while 37% had not even started building one.
Reducing Deployment Challenges
Delivering well-managed, high-performing models is a high-stress task. It requires companies to build on prior work, identify dependencies, maintain current applications, and monitor important artifacts.
For 44% of DataOps and MLOps practitioners and 38% of beginners, the biggest issue was restricted access to data silos, a problem which is best addressed by an overarching data management strategy.
Companies using Data/MLOps tools do particularly well in versioning and creating documentation, providing management frameworks, and testing. They also appear to be better at overcoming the barriers that limit cooperation among stakeholders.
Tool adopters are more able to plan their projects, as they are 4.2 times more likely to be able to deploy their models quickly and 3.5 times less likely to be confronted with projects with overwhelming complexity. If deployment goes wrong, DataOps/MLOps can even help solve the problem.
Because most of these companies surveyed have not yet deployed models, only 26% currently use DataOps/MLOps. But 45% are already planning to use these tools in the future.
When asked how DataOps/MLOps tools had increased their success, 59% of the adopters claimed that they had achieved higher levels of automation. Overall, 97% of the adopters listed a wide range of benefits from using these tools, including more robust applications, better collaboration, and faster time to market.
Of the DataOps/MLOps adopters, 53% said their expectations of ML impact had been met, suggesting that they had realistic expectations about what they could achieve. In fact, 41% described the level of complexity encountered “as expected.”
About 76% of the companies considering the use of DataOps/MLOps tools say they underestimated the difficulty of putting models into production. Presumably, these companies started to explore the products only after being overwhelmed by AI difficulties.
Adopters of DataOps/MLOps products benefit from faster time to market, higher productivity, better scalability, and higher levels of automation — all measures of improved efficiency and speed in delivering results. Deployments lasting just weeks or days are common among DataOps/MLOps adopters but unheard of among companies using other approaches.
ML Software Development
For model development, half of the companies use open source tools, almost a third (31%) use commercial tools, and 19% build their own tools. DataOps/MLOps adopters did not differ significantly from other groups in terms of the tool stacks they used to develop their applications.
Beginners felt more confident using open source or self-developed tools, possibly because they did not take operational concerns seriously. However, they often struggled with complex systems and slow deployment, while commercial tool users enjoyed increased efficiency and could develop models in shorter periods of time (days or weeks).
Importance of Enterprise Support
Organizations need to clearly communicate the ROI of ML models because employee resistance and fear may create barriers to progress. If the benefits of advanced analytics are not widely understood, it is difficult to establish new strategies for digital transformation. The adoption of DataOps/MLOps should always be part of a company-wide initiative to increase data literacy within the organization.
Get the Whole Story
Download the free BARC survey Driving Innovation with AI: Getting ahead with DataOps and MLOps.
DataRobot is the leader in Value-Driven AI – a unique and collaborative approach to AI that combines our open AI platform, deep AI expertise and broad use-case implementation to improve how customers run, grow and optimize their business. The DataRobot AI Platform is the only complete AI lifecycle platform that interoperates with your existing investments in data, applications and business processes, and can be deployed on-prem or in any cloud environment. DataRobot and our partners have a decade of world-class AI expertise collaborating with AI teams (data scientists, business and IT), removing common blockers and developing best practices to successfully navigate projects that result in faster time to value, increased revenue and reduced costs. DataRobot customers include 40% of the Fortune 50, 8 of top 10 US banks, 7 of the top 10 pharmaceutical companies, 7 of the top 10 telcos, 5 of top 10 global manufacturers.
We will contact you shortly
We’re almost there! These are the next steps:
- Look out for an email from DataRobot with a subject line: Your Subscription Confirmation.
- Click the confirmation link to approve your consent.
- Done! You have now opted to receive communications about DataRobot’s products and services.
Didn’t receive the email? Please make sure to check your spam or junk folders.
Optimizing Large Language Model Performance with ONNX on DataRobot MLOpsJune 1, 2023· 11 min read
Belong @ DataRobot: AAPI Heritage Month with the ACTnow! CommunityMay 25, 2023· 3 min read
Deep Learning for Decision-Making Under UncertaintyMay 18, 2023· 5 min read
DataRobot ACTnow! (Asians Coming Together Now) community honors their legacy and celebrates Asian-American and Pacific Islander (AAPI) Heritage Month.
Discover DataRobot's commitment to DEIB during Celebrate Diversity Month. Learn how our Belong Communities and 2023 resolutions foster a culture of belonging.
Women @ DR seeks to create, promote and expand an inclusive culture that connects, educates and advances the needs and aspirations of our community. Read more about Women's History Month celebration.