Get the most value out of your data by integrating enterprise-grade scalability and predictive modeling.
To manage and monitor the application, DataRobot uses Cloudera Custom Service Descriptors. You manage and monitor DataRobot using the exact same tools you use today. DataRobot uses Cloudera Manager to distribute runtime libraries to the Hadoop Data nodes; there are no extra installation and configuration tasks when you add a node.
Security & Encryption
DataRobot uses Sentry for fine-grained role-based authorization, and supports Kerberos and LDAP protocols. With DataRobot, your security protocols are exactly the same as they are for your other applications. Because DataRobot integrates natively and leverages HDFS, it inherits the encryption policies you implement in Cloudera. You do not need to implement additional controls to ensure the security of your data.
Auditing & Lineage
Cloudera Manager tracks DataRobot lifecycle events and security-related events just like any other process running in your Cloudera cluster. Cloudera also tracks the DataRobot analysis and model files, and Cloudera Navigator provides you with a visualization of data lineage.
YARN for Workload Management
DataRobot workloads runs in YARN containers, so DataRobot coexists with your other applications. You do not need to partition your cluster to prevent resource conflict – YARN handles that for you.
DataRobot runs on standard Hadoop-spec commodity hardware. It requires no long-running processes on Hadoop Data nodes. Unlike some commercial tools, you will not need to replace or upgrade your Hadoop servers. In addition, DataRobot does not need a proprietary storage layer; it works directly with HDFS. DataRobot users can work directly with HDFS files, and the application uses HDFS to store analysis datasets and models.
DataRobot uses Apache Spark for high-performance in-memory model scoring. Since DataRobot leverages Cloudera’s scale-out architecture, you can provision scoring for the scoring volume you need at your desired level of throughput.