perpetual

Features

• Hyperparameter-Free Learning: Achieves optimal accuracy in a single run via a simple budget parameter, eliminating the need for time-consuming hyperparameter optimization.
• High-Performance Rust Core: Blazing-fast training and inference with a native Rust core, zero-copy support for Polars/Arrow data, and robust Python & R bindings.
• Comprehensive Objectives: Fully supports Classification (Binary & Multi-class), Regression, and Ranking tasks.
• Advanced Tree Features: Natively handles categorical variables, learnable missing value splits, monotonic constraints, and feature interaction constraints.
• Built-in Causal ML: Out-of-the-box support for causal machine learning to estimate treatment effects.
• Robust Drift Monitoring: Built-in capabilities to monitor both data drift and concept drift without requiring ground truth labels or model retraining.
• Continual Learning: Built-in continual learning capabilities that significantly reduce computational time from O(n²) to O(n).
• Native Calibration: Built-in calibration features to predict fully calibrated distributions (marginal coverage) and conditional coverage without retraining.
• Explainability: Easily interpret model decisions using built-in feature importance, partial dependence plots, and Shapley (SHAP) values.
• Production Ready & Interoperable: Ready for production applications; seamlessly export models to industry-standard XGBoost or ONNX formats for straightforward deployment.

Supported Languages

Perpetual is built in Rust and provides high-performance bindings for Python and R.

Optional Dependencies

• pandas: Enables support for training directly on Pandas DataFrames.
• polars: Enables zero-copy training support for Polars DataFrames.
• scikit-learn: Provides a scikit-learn compatible wrapper interface.
• xgboost: Enables saving and loading models in XGBoost format for interoperability.
• onnxruntime: Enables exporting and loading models in ONNX standard format.

Usage

You can use the algorithm like in the example below. Check examples folders for both Rust and Python.

from perpetual import PerpetualBooster

model = PerpetualBooster(objective="SquaredLoss", budget=0.5)
model.fit(X, y)

Benchmark

PerpetualBooster vs. Optuna + LightGBM

Hyperparameter optimization usually takes 100 iterations with plain GBM algorithms. PerpetualBooster achieves the same accuracy in a single run. Thus, it achieves up to 100x speed-up at the same accuracy with different budget levels and with different datasets.

The following table summarizes the results for the California Housing dataset (regression):

The following table summarizes the results for the Pumpkin Seeds dataset (classification):

The results can be reproduced using the scripts in the examples folder.

PerpetualBooster vs. AutoGluon

PerpetualBooster is a GBM but behaves like AutoML so it is benchmarked also against AutoGluon (v1.2, best quality preset), the current leader in AutoML benchmark. Top 10 datasets with the most number of rows are selected from OpenML datasets for both regression and classification tasks.

The results are summarized in the following table for regression tasks:

PerpetualBooster outperformed AutoGluon on 8 out of 10 regression tasks, training equally fast and inferring 5.1x faster.

The results are summarized in the following table for classification tasks:

PerpetualBooster outperformed AutoGluon on 10 out of 10 classification tasks, training equally fast and inferring 1.1x faster.

PerpetualBooster demonstrates greater robustness compared to AutoGluon, successfully training on all 20 tasks, whereas AutoGluon encountered out-of-memory errors on 3 of those tasks.

The results can be reproduced using the automlbenchmark fork.

Contribution

Contributions are welcome. Check CONTRIBUTING.md for the guideline.

Paper

PerpetualBooster prevents overfitting with a generalization algorithm. The paper is work-in-progress to explain how the algorithm works. Check our blog post for a high level introduction to the algorithm.

Perpetual ML Suite

The Perpetual ML Suite is a comprehensive, batteries-included ML platform designed to deliver maximum predictive power with minimal effort. It allows you to track experiments, monitor metrics, and manage model drift through an intuitive interface.

For a fully managed, serverless ML experience, visit app.perpetual-ml.com.

• Serverless Marimo Notebooks: Run interactive, reactive notebooks without managing any infrastructure.
• Serverless ML Endpoints: One-click deployment of models as production-ready endpoints for real-time inference.

Perpetual is also designed to live where your data lives. It is available as a native application on the Snowflake Marketplace, with support for Databricks and other major data warehouses coming soon.