- Published on
In this post we discuss how we improved the runtime performance of a text mining step in a machine learning pipeline by a factor of 12.
All Posts
All Posts
- python (13)
- conda (5)
- polars (4)
- data (3)
- onnx (3)
- array-api (3)
- ndonnx (3)
- github (2)
- pixi (2)
- packaging (2)
- performance (2)
- mlops (2)
- spox (2)
- sqlalchemy (2)
- automation (1)
- license-checking (1)
- pre-commit (1)
- regulation (1)
- eu (1)
- cra (1)
- data-validation (1)
- tests (1)
- conda-forge (1)
- autotick-bot (1)
- sklearn (1)
- compression (1)
- pickling (1)
- ui (1)
- security (1)
- github-actions (1)
- vulnerability (1)
- glm (1)
- causal-inference (1)
- regex (1)
- numpy (1)
- ast (1)
- compilers (1)
- snowflake (1)
- integration-tests (1)
- pandas (1)
- Published on
We present an open source library to shrink pickled scikit-learn and lightgbm models. We will provide insights of how pickling ML models work and how to improve the disk representation. With this approach, we can reduce the deployment size of machine learning applications up to 6x.- Published on
Datajudge is a Python library for expressing and testing expectations against data from database.- Published on
How to properly set up a React UI component library and share it across your organization.- Published on
When running the integration test suite of a data validation tool against a Snowflake instance, we saw a massive slow-down compared to Postgres or MS SQL.