pins-python
The pins package allows you to publish and share Python objects like data, models, and other artifacts across projects and with colleagues. It supports multiple storage backends including local folders, Posit Connect, Amazon S3, Google Cloud Storage, and Azure blob storage.
Pins provides automatic versioning so you can track changes over time, re-run analyses on historical data, and revert mistakes. The package works cross-platform with R, meaning you can write a pin in Python and read it in R or vice versa. It supports multiple file formats (CSV, JSON, Parquet, joblib) and integrates with Posit Connect’s permission system for secure data sharing.
Contributors#
Resources featuring pins-python#
Easier data and asset sharing across projects and teams with {pins} and Databricks
Led by Edgar Ruiz, Software Engineer at Posit PBC April 30th at 11 am ET / 8 am PT
Sharing data assets can be challenging for many teams. Some may rely on emailed files to keep analyses up to date, making it difficult to keep current or know what version of the data is used. {pins} improves sharing data and other assets across projects and teams. It enables us to publish, or ‘pin’, to a variety of places, such as Amazon S3, Posit Connect and Dropbox.
Given recent customer feedback, the ability to publish, or ‘pin’ to Databricks Volumes has been added to R. The same capability is also currently in the works for the Python version of {pins}.
This session on April 30th will showcase the acceleration of predictions by distributing a ‘pinned’ model using pins and Spark in Databricks. We’ll walk through integrating {pins} with Databricks in your team’s projects and cover novel uses of pins inside the Databricks ecosystem.
GitHub repo: https://github.com/edgararuiz/talks/tree/main/end-to-end
Here are a few additional resources that you might find interesting:
- Pins for R: https://pins.rstudio.com/
- Pins for Python: https://rstudio.github.io/pins-python/
- More information on how Posit and Databricks work together: https://posit.co/use-cases/databricks/
- Customer Spotlight: Standardizing a safety model with tidymodels, Posit Team & Databricks at Suffolk Construction: https://youtu.be/yavHEWpgrCQ
- Q&A Recording: https://youtube.com/live/HDTDmEaK5zQ?feature=share
