Releases: quiltdata/quilt
Better Progress Bar
Version 2.9.1 introduces a better progress bar for installing (downloading) Quilt packages. Quilt push now sends objects' uncompressed size to the registry. The progress bar is now based on the total bytes downloaded instead of the number of files.
Shared Local Package Storage
Shared Local Package Storage
Import packages from shared local directories to save storage overhead and network traffic when sharing packages on the same local network.
Registry Install Stats
Log package installs in the registry to display stats on package use.
New Python API commands
- generate
- rm
- search
Drop support for Python 3.4
(BETA) Team Registries
Updates to commands and local storage to allow users to connect to different registries to support teams running private registries for internal sharing.
Fix download retry
Fixes a bug in download that prevented retrying failed downloads.
Remove Unneeded Pandas dependency
Hotfix for several quilt commands
Add Quilt Catalog
Quilt Catalog
Source for the Quilt data catalog is now included in this repository.
MySQL->Postgres
Ported the Quilt registry from MySQL to Postgres
Docker Compose
Improvements to the docker configuration that allows running the registry, catalog, database and authentication service from Docker compose.
Parallel Download
Data fragments can now be downloaded in parallel leading to much faster package installs for large packages.
Centralized Local Package Store
Release Highlights
Quilt packages live in a centralized location on your machine
Quilt data packages are now available wherever you run Python. We recommend that users quilt push all local packages to the registry before upgrading. Further details on migration are here.
Faster builds with build cache
Quilt now caches build intermediates. So if you wish to update the README of a multi-gigabyte package, you can rebuild the entire package in one second.
Group-level build parameters
You can now specify build parameters (like transform) for all children of a group in one shot. The updated syntax and docs are here.
quilt.yml is like requirments.txt but for data
You can now express dependencies on multiple packages in a single file. Docs here.
Experimental: build a package from a GitHub repo
Quilt build now accepts GitHub URLs. If you use data stored on GitHub you can turn it into a Quilt package with quilt build.
Checks: unit tests for data packages
Version 2.7.1 includes several minor bug fixes and one new feature, checks. Checks allow a user to specify data integrity checks that are enforced during quilt build.
Subpackages and more efficient uploads/downloads
- Support installing subpackages as
quilt install usr/pkg/path
- Upload fragments in parallel
- Use http sessions when accessing S3
Clear session to prevent quilt.login() bugs in Jupyter
2.6.3 bump version number to take session fix