Save Objects to Existing Packages

Compiler

• New helper function quilt.save adds an object (e.g., a Pandas DataFrame) to an existing package by performing a sub-package build and push in a single step
• BugFix: quilt.load now correctly returns sub-packages (fixes issue #741)

Registry

• Send a welcome email to new users after activation

Minor updates and improved documentation

Compiler

• fixes an issue with packages created on older versions of pyarrow
• improves readability for quilt inspect
• allow adding a node with metadata using sub-package build/push

Registry

• adds documentation for running a private registry in AWS

Bug fixes

• Suppress numpy warnings under Python 2.7
• Fix subpackage build and push

Flask-internal Authentication

Compiler

• Added support for sub-package build and push to allow updates to allow adding nodes to large packages without materializing the whole package
• First-class support for ndarray

Registry

• Replaced dependence on external OAuth2 provider with a built-in authentication and session management
• Registry support for sub-package push

Catalog

• Updated to support new registry authentication

Asa extensions

Compiler

• added Bracket accessor for GroupNodes
• asa.plot to show images in packages
• asa.torch to convert packages to PyTorch Datasets
• Enforce fragment store as read-only

Catalog

• Added source maps and CI for catalog testing

Documentation and Bugfixes

Documentation

Expands and improves documentation for working with Quilt packages.

Bug fixes and small improvements

• Load packages by hash
• Choose a custom loader for DataNodes with asa=

Registry

• Specify Ubuntu version in Dockerfiles

Package Filtering

Catalog

• display package traffic stats in catalog

Compiler

• filter packages based on per-node metadata
• get/set metadata for package nodes
• support custom loaders in the _data method

Registry

• package commenting

Metadata only package install

Compiler

• Metadata-only package install
• Build DataFrames from existing Parquet files
• Remove HDF5 dependencies
• Code cleanup and refactoring

Registry

• Option for metadata-only package installs
• New endpoint for fetching missing fragments (e.g., from partially installed packages)
• Improved full-text search

Package Composition

Compiler:

• Allow building packages out of other packages and elements from other packages. A new build-file keyword, package inserts a package (or sub-package) as an element in the package being built.

Catalog:

• Upgrade router and other dependencies
• Display packages by author

Quilt Teams

Catalog Changes to support private registries

• Amin UI for controlling users and access
• Auditing views

Globbing for package builds

• Allow specifying sets of input files in build.yml

Command-line support for private registries

• Specify teams packages
• Admin commands to create and activate/deactivate users