Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prevent usage of time_bucket_ng in CAgg definition #6798

Merged
merged 1 commit into from
Apr 9, 2024

Conversation

jnidzwetzki
Copy link
Contributor

@jnidzwetzki jnidzwetzki commented Apr 2, 2024

The function timescaledb_experimental.time_bucket_ng() has been
deprecated for two years. This PR removes it from the list of bucketing
functions supported in a CAgg. Existing CAggs using this function will
still be supported; however, no new CAggs using this function can be
created.


I added a GUC, that is only available in debug builds (similar to debug_require_batch_sorted_merge), to allow the creation of CAggs using time_bucket_ng. This GUC allows it to prove that existing CAggs using this bucket function continue to work. In addition, this GUC can be used in a further PR to introduce and test migration steps.

@jnidzwetzki jnidzwetzki force-pushed the cagg_time_bucket_ng branch 8 times, most recently from 215037a to 380feff Compare April 5, 2024 12:07
The function timescaledb_experimental.time_bucket_ng() has been
deprecated for two years. This PR removes it from the list of bucketing
functions supported in a CAgg. Existing CAggs using this function will
still be supported; however, no new CAggs using this function can be
created.
@jnidzwetzki jnidzwetzki force-pushed the cagg_time_bucket_ng branch from 380feff to 0b6342c Compare April 5, 2024 12:57
@jnidzwetzki jnidzwetzki self-assigned this Apr 5, 2024
Copy link

codecov bot commented Apr 5, 2024

Codecov Report

Attention: Patch coverage is 60.00000% with 6 lines in your changes are missing coverage. Please review.

Project coverage is 80.92%. Comparing base (59f50f2) to head (0b6342c).
Report is 94 commits behind head on main.

Files Patch % Lines
tsl/src/continuous_aggs/common.c 61.53% 0 Missing and 5 partials ⚠️
src/ts_catalog/continuous_agg.c 0.00% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #6798      +/-   ##
==========================================
+ Coverage   80.06%   80.92%   +0.85%     
==========================================
  Files         190      194       +4     
  Lines       37181    36863     -318     
  Branches     9450     9653     +203     
==========================================
+ Hits        29770    29830      +60     
- Misses       2997     3180     +183     
+ Partials     4414     3853     -561     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@jnidzwetzki jnidzwetzki added this to the TimescaleDB 2.15.0 milestone Apr 5, 2024
@jnidzwetzki jnidzwetzki marked this pull request as ready for review April 5, 2024 13:16
Comment on lines +260 to +270
if (!function_allowed_in_cagg_definition(fe->funcid))
{
if (IS_DEPRECATED_BUCKET_FUNC(finfo))
{
ereport(ERROR,
(errcode(ERRCODE_FEATURE_NOT_SUPPORTED),
errmsg("experimental bucket functions are not supported inside a CAgg "
"definition"),
errhint("Use a function from the %s schema instead.",
FUNCTIONS_SCHEMA_NAME)));
}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How does it work during upgrade, will people be able to upgrade if they have such caggs?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This function is only called when you create new CAggs. So, this PR blocks only the ability to create new CAggs using time_bucket_ng. Existing CAggs continue to work.

-- 2.14.2
CREATE MATERIALIZED VIEW conditions_summary_weekly
WITH (timescaledb.continuous, timescaledb.materialized_only=true) AS
SELECT city,
       timescaledb_experimental.time_bucket_ng('7 days', day, '2000-01-03' :: date) AS bucket,
       MIN(temperature),
       MAX(temperature)
FROM conditions
GROUP BY city, bucket
WITH NO DATA;

test1=# select * from _timescaledb_catalog.continuous_aggs_bucket_function ;
 mat_hypertable_id |                         bucket_func                         | bucket_width | bucket_origin | bucket_offset | bucket_timezone | bucket_fixed_width
-------------------+-------------------------------------------------------------+--------------+---------------+---------------+-----------------+--------------------
                 2 | timescaledb_experimental.time_bucket_ng(interval,date,date) | 604800000000 |               |               |                 | t
(1 row)


test1=# alter extension timescaledb update;
ALTER EXTENSION

INSERT into conditions values(now(), 'Hamburg', 34);
CALL refresh_continuous_aggregate('conditions_summary_weekly', NULL, NULL);

-- 2.15.0-dev
CREATE MATERIALIZED VIEW conditions_summary_weekly2
WITH (timescaledb.continuous, timescaledb.materialized_only=true) AS
SELECT city,
       timescaledb_experimental.time_bucket_ng('7 days', day, '2000-01-03' :: date) AS bucket,
       MIN(temperature),
       MAX(temperature)
FROM conditions
GROUP BY city, bucket
WITH NO DATA;

ERROR:  experimental bucket functions are not supported inside a CAgg definition
HINT:  Use a function from the _timescaledb_functions schema instead.

@jnidzwetzki jnidzwetzki merged commit 626975f into timescale:main Apr 9, 2024
43 of 44 checks passed
@jnidzwetzki jnidzwetzki deleted the cagg_time_bucket_ng branch April 9, 2024 12:55
jnidzwetzki added a commit to jnidzwetzki/timescaledb that referenced this pull request Apr 18, 2024
PR timescale#6798 prevents the usage of time_bucket_ng in CAgg definitions.
However, flipping the real-time functionality should still be possible.
jnidzwetzki added a commit to jnidzwetzki/timescaledb that referenced this pull request Apr 18, 2024
PR timescale#6798 prevents the usage of time_bucket_ng in CAgg definitions.
However, flipping the real-time functionality should still be possible.
jnidzwetzki added a commit to jnidzwetzki/timescaledb that referenced this pull request Apr 18, 2024
PR timescale#6798 prevents the usage of time_bucket_ng in CAgg definitions.
However, flipping the real-time functionality should still be possible.
jnidzwetzki added a commit that referenced this pull request Apr 18, 2024
PR #6798 prevents the usage of time_bucket_ng in CAgg definitions.
However, flipping the real-time functionality should still be possible.
fabriziomello added a commit to fabriziomello/timescaledb that referenced this pull request May 6, 2024
This release contains performance improvements and bug fixes since
the 2.14.2 release. We recommend that you upgrade at the next
available opportunity.

In addition, it includes these noteworthy features:
* Support `time_bucket` with `origin` and/or `offset` on Continuous Aggregate
* Compression improvements:
  - Improve expression pushdown
  - Add minmax sparse indexes when compressing columns with btree indexes
  - Make compression use the defaults functions
  - Vectorize filters in WHERE clause that contain text equality operators and LIKE expressions

**Deprecation warning**
* Starting on this release will not be possible to create Continuous Aggregate using `time_bucket_ng` anymore and it will be completely removed on the upcoming releases.
* Recommend users to [migrate their old Continuous Aggregate format to the new one](https://docs.timescale.com/use-timescale/latest/continuous-aggregates/migrate/) because it support will be completely removed in next releases prevent them to migrate.
* This is the last release supporting PostgreSQL 13.

**For on-premise users and this release only**, you will need to run [this SQL script](https://github.com/timescale/timescaledb-extras/blob/master/utils/2.15.X-fix_hypertable_foreign_keys.sql) after running `ALTER EXTENSION`. More details can be found in the pull request [timescale#6786](timescale#6797).

**Features**
* timescale#6382 Support for time_bucket with origin and offset in CAggs
* timescale#6696 Improve defaults for compression segment_by and order_by
* timescale#6705 Add sparse minmax indexes for compressed columns that have uncompressed btree indexes
* timescale#6754 Allow DROP CONSTRAINT on compressed hypertables
* timescale#6767 Add metadata table `_timestaledb_internal.bgw_job_stat_history` for tracking job execution history
* timescale#6798 Prevent usage of deprecated time_bucket_ng in CAgg definition
* timescale#6810 Add telemetry for access methods
* timescale#6811 Remove no longer relevant timescaledb.allow_install_without_preload GUC
* timescale#6837 Add migration path for CAggs using time_bucket_ng
* timescale#6865 Update the watermark when truncating a CAgg

**Bugfixes**
* timescale#6617 Fix error in show_chunks
* timescale#6621 Remove metadata when dropping chunks
* timescale#6677 Fix snapshot usage in CAgg invalidation scanner
* timescale#6698 Define meaning of 0 retries for jobs as no retries
* timescale#6717 Fix handling of compressed tables with primary or unique index in COPY path
* timescale#6726 Fix constify cagg_watermark using window function when querying a CAgg
* timescale#6729 Fix NULL start value handling in CAgg refresh
* timescale#6732 Fix CAgg migration with custom timezone / date format settings
* timescale#6752 Remove custom autovacuum setting from compressed chunks
* timescale#6770 Fix plantime chunk exclusion for OSM chunk
* timescale#6789 Fix deletes with subqueries and compression
* timescale#6796 Fix a crash involving a view on a hypertable
* timescale#6797 Fix foreign key constraint handling on compressed hypertables
* timescale#6816 Fix handling of chunks with no contraints
* timescale#6820 Fix a crash when the ts_hypertable_insert_blocker was called directly
* timescale#6849 Use non-orderby compressed metadata in compressed DML
* timescale#6867 Clean up compression settings when deleting compressed cagg
* timescale#6869 Fix compressed DML with constraints of form value OP column
* timescale#6870 Fix bool expression pushdown for queries on compressed chunks

**Thanks**
* @brasic for reporting a crash when the ts_hypertable_insert_blocker was called directly
* @bvanelli for reporting an issue with the jobs retry count
* @djzurawsk For reporting error when dropping chunks
* @Dzuzepppe for reporting an issue with DELETEs using subquery on compressed chunk working incorrectly.
* @hongquan For reporting a 'timestamp out of range' error during CAgg migrations
* @kevcenteno for reporting an issue with the show_chunks API showing incorrect output when 'created_before/created_after' was used with time-partitioned columns.
* @mahipv For starting working on the job history PR
* @rovo89 For reporting constify cagg_watermark not working using window function when querying a CAgg
fabriziomello added a commit to fabriziomello/timescaledb that referenced this pull request May 6, 2024
This release contains performance improvements and bug fixes since
the 2.14.2 release. We recommend that you upgrade at the next
available opportunity.

In addition, it includes these noteworthy features:
* Support `time_bucket` with `origin` and/or `offset` on Continuous Aggregate
* Compression improvements:
  - Improve expression pushdown
  - Add minmax sparse indexes when compressing columns with btree indexes
  - Make compression use the defaults functions
  - Vectorize filters in WHERE clause that contain text equality operators and LIKE expressions

**Deprecation warning**
* Starting on this release will not be possible to create Continuous Aggregate using `time_bucket_ng` anymore and it will be completely removed on the upcoming releases.
* Recommend users to [migrate their old Continuous Aggregate format to the new one](https://docs.timescale.com/use-timescale/latest/continuous-aggregates/migrate/) because it support will be completely removed in next releases prevent them to migrate.
* This is the last release supporting PostgreSQL 13.

**For on-premise users and this release only**, you will need to run [this SQL script](https://github.com/timescale/timescaledb-extras/blob/master/utils/2.15.X-fix_hypertable_foreign_keys.sql) after running `ALTER EXTENSION`. More details can be found in the pull request [timescale#6786](timescale#6797).

**Features**
* timescale#6382 Support for time_bucket with origin and offset in CAggs
* timescale#6696 Improve defaults for compression segment_by and order_by
* timescale#6705 Add sparse minmax indexes for compressed columns that have uncompressed btree indexes
* timescale#6754 Allow DROP CONSTRAINT on compressed hypertables
* timescale#6767 Add metadata table `_timestaledb_internal.bgw_job_stat_history` for tracking job execution history
* timescale#6798 Prevent usage of deprecated time_bucket_ng in CAgg definition
* timescale#6810 Add telemetry for access methods
* timescale#6811 Remove no longer relevant timescaledb.allow_install_without_preload GUC
* timescale#6837 Add migration path for CAggs using time_bucket_ng
* timescale#6865 Update the watermark when truncating a CAgg

**Bugfixes**
* timescale#6617 Fix error in show_chunks
* timescale#6621 Remove metadata when dropping chunks
* timescale#6677 Fix snapshot usage in CAgg invalidation scanner
* timescale#6698 Define meaning of 0 retries for jobs as no retries
* timescale#6717 Fix handling of compressed tables with primary or unique index in COPY path
* timescale#6726 Fix constify cagg_watermark using window function when querying a CAgg
* timescale#6729 Fix NULL start value handling in CAgg refresh
* timescale#6732 Fix CAgg migration with custom timezone / date format settings
* timescale#6752 Remove custom autovacuum setting from compressed chunks
* timescale#6770 Fix plantime chunk exclusion for OSM chunk
* timescale#6789 Fix deletes with subqueries and compression
* timescale#6796 Fix a crash involving a view on a hypertable
* timescale#6797 Fix foreign key constraint handling on compressed hypertables
* timescale#6816 Fix handling of chunks with no contraints
* timescale#6820 Fix a crash when the ts_hypertable_insert_blocker was called directly
* timescale#6849 Use non-orderby compressed metadata in compressed DML
* timescale#6867 Clean up compression settings when deleting compressed cagg
* timescale#6869 Fix compressed DML with constraints of form value OP column
* timescale#6870 Fix bool expression pushdown for queries on compressed chunks

**Thanks**
* @brasic for reporting a crash when the ts_hypertable_insert_blocker was called directly
* @bvanelli for reporting an issue with the jobs retry count
* @djzurawsk For reporting error when dropping chunks
* @Dzuzepppe for reporting an issue with DELETEs using subquery on compressed chunk working incorrectly.
* @hongquan For reporting a 'timestamp out of range' error during CAgg migrations
* @kevcenteno for reporting an issue with the show_chunks API showing incorrect output when 'created_before/created_after' was used with time-partitioned columns.
* @mahipv For starting working on the job history PR
* @rovo89 For reporting constify cagg_watermark not working using window function when querying a CAgg
@fabriziomello fabriziomello mentioned this pull request May 6, 2024
fabriziomello added a commit to fabriziomello/timescaledb that referenced this pull request May 6, 2024
This release contains performance improvements and bug fixes since
the 2.14.2 release. We recommend that you upgrade at the next
available opportunity.

In addition, it includes these noteworthy features:
* Support `time_bucket` with `origin` and/or `offset` on Continuous Aggregate
* Compression improvements:
  - Improve expression pushdown
  - Add minmax sparse indexes when compressing columns with btree indexes
  - Make compression use the defaults functions
  - Vectorize filters in WHERE clause that contain text equality operators and LIKE expressions

**Deprecation warning**
* Starting on this release will not be possible to create Continuous Aggregate using `time_bucket_ng` anymore and it will be completely removed on the upcoming releases.
* Recommend users to [migrate their old Continuous Aggregate format to the new one](https://docs.timescale.com/use-timescale/latest/continuous-aggregates/migrate/) because it support will be completely removed in next releases prevent them to migrate.
* This is the last release supporting PostgreSQL 13.

**For on-premise users and this release only**, you will need to run [this SQL script](https://github.com/timescale/timescaledb-extras/blob/master/utils/2.15.X-fix_hypertable_foreign_keys.sql) after running `ALTER EXTENSION`. More details can be found in the pull request [timescale#6786](timescale#6797).

**Features**
* timescale#6382 Support for time_bucket with origin and offset in CAggs
* timescale#6696 Improve defaults for compression segment_by and order_by
* timescale#6705 Add sparse minmax indexes for compressed columns that have uncompressed btree indexes
* timescale#6754 Allow DROP CONSTRAINT on compressed hypertables
* timescale#6767 Add metadata table `_timestaledb_internal.bgw_job_stat_history` for tracking job execution history
* timescale#6798 Prevent usage of deprecated time_bucket_ng in CAgg definition
* timescale#6810 Add telemetry for access methods
* timescale#6811 Remove no longer relevant timescaledb.allow_install_without_preload GUC
* timescale#6837 Add migration path for CAggs using time_bucket_ng
* timescale#6865 Update the watermark when truncating a CAgg

**Bugfixes**
* timescale#6617 Fix error in show_chunks
* timescale#6621 Remove metadata when dropping chunks
* timescale#6677 Fix snapshot usage in CAgg invalidation scanner
* timescale#6698 Define meaning of 0 retries for jobs as no retries
* timescale#6717 Fix handling of compressed tables with primary or unique index in COPY path
* timescale#6726 Fix constify cagg_watermark using window function when querying a CAgg
* timescale#6729 Fix NULL start value handling in CAgg refresh
* timescale#6732 Fix CAgg migration with custom timezone / date format settings
* timescale#6752 Remove custom autovacuum setting from compressed chunks
* timescale#6770 Fix plantime chunk exclusion for OSM chunk
* timescale#6789 Fix deletes with subqueries and compression
* timescale#6796 Fix a crash involving a view on a hypertable
* timescale#6797 Fix foreign key constraint handling on compressed hypertables
* timescale#6816 Fix handling of chunks with no contraints
* timescale#6820 Fix a crash when the ts_hypertable_insert_blocker was called directly
* timescale#6849 Use non-orderby compressed metadata in compressed DML
* timescale#6867 Clean up compression settings when deleting compressed cagg
* timescale#6869 Fix compressed DML with constraints of form value OP column
* timescale#6870 Fix bool expression pushdown for queries on compressed chunks

**Thanks**
* @brasic for reporting a crash when the ts_hypertable_insert_blocker was called directly
* @bvanelli for reporting an issue with the jobs retry count
* @djzurawsk For reporting error when dropping chunks
* @Dzuzepppe for reporting an issue with DELETEs using subquery on compressed chunk working incorrectly.
* @hongquan For reporting a 'timestamp out of range' error during CAgg migrations
* @kevcenteno for reporting an issue with the show_chunks API showing incorrect output when 'created_before/created_after' was used with time-partitioned columns.
* @mahipv For starting working on the job history PR
* @rovo89 For reporting constify cagg_watermark not working using window function when querying a CAgg
fabriziomello added a commit that referenced this pull request May 6, 2024
This release contains performance improvements and bug fixes since
the 2.14.2 release. We recommend that you upgrade at the next
available opportunity.

In addition, it includes these noteworthy features:
* Support `time_bucket` with `origin` and/or `offset` on Continuous Aggregate
* Compression improvements:
  - Improve expression pushdown
  - Add minmax sparse indexes when compressing columns with btree indexes
  - Make compression use the defaults functions
  - Vectorize filters in WHERE clause that contain text equality operators and LIKE expressions

**Deprecation warning**
* Starting on this release will not be possible to create Continuous Aggregate using `time_bucket_ng` anymore and it will be completely removed on the upcoming releases.
* Recommend users to [migrate their old Continuous Aggregate format to the new one](https://docs.timescale.com/use-timescale/latest/continuous-aggregates/migrate/) because it support will be completely removed in next releases prevent them to migrate.
* This is the last release supporting PostgreSQL 13.

**For on-premise users and this release only**, you will need to run [this SQL script](https://github.com/timescale/timescaledb-extras/blob/master/utils/2.15.X-fix_hypertable_foreign_keys.sql) after running `ALTER EXTENSION`. More details can be found in the pull request [#6786](#6797).

**Features**
* #6382 Support for time_bucket with origin and offset in CAggs
* #6696 Improve defaults for compression segment_by and order_by
* #6705 Add sparse minmax indexes for compressed columns that have uncompressed btree indexes
* #6754 Allow DROP CONSTRAINT on compressed hypertables
* #6767 Add metadata table `_timestaledb_internal.bgw_job_stat_history` for tracking job execution history
* #6798 Prevent usage of deprecated time_bucket_ng in CAgg definition
* #6810 Add telemetry for access methods
* #6811 Remove no longer relevant timescaledb.allow_install_without_preload GUC
* #6837 Add migration path for CAggs using time_bucket_ng
* #6865 Update the watermark when truncating a CAgg

**Bugfixes**
* #6617 Fix error in show_chunks
* #6621 Remove metadata when dropping chunks
* #6677 Fix snapshot usage in CAgg invalidation scanner
* #6698 Define meaning of 0 retries for jobs as no retries
* #6717 Fix handling of compressed tables with primary or unique index in COPY path
* #6726 Fix constify cagg_watermark using window function when querying a CAgg
* #6729 Fix NULL start value handling in CAgg refresh
* #6732 Fix CAgg migration with custom timezone / date format settings
* #6752 Remove custom autovacuum setting from compressed chunks
* #6770 Fix plantime chunk exclusion for OSM chunk
* #6789 Fix deletes with subqueries and compression
* #6796 Fix a crash involving a view on a hypertable
* #6797 Fix foreign key constraint handling on compressed hypertables
* #6816 Fix handling of chunks with no contraints
* #6820 Fix a crash when the ts_hypertable_insert_blocker was called directly
* #6849 Use non-orderby compressed metadata in compressed DML
* #6867 Clean up compression settings when deleting compressed cagg
* #6869 Fix compressed DML with constraints of form value OP column
* #6870 Fix bool expression pushdown for queries on compressed chunks

**Thanks**
* @brasic for reporting a crash when the ts_hypertable_insert_blocker was called directly
* @bvanelli for reporting an issue with the jobs retry count
* @djzurawsk For reporting error when dropping chunks
* @Dzuzepppe for reporting an issue with DELETEs using subquery on compressed chunk working incorrectly.
* @hongquan For reporting a 'timestamp out of range' error during CAgg migrations
* @kevcenteno for reporting an issue with the show_chunks API showing incorrect output when 'created_before/created_after' was used with time-partitioned columns.
* @mahipv For starting working on the job history PR
* @rovo89 For reporting constify cagg_watermark not working using window function when querying a CAgg
fabriziomello added a commit to fabriziomello/timescaledb that referenced this pull request May 6, 2024
This release contains performance improvements and bug fixes since
the 2.14.2 release. We recommend that you upgrade at the next
available opportunity.

In addition, it includes these noteworthy features:
* Support `time_bucket` with `origin` and/or `offset` on Continuous Aggregate
* Compression improvements:
  - Improve expression pushdown
  - Add minmax sparse indexes when compressing columns with btree indexes
  - Make compression use the defaults functions
  - Vectorize filters in WHERE clause that contain text equality operators and LIKE expressions

**Deprecation warning**
* Starting on this release will not be possible to create Continuous Aggregate using `time_bucket_ng` anymore and it will be completely removed on the upcoming releases.
* Recommend users to [migrate their old Continuous Aggregate format to the new one](https://docs.timescale.com/use-timescale/latest/continuous-aggregates/migrate/) because it support will be completely removed in next releases prevent them to migrate.
* This is the last release supporting PostgreSQL 13.

**For on-premise users and this release only**, you will need to run [this SQL script](https://github.com/timescale/timescaledb-extras/blob/master/utils/2.15.X-fix_hypertable_foreign_keys.sql) after running `ALTER EXTENSION`. More details can be found in the pull request [timescale#6786](timescale#6797).

**Features**
* timescale#6382 Support for time_bucket with origin and offset in CAggs
* timescale#6696 Improve defaults for compression segment_by and order_by
* timescale#6705 Add sparse minmax indexes for compressed columns that have uncompressed btree indexes
* timescale#6754 Allow DROP CONSTRAINT on compressed hypertables
* timescale#6767 Add metadata table `_timestaledb_internal.bgw_job_stat_history` for tracking job execution history
* timescale#6798 Prevent usage of deprecated time_bucket_ng in CAgg definition
* timescale#6810 Add telemetry for access methods
* timescale#6811 Remove no longer relevant timescaledb.allow_install_without_preload GUC
* timescale#6837 Add migration path for CAggs using time_bucket_ng
* timescale#6865 Update the watermark when truncating a CAgg

**Bugfixes**
* timescale#6617 Fix error in show_chunks
* timescale#6621 Remove metadata when dropping chunks
* timescale#6677 Fix snapshot usage in CAgg invalidation scanner
* timescale#6698 Define meaning of 0 retries for jobs as no retries
* timescale#6717 Fix handling of compressed tables with primary or unique index in COPY path
* timescale#6726 Fix constify cagg_watermark using window function when querying a CAgg
* timescale#6729 Fix NULL start value handling in CAgg refresh
* timescale#6732 Fix CAgg migration with custom timezone / date format settings
* timescale#6752 Remove custom autovacuum setting from compressed chunks
* timescale#6770 Fix plantime chunk exclusion for OSM chunk
* timescale#6789 Fix deletes with subqueries and compression
* timescale#6796 Fix a crash involving a view on a hypertable
* timescale#6797 Fix foreign key constraint handling on compressed hypertables
* timescale#6816 Fix handling of chunks with no contraints
* timescale#6820 Fix a crash when the ts_hypertable_insert_blocker was called directly
* timescale#6849 Use non-orderby compressed metadata in compressed DML
* timescale#6867 Clean up compression settings when deleting compressed cagg
* timescale#6869 Fix compressed DML with constraints of form value OP column
* timescale#6870 Fix bool expression pushdown for queries on compressed chunks

**Thanks**
* @brasic for reporting a crash when the ts_hypertable_insert_blocker was called directly
* @bvanelli for reporting an issue with the jobs retry count
* @djzurawsk For reporting error when dropping chunks
* @Dzuzepppe for reporting an issue with DELETEs using subquery on compressed chunk working incorrectly.
* @hongquan For reporting a 'timestamp out of range' error during CAgg migrations
* @kevcenteno for reporting an issue with the show_chunks API showing incorrect output when 'created_before/created_after' was used with time-partitioned columns.
* @mahipv For starting working on the job history PR
* @rovo89 For reporting constify cagg_watermark not working using window function when querying a CAgg
fabriziomello added a commit that referenced this pull request May 7, 2024
This release contains performance improvements and bug fixes since
the 2.14.2 release. We recommend that you upgrade at the next
available opportunity.

In addition, it includes these noteworthy features:
* Support `time_bucket` with `origin` and/or `offset` on Continuous Aggregate
* Compression improvements:
  - Improve expression pushdown
  - Add minmax sparse indexes when compressing columns with btree indexes
  - Make compression use the defaults functions
  - Vectorize filters in WHERE clause that contain text equality operators and LIKE expressions

**Deprecation warning**
* Starting on this release will not be possible to create Continuous Aggregate using `time_bucket_ng` anymore and it will be completely removed on the upcoming releases.
* Recommend users to [migrate their old Continuous Aggregate format to the new one](https://docs.timescale.com/use-timescale/latest/continuous-aggregates/migrate/) because it support will be completely removed in next releases prevent them to migrate.
* This is the last release supporting PostgreSQL 13.

**For on-premise users and this release only**, you will need to run [this SQL script](https://github.com/timescale/timescaledb-extras/blob/master/utils/2.15.X-fix_hypertable_foreign_keys.sql) after running `ALTER EXTENSION`. More details can be found in the pull request [#6786](#6797).

**Features**
* #6382 Support for time_bucket with origin and offset in CAggs
* #6696 Improve defaults for compression segment_by and order_by
* #6705 Add sparse minmax indexes for compressed columns that have uncompressed btree indexes
* #6754 Allow DROP CONSTRAINT on compressed hypertables
* #6767 Add metadata table `_timestaledb_internal.bgw_job_stat_history` for tracking job execution history
* #6798 Prevent usage of deprecated time_bucket_ng in CAgg definition
* #6810 Add telemetry for access methods
* #6811 Remove no longer relevant timescaledb.allow_install_without_preload GUC
* #6837 Add migration path for CAggs using time_bucket_ng
* #6865 Update the watermark when truncating a CAgg

**Bugfixes**
* #6617 Fix error in show_chunks
* #6621 Remove metadata when dropping chunks
* #6677 Fix snapshot usage in CAgg invalidation scanner
* #6698 Define meaning of 0 retries for jobs as no retries
* #6717 Fix handling of compressed tables with primary or unique index in COPY path
* #6726 Fix constify cagg_watermark using window function when querying a CAgg
* #6729 Fix NULL start value handling in CAgg refresh
* #6732 Fix CAgg migration with custom timezone / date format settings
* #6752 Remove custom autovacuum setting from compressed chunks
* #6770 Fix plantime chunk exclusion for OSM chunk
* #6789 Fix deletes with subqueries and compression
* #6796 Fix a crash involving a view on a hypertable
* #6797 Fix foreign key constraint handling on compressed hypertables
* #6816 Fix handling of chunks with no contraints
* #6820 Fix a crash when the ts_hypertable_insert_blocker was called directly
* #6849 Use non-orderby compressed metadata in compressed DML
* #6867 Clean up compression settings when deleting compressed cagg
* #6869 Fix compressed DML with constraints of form value OP column
* #6870 Fix bool expression pushdown for queries on compressed chunks

**Thanks**
* @brasic for reporting a crash when the ts_hypertable_insert_blocker was called directly
* @bvanelli for reporting an issue with the jobs retry count
* @djzurawsk For reporting error when dropping chunks
* @Dzuzepppe for reporting an issue with DELETEs using subquery on compressed chunk working incorrectly.
* @hongquan For reporting a 'timestamp out of range' error during CAgg migrations
* @kevcenteno for reporting an issue with the show_chunks API showing incorrect output when 'created_before/created_after' was used with time-partitioned columns.
* @mahipv For starting working on the job history PR
* @rovo89 For reporting constify cagg_watermark not working using window function when querying a CAgg
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants