Releases: secretflow/scql
Releases · secretflow/scql
0.9.1b1
Added
- Support window function ROW_NUMBER() with PARTITION BY clause and ORDER BY clause.
- Add new CCL constraint REVAL_RANK.
- Add ExplainQuery API with path /intra/query/explain.
- Support INSERT INTO SELECT syntax to allow writing query result back to db (mysql/sqlite/postgres).
- Support trim function.
Changed
- Improved the job watcher to work better in broker clustered mode.
- Breaking: broker db schema has incompatible changes, please check here for details.
Full Changelog: 0.9.0b1...0.9.1b1
0.9.0b1
What's Changed
Added
- Support write outfile to OSS/MINIO via
select into
query. - Support
sin
,cos
,acos
function. - Support
geodist
function. - Broker support using postgres as metadata storage.
Changed
- Reduce the memory peak of large-scale intersection tasks through streaming execution.
- Link tcmalloc to solve the problem of memory increase.
Fixed
- Fix crashes when dumpfile exceeds 2GB string column.
- Reduce the probability of graph checksum inconsistency issues.
Full Changelog: 0.8.1b1...0.9.0b1
Note: Cross-version compatibility is not currently guaranteed, please make sure all parties use the same version.
0.8.1b1
Added
- [feature] Support session-based log isolation functioality in the SCQL Engine.
- [feature] Support consul-based broker registration/discovery services, providing ACL/TLS authentication.
0.8.0b2
0.8.0b1
What's Changed
Added
- [feature] Support obtaining query job progress information via
FetchResult
RPC. - [feature] Support project/query level configs.
- [feature] Support handling NULL for private data: including Arithmetic, Logic, Aggregation, etc., {IS [NOT] NULL, IFNULL, COALESCE} are also supported.
- [feature] Support port isolation for engine link service and control panel service (RunExecutionPlan).
- [enhancement] Add new CCL constraint
PLAINTEXT_AS_JOIN_PAYLOAD
.
Note: Cross-version compatibility is not currently guaranteed, please make sure all parties use the same version.
0.7.0b1
Added
- Added CheckAndUpdate API for self-recovery when status is inconsistent in P2P mode
Fixed
- Fixed the problem that Broker was unable to detect SCQLEngine crashes or being killed by OOM
0.6.0b2
Fixed
- Fixed Uri config for peer engine
- Disabled ccache to avoid conflict when building duckdb
- Fixed concurrency issues
0.6.0b1
Added
- [feature] Support DRY-RUN mode.
- [feature] Add support for RSA key pairs in SCQLBroker.
- [experiment][feature] support running on kuscia and scheduling SCQLEngine dynamic via kuscia job.
- [Enhancement] Improve Broker high availability, support depoly in multi-node cluster deployment.
- [feature] Add cancel query job API, it only works when scql running on kuscia for now.
- [feature] Support reading csv from oss/minio
Changed
- Breaking: Reshape column data type, data type
LONG
is deprecated. - Breaking: Modify table schema in broker storage for P2P mode.
0.6.0dev20240403
Added
- Support for RSA key pairs in SCQLBroker.
- Support running on kuscia and scheduling SCQLEngine dynamic via kuscia job.
- Added
dry_run
parameter in DoQuery request, it could be used to check query syntax and CCL without actually executing the query. - Improve Broker high availability, support depolying in multi-node cluster deployment.
- Support reading csv from OSS/MINIO.
0.5.0b2
Fixed
- Disable Unbalanced PSI to avoid unexpected results in certain scenarios