Skip to content

3.6
Compare
Choose a tag to compare
@alex-aizman alex-aizman released this 20 Jun 23:04
3.6
640eb05

Highlights

  • observability: revise StatsD integration, add disk metrics, support Prometheus
  • EC version 2: introduce new (packed) metadata format; speed-up erasure-coding and optimize rebalancing of erasure-coded buckets
  • API for reading and writing (tar, tgz, zip) archives - initial, experimental

Observability

  • revise StatsD integration (part one: major update) !4340
  • revise StatsD integration (part two: cleanup, refactoring) !4342
  • stats/ref: move core-stats to common, close StatsD !4345
  • revise StatsD integration (part three) !4346
  • prepare metric names at init time !4355
  • implement Prometheus exporter !4356
  • make StatsD naming and units consistent with Prometheus !4357
  • preallocate disk stats !4358
  • add disk metrics, publish disk metrics !4372
  • tests: fix disk utilization computation !4374
  • track average read/write sizes; log improvements; refactoring !4376
  • read-lock when collecting Prometheus stats !4378

AIS CLI

  • CLI: do not validate config received from a daemon !4339
  • CLI: add an option --validate for bucket summary to show the number of 'not-ok' objects !4341
  • CLI: introduce new top-level command: storage !4350
  • CLI: fix counting missing copies in 'ais storage' output !4353
  • CLI: docs for ais storage command !4362
  • CLI: add 'ais storage disk' sub-command !4375

EC

  • EC: extend metafile with version and a list of slices !4373
  • EC: use packed binary format for metadata !4382
  • EC: flatten EC props for object HEAD response !4386
  • EC: save slice locations in metafile !4387
  • EC: protect metadata with checksum !4395
  • EC: rebalance v2 (major upd) !4426
  • EC: optimize network usage when deleting and restoring an object !4419

Archive

  • archive: GET from tar !4388
  • archive: CLI --extract option; refactoring !4390
  • archive: archpath keyword; add test; refactoring !4391
  • archive: devtools (minor ref) !4392
  • archive: GET from tar, tgz, and zip !4394
  • archive: add extension and provider tests !4396
  • archive bucket to bucket (part one) !4418
  • archive bucket to bucket (part two) !4425
  • archive bucket to bucket (part three) !4427
  • archive bucket to bucket (part four) !4429
  • archive bucket to bucket (part five) !4434
  • archive: auto-detect archive (mime) type !4402
  • archive: add test variations; absolute path !4404
  • archive: add mime type query and more tests !4405

CI

  • CI: fix linter on Darwin platform !4337
  • CI, Jenkins: run cloud ETL tests !4370, !4384
  • CI, Jenkins: correctly read and apply AWS environment for minikube !4397
  • CI: fix dev/k8s template !4403
  • CI: push credentials in secret !4408

Bug fixes and improvements

  • aisloader: require -cleanup option !4335
  • general: use Go 1.16 embed package !4336
  • test: add reader test for SGL !4338
  • config ports, json: remove duplication and parsing !4343
  • config, etc. !4347
  • config: add custom duration type and parsing (part one) !4348
  • revisit json duration (type) !4349
  • config: eliminate string durations, use custom type (part two) !4351
  • docs: "Monitoring AIStore with Prometheus" !4352
  • comments !4354
  • network call with retry: client and server flavors !4344
  • cmn: rename BucketNames struct to Bcks to better describe content !4359
  • fs, ios, ais: minor refactoring & cleanup !4360
  • mountpath, fs disks (ref) !4361
  • fs: revise init and validation logic !4363
  • fs/vmd minor ref !4364
  • transport, streams: tweak global defaults !4365
  • metasync: not using nil SGL for payload (fix) !4366
  • metasync: delayed cleanup (fix) !4367
  • deployment: remove unused aisloader container !4368
  • minor changes in documentation and code !4369
  • ETL: collect stats for communicator !4371
  • metasync: remove CoW debug validation; fixes !4377
  • cos/utils: create-file now always creates write-only !4379
  • dsort: replace section reader !4380
  • ETL: pull docker images only if not present !4381
  • ais: minor ref (get, extract) !4383
  • metasync, BMD, SGL !4385
  • reuse SGL when range-reading w/checksum; DEADBEEF; miscellaneous !4389
  • compute redirect latency every so often (perf) !4393
  • GET and PUT: remove dry-run option !4399
  • Jenkins: upgrade minikube !4400
  • override backends at cluster startup !4401
  • golint is deprecated: using revive !4406
  • memsys: tune-up and refactoring !4409
  • lint: revive fixes (part two) !4410
  • transport/streams: Rx callbacks do not need (or depend on) http !4411
  • comments fixing and minor ref ATB !4412
  • list/range API; CLI comments/examples !4413
  • tests: limit the number of cleanup-generated errors !4414
  • ref: move "connection-refused" and similar exceptions !4415
  • PUT into mirrored bucket !4416
  • more lint !4417
  • rename/refactor xaction providers !4420
  • ref: xaction args !4421
  • xaction factory (ref, consistency) !4422
  • read-json: prevent superfluous response !4423
  • revise xaction renewal (internal) API !4424
  • lint/revive: enable unused-receiver rule !4428
  • revise xaction registry (part one) !4430
  • proxy: mem-pool API args; original bucket url !4431
  • run-provider tests must cleanup after themselves !4432
  • bucket lookups vs a missing backend provider !4433
  • introduce fullname() shortcut for: lom, transport header, archive !4436
  • api/object: close response body, close source reader !4438
  • list-buckets corner cases with no authentication and/or compiled-in backend !4441
Assets 8
Loading