Skip to content

Latest commit

 

History

History
336 lines (239 loc) · 13.6 KB

CHANGELOG.md

File metadata and controls

336 lines (239 loc) · 13.6 KB
Raw

Changelog

All notable changes to this project will be documented in this file.

[Unreleased]

Added

  • The lifetime of auto generated TLS certificates is now configurable with the role and roleGroup config property requestedSecretLifetime. This helps reducing frequent Pod restarts (#619).
  • Run a containerdebug process in the background of each HDFS container to collect debugging information (#629).

Fixed

  • BREAKING: Use distinct ServiceAccounts for the Stacklets, so that multiple Stacklets can be deployed in one namespace. Existing Stacklets will use the newly created ServiceAccounts after restart (#616).

[24.11.0] - 2024-11-18

Added

  • The operator can now run on Kubernetes clusters using a non-default cluster domain. Use the env var KUBERNETES_CLUSTER_DOMAIN or the operator Helm chart property kubernetesClusterDomain to set a non-default cluster domain (#591).

Changed

  • Reduce CRD size from 1.4MB to 136KB by accepting arbitrary YAML input instead of the underlying schema for the following fields (#574):
    • podOverrides
    • affinity

Fixed

  • An invalid HdfsCluster doesn't cause the operator to stop functioning (#594).

[24.7.0] - 2024-07-24

Added

  • Add experimental support for version 3.4.0 (#545, #557). We do NOT support upgrading from 3.3 to 3.4 yet!

Changed

  • Bump stackable-operator from 0.64.0 to 0.70.0 (#546).
  • Bump product-config from 0.6.0 to 0.7.0 (#546).
  • Bump other dependencies (#549).

Fixed

  • Revert changing the getting started script to use the listener class cluster-internal (#492) (#493).
  • Fix HDFS pods crashing on launch when any port names contain dashes (#517).
  • Add labels to ephemeral (listener) volumes. These allow stackablectl stack list to display datanode endpoints (#534)
  • Processing of corrupted log events fixed; If errors occur, the error messages are added to the log event (#536).

[24.3.0] - 2024-03-20

Added

  • Added rack awareness support via topology provider implementation (#429, #495).
  • More CRD documentation ([#433]).
  • Support for exposing HDFS clusters to clients outside of Kubernetes (#450).
  • Helm: support labels in values.yaml (#460).
  • Add support for OPA authorizer (#474).

Changed

  • Use new label builders (#454).
  • Change the liveness probes to use the web UI port and to fail after one minute (#491).
  • Update the getting started script to use the listener class cluster-internal (#492).

Removed

  • [BREAKING] .spec.clusterConfig.listenerClass has been split to .spec.nameNodes.config.listenerClass and .spec.dataNodes.config.listenerClass, migration will be required when using external-unstable (#450, #462).
  • [BREAKING] Removed legacy node selector on roleGroups (#454).
  • Change default value of dfs.ha.nn.not-become-active-in-safemode from true to false (#458).
  • Removed support for Hadoop 3.2 (#475).

Fixed

  • Include hdfs principals dfs.journalnode.kerberos.principal, dfs.namenode.kerberos.principal and dfs.datanode.kerberos.principal in the discovery ConfigMap in case Kerberos is enabled (#451).
  • User provided env overrides now work as expected (#499).

[23.11.0] - 2023-11-24

Added

  • Default stackableVersion to operator version (#381).
  • Configuration overrides for the JVM security properties, such as DNS caching (#384).
  • Support PodDisruptionBudgets (#394).
  • Support graceful shutdown (#407).
  • Added support for 3.2.4, 3.3.6 (#409).

Changed

  • vector 0.26.0 -> 0.33.0 (#378, #409).
  • Let secret-operator handle certificate conversion (#392).
  • operator-rs 0.44.0 -> 0.55.0 (#381, #394, #404, #405, #409).
  • Consolidate Rust workspace members (#425).

Fixed

  • Don't default roleGroup replicas to zero when not specified (#402).
  • [BREAKING] Removed field autoFormatFs, which was never read (#422).

Removed

  • Removed support for 3.3.1, 3.3.3 (#409).

[23.7.0] - 2023-07-14

Added

  • Add support for enabling secure mode with Kerberos (#334).
  • Generate OLM bundle for Release 23.4.0 (#350).
  • Missing CRD defaults for status.conditions field (#354).
  • Set explicit resources on all containers (#359).
  • Support podOverrides (#368).

Changed

  • Operator-rs: 0.40.2 -> 0.44.0 (#349, #372).
  • Use 0.0.0-dev product images for testing (#351)
  • Use testing-tools 0.2.0 (#351)
  • Run as root group (#353).
  • Added kuttl test suites (#364)
  • Increase the size limit of the log volumes (#372)

[23.4.0] - 2023-04-17

Added

  • Deploy default and support custom affinities (#319).
  • Added OLM bundle files (#328).
  • Extend cluster resources for status and cluster operation (paused, stopped) (#337).
  • Cluster status conditions (#339).

Changed

  • [Breaking] Moved top level config option to clusterConfig (#326).
  • [BREAKING] Support specifying Service type. This enables us to later switch non-breaking to using ListenerClasses for the exposure of Services. This change is breaking, because - for security reasons - we default to the cluster-internal ListenerClass. If you need your cluster to be accessible from outside of Kubernetes you need to set clusterConfig.listenerClass to external-unstable (#340).
  • operator-rs 0.36.0 -> 0.40.2 (#326, #337, #341, #342).
  • Use build_rbac_resources from operator-rs (#342).

Fixed

  • Avoid empty log events dated to 1970-01-01 and improve the precision of the log event timestamps (#341).

Removed

  • Removed the --debug flag for HDFS container start up (#332).

[23.1.0] - 2023-01-23

Added

  • Log aggregation added (#290).
  • Support for multiple storage directories (#296).

Changed

  • [BREAKING] Use Product image selection instead of version. spec.version has been replaced by spec.image (#281).
  • Updated stackable image versions (#271).
  • Fix the previously ignored node selector on role groups (#286).
  • operator-rs 0.25.2 -> 0.30.2 (#276, #286, #290).
  • Replaced thiserror with snafu (#290).

[0.6.0] - 2022-11-07

Added

  • Orphaned resources are deleted (#249)
  • Support Hadoop 3.3.4 (#250)

Changed

  • operator-rs 0.24.0 -> 0.25.2 (#249).

Fixed

  • Set specified resource request and limit on namenode main container (#259).

[0.5.0] - 2022-09-06

Changed

  • Include chart name when installing with a custom release name (#205).
  • Added OpenShift compatibility (#225).
  • Add recommended labels to NodePort services (#240).

[0.4.0] - 2022-06-30

Added

Changed

  • operator-rs 0.10.0 -> 0.15.0 (#130, #134, #148).
  • HADOOP_OPTS for jmx exporter specified to HADOOP_NAMENODE_OPTS, HADOOP_DATANODE_OPTS and HADOOP_JOURNALNODE_OPTS to fix cli tool (#148).
  • [BREAKING] Specifying the product version has been changed to adhere to ADR018 instead of just specifying the product version you will now have to add the Stackable image version as well, so version: 3.5.8 becomes (for example) version: 3.5.8-stackable0.1.0 (#180)

[0.3.0] - 2022-02-14

Added

  • Monitoring scraping label prometheus.io/scrape: true (#104).

Changed

  • Complete rewrite to use StatefulSets, hostPath volumes and the Kubernetes overlay network. (#68)
  • operator-rs 0.9.0 → 0.10.0 (#104).

[0.2.0] - 2021-11-12

  • operator-rs 0.3.0 → 0.4.0 (#20).
  • Adapted pod image and container command to docker image (#20).
  • Adapted documentation to represent new workflow with docker images (#20).

[0.1.0] - 2021-10-27

Changed

  • Switched to operator-rs tag 0.3.0 (#13)