3.2.2

Feature

• [DSIP-39][parameter] Improvement startup parameters/global parameters/project parameters data type (#15967) @sdhzwc

Improvement

• merge schema 330 into 321 and change docs (#15582) (#15586) @zhongjiajie
• [Improvement][API] add PageInfo UT (#15622) @Gallardot
• [Doc] fix CNCF logo (#15634) @Gallardot
• [Doc][remote shell] missing remote shell doc for version 3.2.1 (#15660) @pegasas
• [Improvement-15603][API] When removing or modifying a workflow the system can check if there any tasks depend on it. (#15681) @calvinjiang
• [Improvement-15694][UI] After saving the task form the task node uses the wrong background color. (#15695) @calvinjiang
• [Improvement-15707][Master] Work out the issue that the workflow with a task dependency couldn't work well. (#15712) @calvinjiang
• [Improvement-15723][UI] Work out the issue that project preferences doesn't replace all places that they need to affect. (#15724) @calvinjiang
• [Improvement-15725][UI] The default option of project preferences can be clearable. (#15727) @calvinjiang
• [CI] Frontend ci require passed before merge (#15735) @SbloodyS
• [Bug][Worker] Replace jre with jdk (#15764) @Gallardot
• [Improvement][RemoteLogging] Move init into loghandler (#15780) @pegasas
• [Improvement] add resource full name check (#15786) @caishunfeng
• [Improvement-15744][parameter] project parameter add update time and update user id (#15745) @sdhzwc
• Remove dolphinscheduler-data-quality from dolphinscheduler-task-dataquality (#15791) @ruanwenjun
• [Improvement-15713][api]DataSource And UdfFunc list query use Enum code value rather than ordinal (#15714) @songwenyong
• [Improve] Fix typo on ProcessServiceImpl (#15817) @qingwli
• [Improvement][Api] Delete useless batchUpdateUdfFunc method (#15844) @qingwli
• [Fix-15866][Doc] Update the taobao npm mirror address (#15867) @xxzuo
• Add DSIP template (#15871) @ruanwenjun
• [DSIP-28] Donnot scan whole project beans under classpath (#15874) @ruanwenjun
• [DSIP-31] Reduce the connection pool size of hikari (#15890) @ruanwenjun
• [Improvement] Fix alert code smell (#15892) @qingwli
• Use workerNodeInfoWriteLock to update work node info (#15903) @DaqianLiao
• [Improvement-15919][datasource] Improvement datasource get name (#15920) @sdhzwc
• [Improvement-15910][UI] Supposed to provide a default value for the custom parallelism when using the mode of parallel execution. (#15912) @calvinjiang
• Optimizing the scope of RPC base classes (#15946) @ruanwenjun
• [DSIP-35][Alert] Refactor the alert thread model (#15932) @ruanwenjun
• [Improvement] Fix the git url command injection in pytorch task(#15873) (#15950) @cntigers
• Add link to ETCD/JDBC Registry Guideline (#15597) @pegasas
• Add unified integretion test for registry module (#15981) @ruanwenjun
• [Doc] Repair resource configuration exist typo (#15988) @dongyu6
• [Improvement] Use safe constructor with snake yaml (#15758) @EricGao888
• [Improvement][Monitor] Show master && worker Busy Or Normal Status and Show Commands table list (#15978) @qingwli
• [Improvement][Monitor] Add UT for montor (#15998) @qingwli
• Deprecated 2.0.9/3.0.6 upgrade test (#16012) @ruanwenjun
• docs: fix type in contribute.md (#16022) @jxbwhe
• [Improvement][Docs]Correction of Typos in the Chinese Document in appendix.md (#16033) @TianXinCoord
• [Fix] Fix audit log parma typo (#16077) @qingwli
• [Improvement][Helm] Make configmap of api/master/worker/alert configuration (#16058) @pegasas
• [Improvement-16125][dolphinscheduler-dist] Reduce binary distribution tarball file size (#16192) @zhuxt2015

Bugfix

• Fix recover pause workflowInstance may generate failover taskInstance (#15611) @ruanwenjun
• Fix out parameter may loss (#15617) @ruanwenjun
• [Bug][API] list paging missing totalpage (#15619) @Gallardot
• Fix Hive jdbc url (#15627) @xxzuo
• [Bug][dolphinscheduler-task-seatunnel] script resource file path error (#15621) @cqutwangyu
• [Bug] Fix can modify file which is not under resource path (#15652) @ruanwenjun
• [Bug] Fix task might be dispatched even if it has been killed (#15662) @ruanwenjun
• [Bug] [Worker] fix: create linux user with home dir (#15670) @zero-element
• [Fix-15639] [Master] parameterPassing is null case NPE (#15678) @liuchunhua
• [Fix-15679][UI] fix switch status button not show correctly (#15686) @liuchunhua
• [Fix][Master] Fix Potential danger in the event of a worker failover (#15689) @ZhongJinHacker
• [bug][Plugins]fix word spell error in readme.md (#15716) @ZhongJinHacker
• Fix the NullPointerException when "start param to overwrite global param" (#15677) @wustlz
• [CI] Fix ui build error (#15732) @SbloodyS
• [Fix-15698][UI] close the definition when opened in the new tab (#15736) @arlendp
• [CI] Fix frontend ci not trigger (#15749) @SbloodyS
• [Bug] Disable delete a specific workflow version when exist workflow instance under this version which is not finish (#15730) @ruanwenjun
• [Bug] Fix delay execution task will never be dispatched (#15751) @ruanwenjun
• [Bug] Fix Switch logic task doesn't check the branch exist (#15755) @ruanwenjun
• [Fix] add resource full name check (#15757) @caishunfeng
• [Fix-15771] Fix normal user can grant project permission (#15772) @silentxingtian
• [bug][ui] add missing datasource and update datasource id (#15776) @whhe
• [Bug] Fix TaskGroupCoordinator might cause OOM when there is a lot of waiting TaskGroupQueue (#15773) @ruanwenjun
• [Bug] Fix dependent task logic (#15795) @abzymeinsjtu
• [Bug] [Common] Fix typo on common.properties (#15806) @pegasas
• Fix cannot construct instance of StreamingTaskTriggerResponse (#15816) @atjiucheng
• [Improvement] Abnormal characters check (#15824) @pinkfloyds
• [Improvement] Modify python-gateway: enabled default to false. (#15825) @pinkfloyds
• [Fix-15787] Reuse code and solve the problem of complex SQL parsing exceptions in… (#15833) @xinxingi
• Fix ErrorCommand loss some fields in Command (#15847) @ruanwenjun
• Bind processId to construct CodeGenerator (#15848) @ruanwenjun
• Forbidden forcess success a task instance in a running workflow instance (#15855) @ruanwenjun
• [Bug] Fix QUARTZ table order is not correct in initialization schema (#15857) @ruanwenjun
• Change ssh heartbeat type to IGNORE (#15858) @ruanwenjun
• [FIX] Fix failure to recover stopped instance (#15880) @privking
• Fix queryByTypeAndJobId might error due to multiple result (#15883) @ruanwenjun
• Fix kill dynamic task doesn't kill the wait to run workflow instances (#15896) @ruanwenjun
• Fix auto create tennat concurrently will cause the task failed (#15909) @ruanwenjun
• Fix jar path is not correct in java task (#15906) @ruanwenjun
• [FIX] Completed tasks cannot be re-executed in a workflow instance (#15884) @privking
• [Fix-15937] Add tenantCode propagation to DynamicCommandUtils.createCommand (#15956) @stoplyy
• [fix-15907] Fix get remote shell exit code is incorrect (#15911) @Zzih96
• [Fix-15969] [Helm] No DB Nodes Exist (#15970) @Gallardot
• EMR task support replace params placeholder (#15975) @ruanwenjun
• docs: fix spelling (#15996) @jbampton
• Fix database schema change check failed with pg in ci (#15995) @ruanwenjun
• [Fix-15992] maintain slot index by iterate MasterPriorityQueue orderly (#15993) @coldestlin
• Fix workflow instance restart failed due to duplicate key in varpool (#16001) @ruanwenjun
• Use random port in registry IT (#16014) @ruanwenjun
• Fix rpc channel leak due to concurrent operation (#16021) @ruanwenjun
• Fix WorkerTaskExecutorThreadPool#isOverload is incorrect (#16027) @ruanwenjun
• [Fix][CI] fix the ci error of E2E-K8S-Execute (#16031) @rickchengx
• [Hotfix] Fix NettyRemotingClient might throw IllegalMonitorStateException (#16038) @ruanwenjun
• [Fix-16046][SqlTask] Fix Sql task use time type is incorrect (#16050) @yinxiaolog
• [helm] remove AppVersion from common labels (#16066) @Gallardot
• Revert "[Improvement] Abnormal characters check" (#16102) @ruanwenjun
• Fix task instance which status is dispatch will not be failover (#16107) @ruanwenjun
• Fix task nodes ...

3.2.1

Bugfix

• fix: Resource relate path invalid when tenant change (#15581)
• [fix][worker]:Fix the issue of missing disk usage reporting information in the worker (#15565)
• [Fix] Fix WorkflowInstance batch start failed will throw incorrect exception. (#15577)
• Fix create parent directory will cause FileAlreadyExistsException (#15576)
• Fix Recover WorkflowInstance will casue workflow Instance state is success but task insatnce is killed/paused (#15574)
• fix: data quality may fail in docker mode (#15563)
• fix: start param for wf not work (#15544)
• fix: ddl without drop exists (#14128)
• fix switch js (#15487)
• fix: data quality can not use (#15551)
• Fix createFile with permission will not work (#15556)
• [Bug][force-success] force success add end time (#15144)
• [Bug][Task Api] fix 'MACPATTERN' in ProcessUtils and cover all cases on MacOS in ProcessUtilsTest (#15480)
• Fix TaskGroupQueue will never be wakeup due to wakeup failed at one time (#15528)
• Exit JVM when OOM (#15538)
• Fix exception occur in RpcServer side, it will not be sent to RpcClient (#15536)
• front: When you edit a task in the task definition list, the front task list is displayed (#12819)
• [Fix] [Bug] Change default version of Workflow/TaskDefinition to 1 (#15498)
• [Bug] Fix a bug, When the worker service offline, workerNodeInfo cache in master cannot delete the offline worker (#15459)
• fix workflow will have same updatetime when import (#14810)
• [BUG] #15013 Fix retryInterval in RetryPolicy will never be used in RetryUtils (#15014)
• Throw IllegalArgumentException if parse time placeholder error (#15514)
• Fix PostgresqlDatabaseContainerProvider get Image is incorrect (#15434)
• [Bug][Api] Fix NPE when deleting a workflow instance (#15485)
• Directly Throw exception when taskInstancy log path is empty which log need to be queried (#15511)
• Fix notify failover WorkflowInstance will cause NPE (#15499)
• [HotFix] Fix createTaskInstanceWorkingDirectory failed if the old path exist (#15377)
• [bug] Exception when using host in ipv6 format (#14040)
• [Bug][Master]serial_wait strategy workflow unable to wake up (#15270)
• [BUG][Task] fix java task classpath (#15470)
• [Bug] [Audit log] Fix Audit log UI query error (#15427)
• [Bug][Registry] Optimizing waiting strategy (#15223)
• Set TaskGroupQueue updateTime when force start (#15510)
• TaskGroupPriority only compare When TaskGroup is same (#15486)
• Remove taskQueue and looper in worker (#15292)
• Display the resource file doesn't exist message in task create page (#15350)
• Recreate new TaskInstance Working Directory when exist in worker (#15358)
• [Bug] Close SSH session after remote shell finish (#15348)
• Fix check value rather than key in AbstractDataSourceProcessor#checkOther (#15351)
• Fix resource file usage(Delete Resource/ResourceUser which is deprecated)
• [Bug][Master] send ACK event timeout (#15346)
• Fix k8sTaskExecutionContext setting configYaml (#15116)
• [Fix #15129] [Dependent] The date rules of the dependent node are ambiguous. (#15289)
• Fix failover Master might not release taskGroup (#15287)
• [HotFix] Fix TaskOutputParameterParser might OOM if meed a bad output param expression (#15264)
• [Bug-15215][Api] non-admin should not modify tenantId and queue (#15254)
• Set the tenant as the owner in final stage (#15256)
• Use chown to set the file owner (#15240)
• [Fix] Change HTTP plugin timeout param to number type (#15234)
• fix switch condition (#15228)
• Fix docs style is incorrect by CI pass (#15167)
• Expire session when update user password (#15219)
• Fix home page workflow instance miss status (#15193)
• fix security issue (#15192)
• fix can't stop bug (#15191)
• Remove API Result in Service (#15181)
• Exclude DataSourceAutoConfiguration in worker server (#15169)
• [Bug] Fix TriggerRelationMapper cannot work due to miss DatabaseIdProvider (#15153)
• Fix spotless (#15164)
• Fix incorrect button display text (#15160)
• [Fix][Data Quality] Change t_ds_dq_rule_input_entry field name fix PostgreSQL not support value issue (#14992)
• fix missing 'KYUUBI' in droplist of datasource (#15140)
• [Bug] Fix endless loop (#15092)
• fix: execute sql error: datasource plugin 'doris' is not found。 (#15123)
• Fix confusing constant string for unit convertor (#15126)
• [fix-#11726] fix error when set connection proerty both in the URL and an argument (#15093)
• [Fix-15072][Resource Center] Non-admin user can not query resource recursively (#15097)
• [E2E][Bug] Fix k8s-e2e (#15098)
• Fix SqlTask cannot split the given sql when browser in windows (#15062)
• [Fix-15036] [API] Fix task definition edit doesn't work (#14801)
• remove sub workflow finish notify (#15057)
• Fix missing Kyuubi type in UI (#15051)
• [Fix-14885][pom] fix spotless format file path (#14889)
• Fix When the task instance status is 'STOP' (#14967)
• Revert "[Bug] [Resource] fix resource delete bug (#15003)
• [Bug] [Resource] fix resource delete bug (#15003)
• Delete File generated by UT (#15022)

Improvement

• [Improvement][UT] Improve Worker registry coverage (#15380)
• refactor comments & function name for confuse (#15546)
• [Improvement][HTTP] support custom rendering of http body (#15531)
• [improvement][api] Fix typo for controllers (#15438)
• [Feature-15475][DinkyTask] DinkyTask supports Dinky-1.0.0 and common sql (#15479)
• [Improvement][K8S]Optimize MDC for K8S tasks (#15390)
• Enable set ServerLoadProtection fot Master/Worker (#15439)
• [Feature] timed scheduler Improvement (#15449)
• [Improvement][E2E] add e2e javatask case (#15469)
• [Enhancement][API]Enhance mysql connection properties (#15433)
• [Improvement][E2E]e2e improve add workflow httpTask e2e case (#15420)
• Add config for defaultTenantEnabled (#15391)
• Use DefaultUncaughtExceptionHandler to log the uncached exception (#15496)
• adjust the sequence of alarm group and add validate (#15382)
• Use Druid to split sql (#15367)
• optimize add select filter (#15378)
• [Improvement][Helm] using helm-docs to generate docs automatically (#15299)
• [Improvement][K8S] Custom label of a K8S task can be passed to the pod (#15369)
• Optimize server startup log (#15362)
• [Improvement][E2E] support e2e compose v2 fix code style (#15325)
• [Improvement] Ensure that HttpUtils can only get result from certification URL (#15288)
• delete debugger (#15316)
• Set maxRows in SqlTask (#15342)
• [Feature-15146][dolphinscheduler-task-sqoop] add sqoop source/target type (#15146)
• [Feature-15248][dolphinscheduler-alert-plugins] add alert plugin aliyun-voice (#15248)
• [Improvement-15260][dolphinscheduler-datasource-hana] add hana related dependencies (#15260)
• fail-fast for dependent check (#15197)
• [Improvement] Move delay calculation to Master (#15278)
• Add dolphinscheduler-extract-common module (#15266)
• Support parse task output params under multiple log (#15244)
• [Improvement-15009][Parameter] Change project parameter value to text (#15010)
• Remove spring cache for dao (#15184)
• [Improvement] Clean up Scheduler logic (#15198)
• [Improvement][Alert] Add a test send feature when creating an alert instance (#15163)
• [Improvement][Helm] support task type filter (#15179)
• [Improvement][Resource Center] Display brief file name in file-details page (#15137)
• [Improvement][Alert] Add timeout params for HTTP plugin (#15174)
• [feature#14654] alert-spi support prometheus alertmanager (#15079)
• [Improvement][K8S] Remove ResourceQuota (#14991)
• [Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977)
• [DSIP-19] Support sagemaker connections in the connection center, as well as external connections to the connection center in sagemaker tasks (#14976)
• [DSIP-19] Support zeppelin connections in the connection center, as well as external connections to the connection center in zeppelin tasks (#14434)
• [Feature-14832][Listener]Implementation of Listener Mechanism (#14981)
• Remove mapper usage in tools (#15073)
• [Feature-14678][Master][UI]Dependent task parameter passing (#14702)
• Add IT for mysql5/postgresql16 initialize/upgrade (#15063)
• Add IT for dolphinscheduler-tools module (#15043)
• Set kubectl version to v1.28.3 (#15053)
• Add dolphinscheduler-dao-plugin module (#15019)
• [improvement][Resources] Improve details page return to the previous list page (#14951)
• [Improvement][Alert] Alert plugin enhance fail message (#15024)
• [Improvement][Registry][Jdbc] Add jdbc registry config in helm charts (#14431)
• [Improvement][Master] Calculate the remainTime then we set the delay execution. (#15012)

Document

• [Doc][Docker] fix typo on start with docker (#15534)
• [Doc] remove skywalking, update note (#15028)
• Change download url in backend.yml (#15526)
• [Doc][K8S] Add DS K8S Operator into k8s deployment character (#15516)
• Add guideline link into DolphinScheduler mail list (#15447)
• Remove unused cache-evict.png (#15220)
• [Doc-15500][Task] Update cli opts of spark and flink (#15501)
• doc write wrong,should be MinIO it's not MinION (#15395)
• [Doc]remove temporary markdown comments (#15385)
• doc: Classify docs to avoid misleading (#15282)
• Add deploy on Terraform on README (#15189)
• Modify the documentation that python task will not work properly when '\n' indicates the presence of a variable and needs to use 'repr(value)' (#15145)
• [Docs] fix typo (#15032)

Chore

• merge schema 330 into 321 and change docs (#15582)
• Set the workflow instance ready state to running in failover (#15572)
• cp: Reduce the size of tarball to continue ASF release (#15004)
• chore: Docs change for 3.2.1 release (#15539)
• [DS-15489][style]rename the vo object suffix (#15504)

3.1.9

What's Change

Bugfix

• [Bug-15215][Api] non-admin should not modify tenantId and queue #15254 @zhanqian-1993
• [Bug] fix switch condition #15228 @caishunfeng
• [Fix-14805] Task definition log may be written twice #15016 @HomminLee
• [Bug][Master] fix duplicate event, avoid event stacking #14986 @caishunfeng
• [Fix-14963] Fix the error of using shell task to obtain Home variable in Ubuntu system #14964 @zhuangchong
• [Fix-14729] fix problem with the command generated by the flink task #14902 @LiuCanWu
• Construct processInstance may NPE when master handling command #14888 @fuchanghai
• [Bug] [Mater] The process always runs when the process contains subprocess and params deliver #14856 @qingwli
• [Task] Change Seatunnel task run-mode to deploy-mode #14800 @zhangbaipeng
• fix(dolphinscheduler-alert): fix create http request error #14793 @hunter-cloud09
• [Fix-14627][dolphinscheduler-ui] Fix there are too many child node in sub_process, it cannot to filter by keywords #14770 @chenshuai1995
• [Fix-14546] seatunnel unable submit spark job to spark #14617 @Yhr-N
• [Fix]Solve the deadlock problem caused by queuing #13191 @dahai1996
• after a submit failure, stop the processInstance to avoid an endless loop #13051 @fuchanghai

Doc

• doc: Classify docs to avoid misleading #15282 @zhongjiajie
• [Docs] fix typo #15032 @liunaijie
• Fix a typo in English development-environment-setup.md #14767 @wangzheyuan

Full Changelog: 3.1.8...3.1.9

3.2.0

New release for version 3.2.0

Feature

Click to expand

• [Feature-10683][Task Plugin] Add Java Task Plugin. (#10689) @106umao
• [DSIP-13][Feature]github_resource_plugin (#11831) @xdu-chenrj
• [Feat][UI] Set up UI setting component in profile page (#11226) @lynn-illumio
• [Feature][task-plugins] aws datasync task plugins (#11865) @Tianqi-Dotes
• [DSIP-13][python]Sub problem: gitlab, OSS and S3 resource plug-ins (#12025) @xdu-chenrj
• [python] Add resource plugin for python, dataX, CustomDataX and Sql (#12135) @xdu-chenrj
• [Feature] Optimizing data source centers (#12292) @labbomb
• [Feature-10495][Resource Center] Resource Center Refactor (#12076) @EricPyZhou
• [Feature-12040][api][ui] Add authorization management of read and write permissions for project center (#12048) @GavinGYM
• [Feature-12040][docs] Update Granted Permissions Guide for PR#12048 (#12587) @GavinGYM
• [Improvement][Task] Improved way to collect yarn job's appIds (#12197) @Radeity
• [Feature-6586][Server]add some ds process definition demo when init (#11759) @amaoisnb
• [Feature][Task] Transfer files between tasks (#12552) @jieguangzhou
• [Feature-12827] add icon in idea (#12829) @muggleChen
• Add minio as demo storage for helm charts (#12861) @kezhenxu94
• [feature][task] Add Kubeflow task plugin for MLOps scenario (#12843) @jieguangzhou
• [feat] Support set execute type to pydolphinscheduler (#12871) @zhongjiajie
• [Feature-12526][Api] add dynamic task function: shell task (#12840) @Tianqi-Dotes
• [Feature-12456][task plugin] Add new task plugin for apache linkis (#12693) @shangeyao
• [improve]Source skip check (#12900) @insist777
• [Feature][DataSource]Add trino datasource plugin (#12911) @insist777
• [Feature][Master] Run single task in workflow instance (#13103) @jieguangzhou
• Add StarRocks datasource (#13204) @ruanwenjun
• [Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks (#13194) @jieguangzhou
• [Feature][task-plugins-12820] azure azure-sql datasource plugins (#13209) @Tianqi-Dotes
• Add Terraform deploy manifests for quick setup in AWS (#13252) @kezhenxu94
• [Feature-9467] add DAMENG DataSource (#12860) @lenian
• [Feature][Deployment] Add KEDA autoscaler support for worker deployment when deployed in K8S cluster (#13367) @EricGao888
• [feature][api-datasource]add redshift auth mode to get connection by access key (#13379) @Tianqi-Dotes
• [Feature][Api] When use api to run a process we want get processInstanceId (#13184) @qianli2022
• [Feature][task]add azure datafactory task type (#13417) @Tianqi-Dotes
• Flinksql support standalone deploy mode (#13495) @shenyun
• [Fix-13434][Resource Center] fix the NPE when use OSS as the resource center (#13435) @rickchengx
• [Feature][Resource Center] One-time migration script for unmanaged resources (#13512) @Radeity
• [Feature-11195][UI] Add re-upload feature for resource files (#11203) @sketchmind
• [Feature-13331][Remote Logging] Add support for writing task logs to OSS (#13332) @rickchengx
• [Feature-13354][deploy] Add configurable busybox image in values.yaml… (#13560) @qindongliang
• [Feature-13511] Submit Spark task directly on Kubernetes (#13550) @Radeity
• [Feature][DataSource] add oceanbase datasource (#13675) @whhe
• bug: Python add online_schedule for workflow control schedule state (#13551) @zhongjiajie
• [Feature][Metrics] Tag workflow related metrics with process definition code (workflow id) (#13640) @EricGao888
• [Doc] Add OceanBase to supported list (#13700) @whhe
• [Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center (#13562) @rickchengx
• Add jdbc registry module (#13812) @ruanwenjun
• Use bootstrap user as the default tenant (#13825) @ruanwenjun
• [FEATURE][Task Plugin]Add remote-shell task plugin (#13801) @jieguangzhou
• [Improvement-13751][Worker] Support real-time pod log collection (#13752) @Radeity
• Support alert server HA (#13865) @ruanwenjun
• [Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage (#13777) @rickchengx
• Use percentage to represent memory/cpu usage (#13896) @ruanwenjun
• [Improvement-13824][Resource Center] User can only visit resources under tenant defaultPath (#13848) @Radeity
• [Feature][plugin] Support Kyuubi datasource (#13642) @zhaohehuhu
• [Feature][plugin] Add databend datasource in datasource plugin (#13866) @hantmac
• [Feature][Login] Add OAuth login (#8706) @Abingcbc
• [Feature] Support run all level dependent when complement (#11778) @stalary
• [Feature][plugin] Add snowflake datasource in datasource plugin (#13729) @zhaohehuhu
• [Feature-#14148][Task] Added status check interval and dependent failure policy parameters for dependent task nodes (#14150) @zhuangchong
• [Feature-14138][Metrics] Add metrics for api server (#14177) @rickchengx
• [Feature][UI] Support to view and manage all timing settings of a project. (#14178) @calvinjiang
• [Feature] Add project name/workflow definition name/instance id/task name to the built-in variables (#14099) @haibingtown
• [Feature][K8S Task] support node selector (#14126) @Radeity
• [Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters (#14127) @jieguangzhou
• [Feature][UI] Support CRUD of project-level parameters. (#14344) @calvinjiang
• [Feature-14404][datasource-plugin] add HANA datasource (#14404) @IT-Kwj
• [Feature][Api] LDAP SSL supports&& Add LDAP K8s configuration (#14349) @qingwli
• [Improvement-14318][UI] migrate version 2.x workflow definition d3 tree view to version 3.x (#14382) @yeahhhz
• [Feature-14421][K8S Task] Configurable image pull policy (#14426) @Radeity
• [Feature-14321][API] Support to complement data in descending or ascending order of date (#14450) @calvinjiang
• [Feature][Data Quality] Data Quality Support Choose Database (#14406) @qingwli
• [Feature-14542][K8S] add prometheus serviceMonitor (#14539) @Gallardot
• Support execute shell in different interceptor (#14582) @ruanwenjun
• [Feature-14505][UI] Support to set project-level preferences (#14573) @calvinjiang
• [Feature-14545][Master][UI]Cross workflow parameter passing (#14552) @Orange-Summer
• [Feature] doris add datasource (#14391) @xinxingi
• [Feature-13763][K8S Task] collect real-time log (#14379) @Radeity
• [Feature][Resource Center] Add support for Huawei Cloud OBS (#14643) @ediconss
• [RPC] Refactor the remote module. (#14776) @ruanwenjun
• [Feature][Helm] Supports deploying only partial components (#14985) @Gallardot

Improvement

Click to expand

• [Improvement-11773][api] Optimize the log printing of the api module according… (#11782) @guowei-su
• [Improvement][Test] Give an example on replacing Powermock with Mockito (#11588) @EricGao888
• [Improvement-11857][Spark] Remove the spark version of spark task (#11860) @rickchengx
• [Improvement][SQL Task]use default sql segment separator (#10869) @zhuxt2015
• [Improvement][Test] Remove powermock in dolphinscheduler-master module (#12143) @EricGao888
• [Improvement][Test] Remove powermock in service and server modules (#12164) @EricGao888
• [Improvement-12144] Remove powermock in dolphinschduler-api (#12169) @rickchengx
• [Improvement-11880][Hivecli] Improve the UI of HiveCli (#11882) @rickchengx
• [Improvement][Test] Remove the usage of powermock in datasource-plugin module (#12194) @EricGao888
• [Improvement][Test] Remove powermock from DatasyncTaskTest (#12270) @EricGao888
• [Improvement][Test] Fully remove the usage of powermock from the whole project (#12244) @EricGao888
• [Improvement][Test] Migrate all UT cases from jUnit4 to jUnit5 in task-plugin module as an example (#12299) @EricGao888
• [Improvement-12296][Test] Close static mock (#12300) @rickchengx
• [Improvement-12289][k8s] update the common.properties in values.yaml (#12290) @rickchengx
• [Migrate][Test] Migrate all UT cases from jUnit 4 to jUnit 5 in alert and api module (#12337) @EricGao888
• [improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module (#12328) @fuchanghai
• [Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules (#12352) @EricGao888
• [Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in common, service, and spi modules (#12363) @DarkAssassinator
• [Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom (#12311) @EricGao888
• [Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in master, worker, and remote modules (#12362) @DarkAssassinator
• [Migrate][Test] Migrate other UT cases from jUnit 4 to 5, change @ignore to @disable (#12382) @DarkAssassinator
• [Improvement] add presto in datax (#12371) @fuchanghai
• [Migrate][Test] Add Spotless step to check and block jUnit4 imports (#12398) @EricGao888
• [Improvement][Style] Fix remaining style errors and wildcard imports (#12412) @EricGao888
• [Improvement-12333][Test] Migrate all UT cases from jUnit 4 to jUnit 5 in microbench and e2e module (#12348) @rickchengx
• [Improvement-12446][CI] Run mvn spotless apply (#12447) @DarkAssassinator
• [Improvement][Style] Update spotless junit4 check scope (#12450) @EricGao888
• [Refactor] Migrate all command-related interface functions from ProcessServiceImpl (#12474) @DarkAssassinator
• Update the project introduction (#12501) @davidzollo
• [Improvement] add springdoc-openapi-ui (#12379) @fuchanghai
• [Refactor]migrate some task dao functions from ProcessServiceImpl to dao modules. (#12505) @DarkAssassinator
• [Refactor] Migrate all workergroup-related interface functions from ProcessServiceImpl (#12493) @DarkAssassinator
• Fix alert status spelling error (#12592) @qingwli
• [Improvement-12536][k8s] Support the command for the container in k8s task plugin (#12538) @rickchengx
• [Improvement][Install] Add ${zkRoot} description. ...

3.1.8

What's Change

Bugfix

• [Fix-#14537] the branch that needs to be executed overlaps with another branch, it may not be able to complete the normal execution #14563
• Use adhoc connection in sql/procedure task #14670
• [Fix][SeaTunnel] Fix wrong judgment condition when building parameters of seatunnel task node. #14594
• [Bug] [Seatunnel-Task] Run Mode defaults to run, and you cannot select a null value #14267
• [Fix-#14447]The judgment in k8sUtils#getPodLog is not accurate #14448
• [Fix-14441] [Bug] [Alarm Instance Manage] Search result list error #14444
• [Fix-14397][dao] the task node in the imported workflow definition was not displayed on the task definition page #14398
• [Bug] [Master] fix State event handle error, get a unknown exception, will retry this event with IndexOutOfBoundsException #14361
• [Fix-#14303][Master] workflow with sub_process task can't be stop when running #14343
• [Alert] [HTTP Plugin] Lose HTTP port #14341
• [Fix-#10340][UI] Fix resource center upload file timeout bug #14268
• [Bug][plugin]Fix: Correct the way to determine the yarn queue in Flink CommandLine and SQL mode #14237
• [Bug][API] Fix TreeView "Task Status" not show bug and compatibility with older versions use WorkflowExecutionStatus.name() #14207
• [Fix] default datax plugin, using RDBMS as default. #14204
• [Fix-#14008][registry] cache keep alive lease #14034
• [Fix-#11877][UI] Fix the problem that the environment cannot be deleted on the UI of some tasks #11878

Doc

• [Doc] Support Sqoop in Website #14435

chore

• [CI] [Test] Try to fix jar conficts #14407
• [NOTICE]Update the NOTICE year #14272

Full Changelog: 3.1.7...3.1.8

2.0.9

What's Change

Bugfix

• [Fix-13581][UI][2.0.9] Speed up the refresh of task status in process instance (#13587)
• [rollback-12488] Roll back the logic of execution complement failure stop (#13723)
• [Fix-13760] [server] When running the specified job and its downstream jobs, enable dry running of the specified job, causing the downstream jobs to dry run at the same time (#13961)
• [Fix-13814] [Built-in variable] shell task transfer param (#13974)

Full Changelog: 2.0.8...2.0.9

3.0.6

• [fix-#14086]The subprocess type node is always in the ready stop state #14087
• [Fix-13913][Master] syncMasterNodes does not make current slot correctly after zookeeper reconnect #14014

3.1.7

What's Change

Bugfix

• fix: Save task seatunnel error #14129
• [fix-#13940] add status of stop in class of TaskExecutionStatus (#14016)
• [Bug-13951 ][dolphinscheduler-service] StartParams is not applied when task is failover(RECOVER_TOLERANCE_FAULT_PROCESS CommandType) #13958
• [fix-#14169]The subprocess type node is always in the ready pause or ready stop state (#14170)
• [fix-11321][ui] fix create workflow contains chunjun node failed (#11979)
• make status and schedule publish status display together (issue-12834) (#12922)
• fix the select component on the page of workflow relation (#13805)

doc

• [Doc] Fix upgrade-schema.sh cannot load driver class (#14072)

Full Changelog: 3.1.6...3.1.7

3.1.6

What's Change

Bugfix

• [Fix-13928][UI] Fix repeat CustomParams input box #14029
• [Fix-13815][master] Fix dependent task incorrect timeout alerts #13822
• [Fix 13941]Fix replace time variable #13975
• [BUG][Data Quality] Fixing the incorrect DML statements in upgrade SQL. (#13960)
• [Fix-13780][api] Fix the problem of process instance DAG can't show dependent task #13823
• fix-13869: add return success judge #13873
• [Bug] [worker] WorkerConfig output is wrong #14001
• OracleSouce edited again, ConnectionType is null #13881
• [Fix-13596][Task Instance] Throw an error message to tell the user that the file cannot be found instead of NPE during task execution (#13878)
• [Fix-13828][api] Fix the problem of work groups have two defult records #13829
• Fix schedule time data primary key conflict when importing workflow definition (#13926)
• Fix item, workflow, and task parameters in dependent task nodes can be searched (#13918)
• fix: when sudo enable is false, execute command will failed (#13860)
• [Bug] [Cron] Parse corn expression error #13841

doc

• [doc] Change DinkyTask picture to english (#14061)
• [doc] Change readme and standalone docker quick start (#14002)
• [doc] Update resource local file system docs (#13982)
• [doc] Add hyperlink for pydolphinscheduler doc (#13907)

chore

• [E2E-Test] Try to fix flaky e2e test (#13971)
• Add release Helm Chart #13385
• docker auto push tag name (#13858)

Feature

• [Feature-13052][Task Plugin] Support Seatunnel flink-v2, spark-v2, seatunnel-engine (#13086)

Full Changelog: 3.1.5...3.1.6

3.1.5

What's Change

Bugfix

• [Fix-13657][Master]NPE caused by the execution of workflow with startNode and forbidden task (#13668)
• [Bug][Master] fix task failure continue (#13155)
• fix when the task details are not modified, the predecessor node cannot be modified (#13422)
• Fix when update scheduler will execute workflow #13285
• [Fix-11583][UI] Fix the API usage of gantt graph #13778
• [Fix][Alert] Fix when auth is false and user || pwd null can't send email excection #13761
• Fix Bug [Athena Datasource] datasource other params illegal (#13032)
• [fix][sql] Add unique key to process_definition_log avoid TooManyResultExpection #12503
• [Fix][Data Quality]Dataquality Spark Get Datasource Password Error When Password Has $ #13643
• [BUG][UI] Flink task display right version and deploy mode (#13628)
• [Bug-13666] remove WORKER_GROUP in values.yaml #13718
• Fix webex teams alert plugin null exception error (#13591)
• feat: Python return datasource object and allow filter by type (#13616)
• feat: Python add online_schedule for workflow control schedule state (#13551)
• [fix] Remove tenant arg in workflow definition (#13212)
• [improve-#13678] add filter in method of setMainJarName (#13748)
• fix: python gateway tenant code query

chore

• Publish Docker images to docker hub when released #13631

Full Changelog: 3.1.4...3.1.5