Finetuning Extension code #6459

achauhan-scc · 2026-01-07T10:30:34Z

This pull request introduces a new Azure AI Fine Tuning extension for the azd CLI, providing a well-structured foundation for fine-tuning workflows, multi-vendor support, and robust build tooling. The changes include a comprehensive architecture summary, build scripts for multiple platforms, example configuration files for various fine-tuning methods, and initial documentation and metadata.

Extension Architecture and Design:

Added a detailed implementation summary in IMPLEMENTATION_SUMMARY.md, outlining the folder structure, interfaces, domain models, provider and service layers, and next steps for development. This document clarifies separation of concerns, import rules, and testability for future contributors.

Build and CI Tooling:

Introduced cross-platform build scripts: build.sh (Bash) and build.ps1 (PowerShell) for building the extension binaries for multiple OS/architecture targets, including logic for versioning and commit tracking. Added a CI-specific build script ci-build.ps1 with advanced build flags and code coverage options. [1] [2] [3]

Configuration and Example Files:

Added example YAML configuration files for supervised, DPO (Direct Preference Optimization), and reinforcement learning fine-tuning scenarios, demonstrating how to set up and customize jobs for different use cases. [1] [2] [3]

Documentation and Metadata:

Created initial documentation files: README.md describing the extension, changelog.md for release history, and extension.yaml defining extension metadata, capabilities, and usage examples for the azd CLI. [1] [2] [3]

These changes lay the groundwork for a scalable, multi-vendor fine-tuning extension, enabling rapid development and future enhancements.

* adding draft for fine tuning * adding service target * fixing root command format * cleaning unused commands and adding operation/sub-operation commands * adding more details to command * fixes for relative path * adding registry entry * adding git download * adding 0.0.3 * fixing bug in deploy * adding printing format * re-structuring code * adding 0.0.5 * 0.0.6 * adding low level design details * fixing ext for build * adding restructured code * reverting any registry changes

…ronment and validation utils (#6430) * initial changes * Add retry util for exponential backoff with jitter strategy * Clean-up * Standardize CLI text to lowercase conventions, and remove redundant error messages * Address comments * Add common util for fetch environment variables * Cosmetic changes * Cosmetic changes 2 * Fix runtime error * Fix error message format

* Create command for ft cli * handling null pointer for state * removing changes from old converter and yaml logic * pr review changes + scheme implementation for job params * a few formatting changes * removing ofAuto value for hyperparameters * more formatting changes * adding command line parameters + formatting * minor merge fixes

* Adding pipeline scripts * Adding pipeline scripts * fixing version path * fixing build command

* adding init command * update version

* Adding pipeline scripts * Adding pipeline scripts * fixing version path * fixing build command * Djurek/test-network-isolation (#6455) * Update 1es-redirect.yml * Trivial change to test pipeline * Show GOPROXY * Use golang internalModuleProxy --------- Co-authored-by: Daniel Jurek <[email protected]>

* adding init command * update version * cleaning some code

Copilot

Pull request overview

This PR introduces a comprehensive Azure AI Fine Tuning extension for the azd CLI, establishing a well-architected foundation for fine-tuning workflows with multi-vendor support. The implementation follows a three-layer architecture (Domain Models, Service Layer, Provider Layer) with clear separation of concerns.

Key Changes:

Added complete extension architecture with domain models, services, and provider interfaces
Implemented cross-platform build scripts and CI/CD pipeline configuration
Included example YAML configurations for supervised, DPO, and reinforcement learning fine-tuning
Provided comprehensive architecture documentation and implementation guides

Reviewed changes

Copilot reviewed 41 out of 42 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
`eng/pipelines/templates/steps/setup-go.yml`	Added GOPROXY environment variable logging for debugging
`eng/pipelines/templates/stages/1es-redirect.yml`	Enhanced pipeline configuration with golang proxy, network isolation, and SDL controls
`eng/pipelines/release-ext-azure-ai-finetune.yml`	New CI/CD pipeline definition for the extension
`cli/azd/extensions/azure.ai.finetune/version.txt`	Version file for the extension (0.0.6-preview)
`cli/azd/extensions/azure.ai.finetune/pkg/models/*.go`	Domain models for fine-tuning jobs, deployments, errors, and requests
`cli/azd/extensions/azure.ai.finetune/internal/utils/*.go`	Utility functions for time formatting, status display, retry logic, parsing, and environment handling
`cli/azd/extensions/azure.ai.finetune/internal/services/*.go`	Service layer interfaces and implementations for business logic
`cli/azd/extensions/azure.ai.finetune/internal/providers/*.go`	Provider layer with OpenAI and Azure implementations
`cli/azd/extensions/azure.ai.finetune/internal/cmd/*.go`	CLI commands for init, operations, validation, and version
`cli/azd/extensions/azure.ai.finetune/main.go`	Extension entry point
`cli/azd/extensions/azure.ai.finetune/go.mod`	Go module dependencies
`cli/azd/extensions/azure.ai.finetune/extension.yaml`	Extension metadata and configuration
`cli/azd/extensions/azure.ai.finetune/examples/*.yaml`	Example configurations for different fine-tuning methods
`cli/azd/extensions/azure.ai.finetune/design/*.md`	Architecture documentation and implementation summary
`cli/azd/extensions/azure.ai.finetune/build.*`	Cross-platform build scripts
`cli/azd/extensions/azure.ai.finetune/ci-build.ps1`	CI-specific build script with advanced flags
`cli/azd/extensions/azure.ai.finetune/changelog.md`	Release history
`cli/azd/extensions/azure.ai.finetune/README.md`	Extension documentation

Note: Due to the large scope of this PR with 30+ new files, I've conducted a comprehensive architectural review. The code demonstrates good separation of concerns and follows the repository's coding standards. All files include proper copyright headers, and the architecture is well-documented.

cli/azd/extensions/azure.ai.finetune/internal/utils/parser.go

cli/azd/extensions/azure.ai.finetune/extension.yaml

cli/azd/extensions/azure.ai.finetune/README.md

cli/azd/extensions/azure.ai.finetune/extension.yaml

cli/azd/extensions/azure.ai.finetune/internal/cmd/init.go

cli/azd/extensions/azure.ai.finetune/internal/utils/common.go

cli/azd/extensions/azure.ai.finetune/internal/services/finetune_service.go

Copilot

Pull request overview

Copilot reviewed 41 out of 42 changed files in this pull request and generated 4 comments.

cli/azd/extensions/azure.ai.finetune/internal/utils/common.go

cli/azd/extensions/azure.ai.finetune/main.go

cli/azd/extensions/azure.ai.finetune/internal/services/finetune_service.go

cli/azd/extensions/azure.ai.finetune/internal/utils/parser.go

…n.yaml Co-authored-by: JeffreyCA <[email protected]>

cli/azd/extensions/azure.ai.finetune/internal/cmd/init.go

wbreza

Looks great overall - just a few minor comments and questions before approving.

cli/azd/extensions/azure.ai.finetune/examples/fine-tuning-dpo.yaml

cli/azd/extensions/azure.ai.finetune/internal/cmd/init.go

cli/azd/extensions/azure.ai.finetune/internal/utils/retry.go

cli/azd/extensions/azure.ai.finetune/extension.yaml

eng/pipelines/templates/stages/1es-redirect.yml

eng/pipelines/templates/steps/setup-go.yml

* Updating parseGithubUrl func * updating resource prompt logic * copilot suggestion to remove unused variable Co-authored-by: Copilot <[email protected]> * gh copilot suggestion Co-authored-by: Copilot <[email protected]> --------- Co-authored-by: Copilot <[email protected]>

* adding init command * update version * cleaning some code * updating readme

…ure-dev into Model-Customization-Dev

…Customization-Dev

…6485) * Using oss go-retry package * fixing retry count

* adding init command * update version * cleaning some code * updating readme * allowing fine tuning routes to be overriden by envrionment variables

* adding init command * update version * cleaning some code * updating readme * allowing fine tuning routes to be overriden by envrionment variables * fixing spell check issues

cli/azd/extensions/azure.ai.finetune/go.mod

JeffreyCA · 2026-01-09T18:01:51Z

@microsoft-github-policy-service rerun

Copilot

Pull request overview

Copilot reviewed 42 out of 43 changed files in this pull request and generated no new comments.

rajeshkamal5050 · 2026-01-10T07:04:05Z

/check-enforcer override

achauhan-scc and others added 8 commits December 24, 2025 10:27

Refactoring jobs show command to align with the LLD (#6434)

4e01756

Build and Release Pipelines for Finetuning CLI (#6449)

62a90c5

* Adding pipeline scripts * Adding pipeline scripts * fixing version path * fixing build command

adding init command (#6442)

53d2524

* adding init command * update version

Cleaning code to raise a PR to main (#6457)

b562fd0

* adding init command * update version * cleaning some code

Copilot AI review requested due to automatic review settings January 7, 2026 10:30

achauhan-scc requested review from JeffreyCA, danieljurek, hemarina, rajeshkamal5050, tg-msft, vhvb1989, wbreza and weikanglim as code owners January 7, 2026 10:30

microsoft-github-policy-service bot assigned achauhan-scc Jan 7, 2026

Copilot started reviewing on behalf of achauhan-scc January 7, 2026 10:31 View session

Copilot AI reviewed Jan 7, 2026

View reviewed changes

ZubaeyrMSFT added 2 commits January 7, 2026 18:48

updating version to 0.0.7-preview (#6462)

eacfee5

Rename changelog.md to CHANGELOG.md

481edde

JeffreyCA reviewed Jan 7, 2026

View reviewed changes

cli/azd/extensions/azure.ai.finetune/internal/utils/parser.go Show resolved Hide resolved

cli/azd/extensions/azure.ai.finetune/extension.yaml Show resolved Hide resolved

JeffreyCA reviewed Jan 7, 2026

View reviewed changes

JeffreyCA requested a review from Copilot January 7, 2026 17:28

Copilot started reviewing on behalf of JeffreyCA January 7, 2026 17:29 View session

Copilot AI reviewed Jan 7, 2026

View reviewed changes

ZubaeyrMSFT and others added 3 commits January 8, 2026 14:30

adding copyright header text

5155d1c

applying pr review suggestion: remove providers section from extensio…

a738c5f

…n.yaml Co-authored-by: JeffreyCA <[email protected]>

updating version.txt to 0.0.8-preview

16eab72

ZubaeyrMSFT added 2 commits January 8, 2026 15:37

updating cspell.yaml

9c39857

Updating finetune word in global cspell.yaml

59530fa

vhvb1989 reviewed Jan 8, 2026

View reviewed changes

wbreza reviewed Jan 8, 2026

View reviewed changes

ZubaeyrMSFT and others added 10 commits January 9, 2026 09:54

Updating extension name in read me file. (#6483)

6d1becb

* adding init command * update version * cleaning some code * updating readme

resolving review comments

6d288aa

Merge branch 'Model-Customization-Dev' of https://github.com/Azure/az…

408d746

…ure-dev into Model-Customization-Dev

resolving review comments

9a7c06d

using arm resourceId parser

92d7b8c

Merge branch 'main' of https://github.com/Azure/azure-dev into Model-…

f73698b

…Customization-Dev

Finetuning CLU - Using OSS package go-retry instead of custom logic (#…

da93fca

…6485) * Using oss go-retry package * fixing retry count

Allowing user to override the fine tuning route (#6484)

e8962f5

* adding init command * update version * cleaning some code * updating readme * allowing fine tuning routes to be overriden by envrionment variables

spell check fix (#6486)

6cd886a

* adding init command * update version * cleaning some code * updating readme * allowing fine tuning routes to be overriden by envrionment variables * fixing spell check issues

JeffreyCA reviewed Jan 9, 2026

View reviewed changes

cli/azd/extensions/azure.ai.finetune/go.mod Show resolved Hide resolved

JeffreyCA approved these changes Jan 9, 2026

View reviewed changes

wbreza approved these changes Jan 9, 2026

View reviewed changes

danieljurek approved these changes Jan 10, 2026

View reviewed changes

achauhan-scc requested review from ZubaeyrMSFT, Copilot and vhvb1989 January 10, 2026 06:55

Copilot started reviewing on behalf of achauhan-scc January 10, 2026 06:55 View session

achauhan-scc enabled auto-merge (squash) January 10, 2026 06:58

Copilot AI reviewed Jan 10, 2026

View reviewed changes

rajeshkamal5050 approved these changes Jan 10, 2026

View reviewed changes

achauhan-scc merged commit a86b5ca into main Jan 10, 2026
24 checks passed

JeffreyCA mentioned this pull request Jan 12, 2026

Updating formatting for list and show commands as per specs #6493

Closed

danieljurek mentioned this pull request Jan 15, 2026

Cleanup: Remove unnecessary logging #6533

Merged

Finetuning Extension code #6459

Finetuning Extension code #6459

Uh oh!

Conversation

achauhan-scc commented Jan 7, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

wbreza left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

JeffreyCA commented Jan 9, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

rajeshkamal5050 commented Jan 10, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

9 participants