[Auto-Release-Pipeline] Python Auto Release Pipeline #17730

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

msyyc merged 59 commits into Azure:master from msyyc:auto-release-debug

Apr 1, 2021

scripts/auto_release/CHANGELOG.md

-Original file line number
+Diff line change
@@ -0,0 +1,5 @@
+    # Release History
+    ## 1.0.0b1 (data_format)
+    * Initial Release

scripts/auto_release/PythonSdkLiveTest.yml

-Original file line number
+Diff line change
@@ -0,0 +1,87 @@
+    # Live Test For Python SDK
+    name: $(BASE_BRANCH)
+    trigger:
+      branches:
+        exclude:
+        - '*'
+    jobs:
+    - job: LiveTestPython38
+      displayName: Live Test Python 3.8
+      timeoutInMinutes: 1500
+      strategy:
+        maxParallel: 5
+      pool:
+        vmImage: 'ubuntu-18.04'
+      steps:
+        - task: UsePythonVersion@0
+          inputs:
+            versionSpec: '3.8'
+            addToPath: true
+            architecture: 'x64'
+        - bash: |
+            script_path=$(pwd)/scripts/auto_release
+            cd ..
+            git config --global user.email "PythonSdkPipelines"
+            git config --global user.name "PythonSdkPipelines"
+            # clone(REPO: https://github.com/Azure/azure-sdk-for-python.git, USR_NAME: Azure, USR_TOKEN: xxxxxxxxxxxxx)
+            mkdir azure-sdk-for-python
+            git clone ${REPO:0:8}$(USR_NAME):$(USR_TOKEN)@${REPO:8} $(pwd)/azure-sdk-for-python
+            # create virtual env
+            python -m venv venv-sdk
+            source venv-sdk/bin/activate
+            output_path=$(pwd)/venv-sdk
+            pip install packaging
+            pip install -r $script_path/livetest_package.txt
+            # import env variable
+            export AZURE_TEST_RUN_LIVE=true
+            export TENANT_ID=$(ENV_TENANT_ID)
+            export CLIENT_ID=$(ENV_CLIENT_ID)
+            export CLIENT_SECRET=$(ENV_CLIENT_SECRET)
+            export SUBSCRIPTION_ID=$(ENV_SUBSCRIPTION_ID)
+            export AZURE_TENANT_ID=$(ENV_TENANT_ID)
+            export AZURE_CLIENT_ID=$(ENV_CLIENT_ID)
+            export AZURE_CLIENT_SECRET=$(ENV_CLIENT_SECRET)
+            export AZURE_SUBSCRIPTION_ID=$(ENV_SUBSCRIPTION_ID)
+            # run
+            cd azure-sdk-for-python
+            python $script_path/main.py $(BASE_BRANCH) "$script_path" "$output_path"
+            # judge
+            if [ ! -f "$output_path/output.txt" ]; then
+              echo "output.txt does not exist, pipeline fail!!!"
+              exit 1
+            fi
+            test_result=""
+            if [ -f "$output_path/live_test_fail.txt" ]; then
+              test_result="Live test fail, detailed info is in pipeline log(search keyword FAILED)!!!\n"
+            fi
+            # create PR
+            new_branch=`sed -n '1p' $output_path/output.txt`
+            target_branch=`sed -n '2p' $output_path/output.txt`
+            curl \
+              --user "anything:$(USR_TOKEN)" \
+              -d "{\
+                      \"title\":\"[AutoRelease] $new_branch(Do not merge)\",\
+                      \"body\":\"$test_result Please Add the link issue \",\
+                      \"head\":\"$(USR_NAME):$new_branch\",\
+                      \"base\":\"$target_branch\"\
+                  }" \
+                  https://api.github.com/repos/Azure/azure-sdk-for-python/pulls
+            echo "\'[AutoRelease] $new_branch \' has been created!!!"
+            # if test fail, still push and crete PR. But pipeline would fail to remind user
+            if [ -f "$output_path/live_test_fail.txt" ]; then
+              echo "please fix failure test!!! \'[AutoRelease] $new_branch \' has been created!!!"
+              exit 1
+            fi

scripts/auto_release/livetest_folder_link.py

-Original file line number
+Diff line change
@@ -0,0 +1,124 @@
+    # ServiceName:SdkFolder
+    FOLDER_LINK={
+      'advisor' : 'advisor',
+      'devspaces' : 'aks',
+      'alertsmanagement' : 'alertsmanagement',
+      'apimanagement' : 'apimanagement',
+      'appconfiguration' : 'appconfiguration',
+      'applicationinsights' : 'applicationinsights',
+      'appplatform' : 'appplatform',
+      'web' : 'appservice',
+      'attestation' : 'attestation',
+      'authorization' : 'authorization',
+      'automanage' : 'automanage',
+      'automation' : 'automation',
+      'azurestack' : 'azurestack',
+      'baremetalinfrastructure' : 'baremetalinfrastructure',
+      'batch' : 'batch',
+      'billing' : 'billing',
+      'botservice' : 'botservice',
+      'cdn' : 'cdn',
+      'cognitiveservices' : 'cognitiveservices',
+      'commerce' : 'commerce',
+      'communication' : 'communication',
+      'compute' : 'compute',
+      'imagebuilder' : 'compute',
+      'vmwarecloudsimple' : 'compute',
+      'confluent' : 'confluent',
+      'consumption' : 'consumption',
+      'containerinstance' : 'containerinstance',
+      'containerregistry' : 'containerregistry',
+      'containerservice' : 'containerservice',
+      'core' : 'core',
+      'datalake-nspkg' : 'core',
+      'nspkg' : 'core',
+      'cosmosdb' : 'cosmos',
+      'documentdb' : 'cosmos',
+      'costmanagement' : 'costmanagement',
+      'customproviders' : 'customproviders',
+      'databox' : 'databox',
+      'databoxedge' : 'databoxedge',
+      'databricks' : 'databricks',
+      'datadog' : 'datadog',
+      'datafactory' : 'datafactory',
+      'datalake-analytics' : 'datalake',
+      'datalake-store' : 'datalake',
+      'datamigration' : 'datamigration',
+      'datashare' : 'datashare',
+      'deploymentmanager' : 'deploymentmanager',
+      'devtestlabs' : 'devtestlabs',
+      'digitaltwins' : 'digitaltwins',
+      'edgegateway' : 'edgegateway',
+      'eventgrid' : 'eventgrid',
+      'eventhub' : 'eventhub',
+      'hanaonazure' : 'hanaonazure',
+      'hdinsight' : 'hdinsight',
+      'healthcareapis' : 'healthcareapis',
+      'hybridcompute' : 'hybridcompute',
+      'hybridkubernetes' : 'hybridkubernetes',
+      'iotcentral' : 'iothub',
+      'iothub' : 'iothub',
+      'iothubprovisioningservices' : 'iothub',
+      'keyvault' : 'keyvault',
+      'kubernetesconfiguration' : 'kubernetesconfiguration',
+      'kusto' : 'kusto',
+      'labservices' : 'labservices',
+      'loganalytics' : 'loganalytics',
+      'logic' : 'logic',
+      'machinelearningcompute' : 'machinelearning',
+      'machinelearningservices' : 'machinelearning',
+      'maintenance' : 'maintenance',
+      'managedservices' : 'managedservices',
+      'managementgroups' : 'managementgroups',
+      'managementpartner' : 'managementpartner',
+      'maps' : 'maps',
+      'marketplaceordering' : 'marketplaceordering',
+      'media' : 'media',
+      'mixedreality' : 'mixedreality',
+      'monitor' : 'monitor',
+      'netapp' : 'netapp',
+      'dns' : 'network',
+      'frontdoor' : 'network',
+      'network' : 'network',
+      'privatedns' : 'network',
+      'notificationhubs' : 'notificationhubs',
+      'operationsmanagement' : 'operationsmanagement',
+      'peering' : 'peering',
+      'policyinsights' : 'policyinsights',
+      'powerbidedicated' : 'powerbidedicated',
+      'powerbiembedded' : 'powerbiembedded',
+      'rdbms' : 'rdbms',
+      'recoveryservices' : 'recoveryservices',
+      'recoveryservicesbackup' : 'recoveryservices',
+      'redhatopenshift' : 'redhatopenshift',
+      'redis' : 'redis',
+      'regionmove' : 'regionmove',
+      'relay' : 'relay',
+      'reservations' : 'reservations',
+      'resourcemover' : 'resourcemover',
+      'msi' : 'resources',
+      'resource' : 'resources',
+      'resourcegraph' : 'resources',
+      'scheduler' : 'scheduler',
+      'search' : 'search',
+      'security' : 'security',
+      'securityinsight' : 'securityinsight',
+      'serialconsole' : 'serialconsole',
+      'servermanager' : 'servermanager',
+      'servicebus' : 'servicebus',
+      'servicefabric' : 'servicefabric',
+      'signalr' : 'signalr',
+      'sql' : 'sql',
+      'sqlvirtualmachine' : 'sql',
+      'storage' : 'storage',
+      'storagecache' : 'storage',
+      'storageimportexport' : 'storage',
+      'storagesync' : 'storage',
+      'streamanalytics' : 'streamanalytics',
+      'subscription' : 'subscription',
+      'support' : 'support',
+      'synapse' : 'synapse',
+      'timeseriesinsights' : 'timeseriesinsights',
+      'trafficmanager' : 'trafficmanager',
+      'workloadmonitor' : 'workloadmonitor',
+    }

scripts/auto_release/livetest_package.txt

Original file line number	Diff line number	Diff line change
		@@ -0,0 +1,2 @@
		azure-identity
		python-dotenv==0.15.0

scripts/auto_release/livetest_package_compute_track2.txt

Original file line number	Diff line number	Diff line change
		@@ -0,0 +1 @@
		azure-storage-blob

scripts/auto_release/livetest_package_hdinsight_track1.txt

-Original file line number
+Diff line change
@@ -0,0 +1,4 @@
+    azure-keyvault==4.1.0
+    azure-keyvault-certificates==4.2.1
+    azure-keyvault-keys==4.2.0
+    azure-keyvault-secrets==4.2.0

scripts/auto_release/livetest_package_hdinsight_track2.txt

-Original file line number
+Diff line change
@@ -0,0 +1,4 @@
+    azure-keyvault==4.1.0
+    azure-keyvault-certificates==4.2.1
+    azure-keyvault-keys==4.2.0
+    azure-keyvault-secrets==4.2.0

scripts/auto_release/livetest_package_monitor_track1.txt

-Original file line number
+Diff line change
@@ -0,0 +1,6 @@
+    azure-mgmt-storage
+    azure-mgmt-eventhub
+    azure-mgmt-loganalytics
+    azure-mgmt-compute
+    azure-mgmt-network
+    azure-mgmt-logic

scripts/auto_release/livetest_package_monitor_track2.txt

-Original file line number
+Diff line change
@@ -0,0 +1,6 @@
+    azure-mgmt-storage
+    azure-mgmt-eventhub
+    azure-mgmt-loganalytics
+    azure-mgmt-compute==14.0.0
+    azure-mgmt-network
+    azure-mgmt-logic

scripts/auto_release/livetest_package_network_track2.txt

-Original file line number
+Diff line change
@@ -0,0 +1,3 @@
+    azure-mgmt-compute==14.0.0
+    azure-mgmt-storage==11.2.0
+    azure-mgmt-privatedns==0.1.0

scripts/auto_release/livetest_package_resource_track2.txt

Original file line number	Diff line number	Diff line change
		@@ -0,0 +1,2 @@
		azure-mgmt-managementgroups
		azure-mgmt-msi

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Auto-Release-Pipeline] Python Auto Release Pipeline #17730

Uh oh!

Diff view

Diff view

There are no files selected for viewing

Uh oh!