Skip to content

Enable live test for remote MCP#1630

Merged
chidozieononiwu merged 14 commits intomicrosoft:mainfrom
chidozieononiwu:LiveTestForRemoteMCP
Feb 14, 2026
Merged

Enable live test for remote MCP#1630
chidozieononiwu merged 14 commits intomicrosoft:mainfrom
chidozieononiwu:LiveTestForRemoteMCP

Conversation

@chidozieononiwu
Copy link
Member

@chidozieononiwu chidozieononiwu commented Feb 3, 2026 •
edited
Loading

What does this PR do?

  • Extends the test infrastructure to also start the Azure MCP Server in HTTP mode (--transport http).
  • Updates Live test pipeline to also test in http transport mode

GitHub issue number?

#1572

Pre-merge Checklist

  • Required for All PRs
    • Read contribution guidelines
    • PR title clearly describes the change
    • Commit history is clean with descriptive messages (cleanup guide)
    • Added comprehensive tests for new/modified functionality
    • Updated servers/Azure.Mcp.Server/CHANGELOG.md and/or servers/Fabric.Mcp.Server/CHANGELOG.md for product changes (features, bug fixes, UI/UX, updated dependencies)
  • For MCP tool changes:
    • One tool per PR: This PR adds or modifies only one MCP tool for faster review cycles
    • Updated servers/Azure.Mcp.Server/README.md and/or servers/Fabric.Mcp.Server/README.md documentation
    • Validate README.md changes using script at eng/scripts/Process-PackageReadMe.ps1. See Package README
    • Updated command list in /servers/Azure.Mcp.Server/docs/azmcp-commands.md and/or /docs/fabric-commands.md
    • Run .\eng\scripts\Update-AzCommandsMetadata.ps1 to update tool metadata in azmcp-commands.md (required for CI)
    • For new or modified tool descriptions, ran ToolDescriptionEvaluator and obtained a score of 0.4 or more and a top 3 ranking for all related test prompts
    • For tools with new names, including new tools or renamed tools, update consolidated-tools.json
    • For new tools associated with Azure services or publicly available tools/APIs/products, add URL to documentation in the PR description
  • Extra steps for Azure MCP Server tool changes:
    • Updated test prompts in /servers/Azure.Mcp.Server/docs/e2eTestPrompts.md
    • 👉 For Community (non-Microsoft team member) PRs:
      • Security review: Reviewed code for security vulnerabilities, malicious code, or suspicious activities before running tests (crypto mining, spam, data exfiltration, etc.)
      • Manual tests run: added comment /azp run mcp - pullrequest - live to run Live Test Pipeline

@github-project-automation github-project-automation bot moved this to Untriaged in Azure MCP Server Feb 3, 2026
scbedd
scbedd approved these changes Feb 11, 2026
View reviewed changes
Copy link
Contributor

@scbedd scbedd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nothing is jumping out at me. @hallipr please give this a look through to be certain that I'm not missing anything.

@chidozieononiwu
Copy link
Member Author

chidozieononiwu commented Feb 11, 2026

/azp run mcp - pullrequest - live

@azure-pipelines
Copy link

azure-pipelines bot commented Feb 11, 2026

Azure Pipelines successfully started running 1 pipeline(s).

anuchandy
anuchandy approved these changes Feb 12, 2026
View reviewed changes
Copy link
Member

@anuchandy anuchandy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks Dozie!. Summarizing our offline chat.

  1. Live tests run in both stdio and HTTP mode (using UseHostingEnvironmentIdentity).
  2. Recorded tests run in stdio only.
  3. One server is spun up per test class - an improvement from the earlier setup, which spun up one server per test within a class.

@chidozieononiwu chidozieononiwu mentioned this pull request Feb 12, 2026
Merged
@chidozieononiwu
Copy link
Member Author

chidozieononiwu commented Feb 12, 2026

/azp run mcp - pullrequest - live

@azure-pipelines
Copy link

azure-pipelines bot commented Feb 12, 2026

Azure Pipelines successfully started running 1 pipeline(s).

@chidozieononiwu
Copy link
Member Author

chidozieononiwu commented Feb 13, 2026

/azp run mcp - pullrequest - live

@azure-pipelines
Copy link

azure-pipelines bot commented Feb 13, 2026

Azure Pipelines successfully started running 1 pipeline(s).

@chidozieononiwu
Copy link
Member Author

chidozieononiwu commented Feb 14, 2026

/azp run mcp - pullrequest - live

@azure-pipelines
Copy link

azure-pipelines bot commented Feb 14, 2026

Azure Pipelines successfully started running 1 pipeline(s).

@chidozieononiwu chidozieononiwu merged commit be40237 into microsoft:main Feb 14, 2026
52 of 65 checks passed
@github-project-automation github-project-automation bot moved this from In Progress to Done in Azure MCP Server Feb 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot Copilot left review comments

@anuchandy anuchandy anuchandy approved these changes

@scbedd scbedd scbedd approved these changes

@matteing matteing Awaiting requested review from matteing matteing is a code owner

@vladimisms vladimisms Awaiting requested review from vladimisms vladimisms is a code owner

@ankushbindlish2 ankushbindlish2 Awaiting requested review from ankushbindlish2 ankushbindlish2 is a code owner

@kszobi kszobi Awaiting requested review from kszobi kszobi is a code owner

@alzimmermsft alzimmermsft Awaiting requested review from alzimmermsft alzimmermsft is a code owner

@jongio jongio Awaiting requested review from jongio jongio is a code owner

@xiangyan99 xiangyan99 Awaiting requested review from xiangyan99 xiangyan99 is a code owner

@achyuth-ms achyuth-ms Awaiting requested review from achyuth-ms achyuth-ms is a code owner

@ericshape ericshape Awaiting requested review from ericshape ericshape is a code owner

@jeremyfrosti jeremyfrosti Awaiting requested review from jeremyfrosti jeremyfrosti is a code owner

@JonathanCrd JonathanCrd Awaiting requested review from JonathanCrd JonathanCrd is a code owner

@HaofanLiao HaofanLiao Awaiting requested review from HaofanLiao HaofanLiao is a code owner

@JialinXin JialinXin Awaiting requested review from JialinXin JialinXin is a code owner

@conniey conniey Awaiting requested review from conniey conniey is a code owner

@pablocastro pablocastro Awaiting requested review from pablocastro pablocastro is a code owner

@philon-msft philon-msft Awaiting requested review from philon-msft philon-msft is a code owner

@sharedferret sharedferret Awaiting requested review from sharedferret sharedferret is a code owner

@qianwens qianwens Awaiting requested review from qianwens qianwens is a code owner

@anannya03 anannya03 Awaiting requested review from anannya03 anannya03 is a code owner

@kk-src kk-src Awaiting requested review from kk-src kk-src is a code owner

@srnagar srnagar Awaiting requested review from srnagar srnagar is a code owner

@meirloichter meirloichter Awaiting requested review from meirloichter meirloichter is a code owner

@rebecca-makar rebecca-makar Awaiting requested review from rebecca-makar rebecca-makar is a code owner

@wolfgang-desalvador wolfgang-desalvador Awaiting requested review from wolfgang-desalvador wolfgang-desalvador is a code owner

@danield137 danield137 Awaiting requested review from danield137 danield137 is a code owner

@prvavill prvavill Awaiting requested review from prvavill prvavill is a code owner

@vcolin7 vcolin7 Awaiting requested review from vcolin7 vcolin7 is a code owner

@weng5e weng5e Awaiting requested review from weng5e weng5e is a code owner

@jairmyree jairmyree Awaiting requested review from jairmyree jairmyree is a code owner

@ivarprudnikov ivarprudnikov Awaiting requested review from ivarprudnikov ivarprudnikov is a code owner

@taicchoumsft taicchoumsft Awaiting requested review from taicchoumsft taicchoumsft is a code owner

@g2vinay g2vinay Awaiting requested review from g2vinay g2vinay is a code owner

@KarishmaGhiya KarishmaGhiya Awaiting requested review from KarishmaGhiya KarishmaGhiya is a code owner

@vurhanau vurhanau Awaiting requested review from vurhanau vurhanau is a code owner

@feiskyer feiskyer Awaiting requested review from feiskyer feiskyer is a code owner

@gossion gossion Awaiting requested review from gossion gossion is a code owner

Assignees

@chidozieononiwu chidozieononiwu

Labels

tools-ACR tools-Aks tools-AppConfig AppConfig tools-AppService tools for app service tools-Authorization tools-Communication tools for Azure communication services tools-ConfidentialLedger tools-CosmosDB tools-Deploy tools-EventGrid tools-FileShares tools-Foundry Azure AI Foundry tools-FunctionApp tools-Grafana Azure Managed Grafana tools-ISV Azure Liftr / ISV tools-KeyVault tools-Kusto tools-LoadTesting tools-managedlustre Azure Managed Lustre tools-Marketplace tools-Monitor tools-Postgres PostgreSQL tools-Redis tools-ResourceHealth tools-Search Search tools-ServiceBus tools-SignalR Azure SignalR tools-Speech tools-SQL tools-Storage tools-StorageSync tools-VirtualDesktop Azure Virtual Desktop service tools-Workbooks

Projects

Azure MCP Server
Status: Done

Milestone

2026-02

Development

Successfully merging this pull request may close these issues.

4 participants

@chidozieononiwu @anuchandy @scbedd @joshfree