Merge changes from internal (#7038)

* Merged PR 54952: Getting ready for the 10.0 stable release. Flowing .NET Servicing

#### AI description  (iteration 1)
#### PR Classification
This PR updates dependency versions and build pipeline configurations to prepare for the .NET 10.0 stable release.

#### PR Summary
The changes update dependency and LTS versions (upgrading many from 9.0.10 to 9.0.11), enable release-specific flags, and streamline the build pipelines for servicing.
- **`eng/Version.Details.xml` and `eng/Versions.props`**: Upgraded various dependency versions and LTS numbers and set stabilization flags (e.g., `StabilizePackageVersion` to true, `DotNetFinalVersionKind` to release).
- **`azure-pipelines.yml`**: Removed the code coverage stage to simplify the CI pipeline.
- **`eng/pipelines/templates/BuildAndTest.yml`**: Added tasks to set up private feed credentials and commented out integration tests that require authentication.
- **`NuGet.config`**: Revised package source configuration by removing package source mapping and adding new internal feed URLs.
- **`Directory.Build.props`**: Suppressed NU1507 warnings to accommodate internal branch configuration.
<!-- GitOpsUserAgent=GitOps.Apps.Server.pullrequestcopilot -->

* [MEDI] start producing NuGet packages (#7016)

* remove IsPackable=false, provide all mandatory properties for each package we want to ship

* add basic READMEs

* Update version numbers in AI changelogs (#7008)

* [MEDI] Don't stop document processing on enricher error (#7005)

* introduce EnricherOptions option bag

* implement batching

* don't validate results returned by IChatClient

* don't expose FileInfo as source via IngestionResult, as it could be Stream in the future. Just expose the document id

* Enricher failures should not fail the whole ingestion pipeline, as they are best-effort enhancements

* [MEDI] add PackageTags (#7022)

* Add MarkItDownMcpReader for MCP server support (#7025)

Co-authored-by: copilot-swe-agent[bot] <[email protected]>
Co-authored-by: Adam Sitnik <[email protected]>

* Image generation tool (#6749)

* Prototype of using ImageGenerationTool

* Handle DataContent returned from ImageGen

* React to rename and improve metadata

* Handle image_generation tool content from streaming

* Add handling for combining updates with images

* Add tests for new ChatResponseUpdateExtensions

* Rename ImageGenerationTool to HostedImageGenerationTool

* Remove ChatResponseUpdateCoalescingOptions

* Add ImageGeneratingChatClient

* Fix namespace of tool

* Replace traces of function calling

* More namepsace fix

* Enable editing

* Update to preview OpenAI with image tool support

* Temporary OpenAI feed

* Fix tests

* Add integration tests for ImageGeneratingChatClient

* Remove ChatRole.Tool -> Assistant workaround

* Remove use of private reflection for Image results

* Add ChatResponseUpdate.Clone

* Move all mutable state into RequestState object

* Adjust prompt to improve integration test reliability

* Refactor tool initialization

I verified that the tool creation is cached by ReflectionAIFunctionDescriptor

This change includes a small optimization to avoid additional allocation
around inserting tools into the options.

* Add integration tests for streaming

Fixes the removal of tool content - this was broken for streaming when
I changed removal to be based on callId.  We don't have the CallId yet
in the streaming case so we have to remove by name.

* React to changes and fix tests

* Address feedback

* Fix SkipTestException from ConditionalTheory

* Fix formatting

* Add back image replacement coalescing (removed in merge)

* Fix template tests and use new OpenAI

* Remove use of temporary staging nuget feed

* Address feedback

* Make ImageGeneratingChatClient use ImageGenerationTool*Content

* Remove ApplyUpdates and Coalesce ImageResults instead of DataContent.

* Workaround OpenAI issue where image data is not read for partial images.

openai/openai-dotnet#809

* Improved workaround

* Return ImageGenerationToolCallContent from OpenAI

* Add OpenAI image tool tests with representation of real traffic

* Correct the event sequence for streaming single image

* Fix some docs and refactor for clarity

* Make MEAI packages use 10.0 runtime packages (#7028)

* Make MEAI packages use 10.0 runtime packages

* Add back MEAI.Abstractions JsonSchemaExporter tests

* Address feedback

* Remove unneeded trimming suppression

* When using latest .NET packages, force System.Numerics.Tensors to 10.0 (for MEAI) (#7031)

* Add a new Microsoft.Agents.AI.Templates package with an aiagents-webapi project template (#7014)

* Initial Microsoft.Agents.AI.Templates structure

* Refine Microsoft.Agents.AI.Templates infrastructure

* Move project template infrastructure utilities into a shared folder

* Add the webapi-agents project template content with GitHub models

* Support parameterized AI Service Provider

* Rename to aiagents-webapi

* Support parameterized chatmodel and update docs with renames

* Add Snapshot tests

* Add aiagents-webapi snapshot tests

* Add aiagents-webapi execution tests (and component governance)

* Improve aiagents-webapi template parameters

* Apply suggestions from copilot code review

Co-authored-by: Copilot <[email protected]>

* Move shared ProjectTemplate infrastructure to not get included in Shared.Tests

* Fix the template sandbox / execution tests after moving infrastructure

* Ignore CA1716 warning about 'Shared' namespace in template tests

* Clean up template sandbox source/output

* Rename to "aiagent-webapi" and favor singular "Agent". Docs cleanup.

* Update templates dev doc to cover Microsoft.Agents.AI.Templates too

* Fix remaining template sandbox references with new paths

* Add a tool call in aiagent-webapi. Update workflow API usage for upcoming change.

Fix snapshots

* Exclude csproj.in file from template package

* Add a survey link to the aiagent-webapi template's generated readme

---------

Co-authored-by: Copilot <[email protected]>

* Use `Microsoft.Extensions.DataIngestion` in AI Chat Web template (#7023)

* Add Markdown support

* Remove PDF support

* Revert "Remove PDF support"

This reverts commit e1d066034962c9686bf8150984b6adf0e25846c8.

* Add 'Example_GPS_Watch.md'

* Add MEDI dependencies

* Revert "[MEDI] Remove collection key type workaround (#7010)"

This reverts commit a369be9.

* MEDI integration into chat template

* Remove PdfPig dependency

* Fix citation + normalize identifier path

* Undo changes to `M.E.DI.csproj`

* Update snapshots

* Update DataIngestion unit tests to handle keys as either strings or guids

* Update SK and fix MEDI version

* Remove SK workaround

* Fix sandbox paths to allow running tests multiple times

* Reliable data ingestion

* Enable MEDI tracing

* Simplify log message

* Add `PdfPigReader` for non-Aspire template

* Invert PdfPigReader exclusion condition

* Use Markitdown MCP

* Update snapshots

* Undo changes to `IngestionPipelineTests.cs`

* Update src/ProjectTemplates/Microsoft.Extensions.AI.Templates/src/ChatWithCustomData/ChatWithCustomData-CSharp.Web/Services/Ingestion/DocumentReader.cs

Co-authored-by: Jeff Handley <[email protected]>

* Update snapshots

* Improve template execution test failure output

* Support .NET 10 in aichatweb, using it by default

* Show a message when loading documents by loading docs as a separate tool

* disable the incremental ingestion

* map every PDF page to a single section

* drop SK dependency

* Add system prompt instructions for calling the LoadDocuments tool. Fix code formatting.

---------

Co-authored-by: Jeff Handley <[email protected]>
Co-authored-by: Adam Sitnik <[email protected]>

* Add Agent Framework DevUI into the aiagent-webapi template (#7026)

* Integrate DevUI into the aiagent-webapi project template

* Improve aiagent-webapi Program.cs per feedback.

* Remove --no-devui. Fix OpenAI clients. Augment execution test sandbox ignores.

* Rename to Microsoft.Agents.AI.ProjectTemplates

* Set Microsoft.Agents.AI package versions

* Simplify the GitHub and OpenAI key config vars for aiagent-webapi

* Sort package references

* Fix troubleshooting section in READMEs

* Revert MEAI.Templates change. Make launchSettings .gitignore more specific.

---------

Co-authored-by: Mackinnon Buck <[email protected]>

* Fix display of target frameworks in agents template. Hide the chat model textbox from the IDE template UI.

---------

Co-authored-by: Adam Sitnik <[email protected]>
Co-authored-by: Stephen Toub <[email protected]>
Co-authored-by: Copilot <[email protected]>
Co-authored-by: Eric StJohn <[email protected]>
Co-authored-by: Jeff Handley <[email protected]>
Co-authored-by: Jeff Handley <[email protected]>
Co-authored-by: Copilot <[email protected]>
Co-authored-by: Mackinnon Buck <[email protected]>

Author: 8 people

Directory.Build.targets

@@ -8,6 +8,11 @@
   <Import Project="$(MSBuildThisFileDirectory)\eng\MSBuild\Generators.targets" />
   <Import Project="$(MSBuildThisFileDirectory)\eng\MSBuild\ProjectStaging.targets" />
 
+  <PropertyGroup>
+    <!-- Workaround https://github.com/dotnet/sdk/issues/51265 - can be removed when updating to .NET 10.0.100 (GA) SDK -->
+    <RestoreEnablePackagePruning Condition="'$(TargetFrameworkIdentifier)' == '.NETFramework'">false</RestoreEnablePackagePruning>
+  </PropertyGroup>
+  
   <!-- Warning stuff -->
   <PropertyGroup>
     <MSBuildWarningsAsMessages>$(MSBuildWarningsAsMessages);NETSDK1138;MSB3270</MSBuildWarningsAsMessages>

eng/MSBuild/LegacySupport.props

@@ -2,7 +2,7 @@
   <ItemGroup Condition="'$(InjectCompilerFeatureRequiredOnLegacy)' == 'true' AND ('$(TargetFramework)' == 'net462' or '$(TargetFramework)' == 'netstandard2.0' or '$(TargetFramework)' == 'netcoreapp3.1')">
     <Compile Include="$(MSBuildThisFileDirectory)\..\..\src\LegacySupport\CompilerFeatureRequiredAttribute\*.cs" LinkBase="LegacySupport\CompilerFeatureRequiredAttribute" />
   </ItemGroup>
-  
+
   <ItemGroup Condition="'$(InjectRequiredMemberOnLegacy)' == 'true' AND ('$(TargetFramework)' == 'net462' or '$(TargetFramework)' == 'netstandard2.0' or '$(TargetFramework)' == 'netcoreapp3.1')">
     <Compile Include="$(MSBuildThisFileDirectory)\..\..\src\LegacySupport\RequiredMemberAttribute\*.cs" LinkBase="LegacySupport\RequiredMemberAttribute" />
   </ItemGroup>
@@ -47,10 +47,6 @@
     <Compile Include="$(MSBuildThisFileDirectory)\..\..\src\LegacySupport\StringSyntaxAttribute\*.cs" LinkBase="LegacySupport\StringSyntaxAttribute" />
   </ItemGroup>
 
-  <ItemGroup Condition="'$(InjectJsonSchemaExporterOnLegacy)' == 'true' AND ('$(TargetFramework)' == 'net462' or '$(TargetFramework)' == 'netstandard2.0' or '$(TargetFramework)' == 'netcoreapp3.1' or '$(TargetFramework)' == 'net6.0' or '$(TargetFramework)' == 'net7.0' or '$(TargetFramework)' == 'net8.0')">
-    <Compile Include="$(MSBuildThisFileDirectory)\..\..\src\Shared\JsonSchemaExporter\**\*.cs" LinkBase="Shared\EmptyCollections" />
-  </ItemGroup>
-
   <ItemGroup Condition="'$(InjectGetOrAddOnLegacy)' == 'true' AND ('$(TargetFramework)' == 'net462' or '$(TargetFramework)' == 'netstandard2.0')">
     <Compile Include="$(MSBuildThisFileDirectory)\..\..\src\LegacySupport\GetOrAdd\*.cs" LinkBase="LegacySupport\GetOrAdd" />
   </ItemGroup>

eng/Version.Details.xml

@@ -1,7 +1,7 @@
 <Project Sdk="Microsoft.Build.Traversal">
   <ItemGroup>
     <_SnapshotsToExclude Include="$(MSBuildThisFileDirectory)..\test\**\Snapshots\**\*.*proj" />
-    <_GeneratedContentToExclude Include="$(MSBuildThisFileDirectory)..\test\**\TemplateSandbox\**\*.*proj" />
+    <_GeneratedContentToExclude Include="$(MSBuildThisFileDirectory)..\test\**\ExecutionTestSandbox\**\*.*proj" />
 
     <!-- We recursively add all of the projects inside the src directory, except for the exclusions above -->
     <_ProjectsToBuild Include="$(MSBuildThisFileDirectory)..\src\**\*.csproj" />

eng/Versions.props

@@ -38,6 +38,7 @@
     <PackageVersion Include="System.IO.Pipelines" Version="$(SystemIOPipelinesNet10Version)" />
     <PackageVersion Include="System.Memory.Data" Version="$(SystemMemoryDataNet10Version)" />
     <PackageVersion Include="System.Net.Http.Json" Version="$(SystemNetHttpJsonNet10Version)" />
+    <PackageVersion Include="System.Numerics.Tensors" Version="$(SystemNumericsTensorsNet10Version)" />
     <PackageVersion Include="System.Text.Encodings.Web" Version="$(SystemTextEncodingsWebNet10Version)" />
     <PackageVersion Include="System.Text.Json" Version="$(SystemTextJsonNet10Version)" />
     <PackageVersion Include="System.Threading.Channels" Version="$(SystemThreadingChannelsNet10Version)" />

eng/build.proj

@@ -38,6 +38,7 @@
     <PackageVersion Include="System.IO.Pipelines" Version="$(SystemIOPipelinesVersion)" />
     <PackageVersion Include="System.Memory.Data" Version="$(SystemMemoryDataVersion)" />
     <PackageVersion Include="System.Net.Http.Json" Version="$(SystemNetHttpJsonVersion)" />
+    <PackageVersion Include="System.Numerics.Tensors" Version="$(SystemNumericsTensorsVersion)" />
     <PackageVersion Include="System.Text.Encodings.Web" Version="$(SystemTextEncodingsWebVersion)" />
     <PackageVersion Include="System.Text.Json" Version="$(SystemTextJsonVersion)" />
     <PackageVersion Include="System.Threading.Channels" Version="$(SystemThreadingChannelsVersion)" />

eng/packages/General-net10.props

@@ -18,6 +18,7 @@
     <PackageVersion Include="Microsoft.Extensions.VectorData.Abstractions" Version="$(MicrosoftExtensionsVectorDataAbstractionsVersion)" />
     <PackageVersion Include="Microsoft.IO.RecyclableMemoryStream" Version="3.0.0" />
     <PackageVersion Include="Microsoft.ML.Tokenizers" Version="$(MicrosoftMLTokenizersVersion)" />
+    <PackageVersion Include="ModelContextProtocol.Core" Version="0.4.0-preview.3" />
     <PackageVersion Include="Newtonsoft.Json" Version="13.0.3" />
     <PackageVersion Include="OllamaSharp" Version="5.1.9" />
     <PackageVersion Include="OpenAI" Version="2.6.0" />
@@ -32,7 +33,6 @@
     <PackageVersion Include="System.CommandLine" Version="2.0.0-beta4.22272.1" />
     <PackageVersion Include="System.ComponentModel.Annotations" Version="5.0.0" />
     <PackageVersion Include="System.Memory" Version="4.5.5" />
-    <PackageVersion Include="System.Numerics.Tensors" Version="$(SystemNumericsTensorsVersion)" />
     <PackageVersion Include="System.Private.Uri" Version="4.3.2" />
     <PackageVersion Include="System.Runtime.Caching" Version="$(SystemRuntimeCachingVersion)" />
     <PackageVersion Include="System.Runtime.CompilerServices.Unsafe" Version="6.1.0" />

eng/packages/General-net9.props

@@ -31,6 +31,12 @@
     <PackageVersion Include="Xunit.SkippableFact" Version="1.4.13" />
   </ItemGroup>
 
+  <PropertyGroup>
+    <!-- Warn NU1903 happens at restore time when a transitive dependency has been marked with a vulnerability in NuGet. Our test projects get it due to Transitive dependencies to System.Net.Http and System.Text.RegularExpressions.
+    Given both of those assemblies are in the shared framework, they won't be used at runtime and so we dismiss this warning for test projects. -->
+    <NoWarn>$(NoWarn);NU1903</NoWarn>
+  </PropertyGroup>
+
   <ItemGroup Condition="'$(TargetFramework)' == 'net462'">
     <PackageVersion Include="Microsoft.AspNetCore.Mvc" Version="2.1.3" />
     <PackageVersion Include="Microsoft.AspNetCore.Mvc.Testing" Version="2.1.3" />

eng/packages/General.props

@@ -1,6 +1,6 @@
 # Release History
 
-## NOT YET RELEASED
+## 9.10.2
 
 - Updated `AIFunctionFactory` to respect `[DisplayName(...)]` on functions as a way to override the function name.
 - Updated `AIFunctionFactory` to respect `[DefaultValue(...)]` on function parameters as a way to specify default values.