Getting "Unable to load processor: TfsTeamProjectConfig"

[yves-grenier]

Downloaded the source, built solution and upon running I am getting this error. Please help.

13:33:56 INF] Note: Exception data cannot be 100% guaranteed to not leak production data
[13:33:56 INF] --------------------------------------
[13:33:56 INF] Start Time: 10/18/2023 13:33:56
[13:33:56 INF] Running with args: execute
[13:33:56 INF] OSVersion: Microsoft Windows NT 10.0.19045.0
[13:33:56 INF] Version: 0.0.0.1
[13:34:01 INF] Latest version detected as 14.0.1.0
[13:34:01 INF] Telemetry: True
[13:34:01 DBG] Hosting starting
[13:34:01 INF] Application started. Press Ctrl+C to shut down.
[13:34:01 INF] Hosting environment: Production
[13:34:01 INF] Content root path: U:\docs\AZURE Migration\source\azure-devops-migration-tools-14.0.1\src\MigrationTools.ConsoleCore\bin\Debug\net7.0
[13:34:01 INF] Press Ctrl+C to shut down.
[13:34:01 DBG] Hosting started
[13:34:01 INF] Config Found, creating engine host
[13:34:04 WRN] Unable to load Processor: TfsTeamProjectConfig
[13:34:05 FTL] Your configuration file is malformed and cant be loaded!
[13:34:05 ERR] Error resolving type specified in JSON 'TfsTeamProjectConfig'. Path 'Source.$type', line 6, position 35.
[13:34:05 ERR] How to Solve: Malformed Json is usually a result of editing errors. Validate that your configuration.json is valid Json!

U:\docs\AZURE Migration\source\azure-devops-migration-tools-14.0.1\src\MigrationTools.ConsoleCore\bin\Debug\net7.0\devopsmigration.exe (process 20164) exited with code -1.
Press any key to close this window . . .

[MrHinsh]

You are not using a valid config!

[13:34:04 WRN] Unable to load Processor: TfsTeamProjectConfig
[13:34:05 FTL] Your configuration file is malformed and cant be loaded!

Please provide your config as well as what it is that you are trying to do!

Your config file, as provided below, is not valid JSON. You cant use a \ in a JSON file and need to escape it using an extra one, like \\.

You will also have a problem with NodeBasePaths as it also needs escaped not just for JSON but also for REGEX.

[yves-grenier]

I decided to investigate (download the source, build, run and debug) because TestCases descriptions fields are not being migrated for me when using the most recent exe.

But I am getting the above mentioned error when I build the exe myself. Could this be a DLL issue? The config file content is next. I tried many well formed configs and still the same problem. Thanks for your reply.

{
"ChangeSetMappingFile": null,
"LogLevel": "Debug",
"Source": {
"$type": "TfsTeamProjectConfig",
"Collection": "https://dev.azure.com/***/",
"Project": "ERP Playpen",
"ReflectedWorkItemIDFieldName": "Custom.ReflectedWorkItemId",
"AllowCrossProjectLinking": false,
"AuthenticationMode": "Prompt",
"PersonalAccessToken": "",
"PersonalAccessTokenVariableName": "",
"LanguageMaps": {
"AreaPath": "Area",
"IterationPath": "Iteration"
}
},
"Target": {
"$type": "TfsTeamProjectConfig",
"Collection": "https://dev.azure.com/****/",
"Project": "ERP Playpen",
"ReflectedWorkItemIDFieldName": "Custom.ReflectedWorkItemId",
"AllowCrossProjectLinking": false,
"AuthenticationMode": "Prompt",
"PersonalAccessToken": "",
"PersonalAccessTokenVariableName": "",
"LanguageMaps": {
"AreaPath": "Area",
"IterationPath": "Iteration"
}
},
"FieldMaps": [
{
"$type": "MultiValueConditionalMapConfig",
"WorkItemTypeName": "",
"sourceFieldsAndValues": {
"Field1": "Value1",
"Field2": "Value2"
},
"targetFieldsAndValues": {
"Field1": "Value1",
"Field2": "Value2"
}
},
{
"$type": "FieldSkipMapConfig",
"WorkItemTypeName": "",
"targetField": "TfsMigrationTool.ReflectedWorkItemId"
},
{
"$type": "FieldValuetoTagMapConfig",
"WorkItemTypeName": "",
"sourceField": "Microsoft.VSTS.CMMI.Blocked",
"pattern": "Yes",
"formatExpression": "{0}"
},
{
"$type": "TreeToTagMapConfig",
"WorkItemTypeName": "",
"toSkip": 3,
"timeTravel": 1
}
],
"GitRepoMapping": null,
"CommonEnrichersConfig": null,
"Processors": [
{
"$type": "WorkItemMigrationConfig",
"Enabled": false,
"ReplayRevisions": true,
"PrefixProjectToNodes": false,
"UpdateCreatedDate": true,
"UpdateCreatedBy": true,
"WIQLQueryBit": " AND [System.WorkItemType] IN ('Test Case','Test Suite', 'Test Plan') AND [System.Tags] CONTAINS 'transfer'",
"WIQLOrderBit": "[System.ChangedDate] desc",
"LinkMigration": true,
"AttachmentMigration": true,
"AttachmentWorkingPath": "c:\tmp\WorkItemAttachmentWorkingFolder\",
"FixHtmlAttachmentLinks": true,
"SkipToFinalRevisedWorkItemType": false,
"WorkItemCreateRetryLimit": 5,
"FilterWorkItemsThatAlreadyExistInTarget": true,
"PauseAfterEachWorkItem": false,
"AttachmentMaxSize": 480000000,
"AttachRevisionHistory": false,
"LinkMigrationSaveEachAsAdded": false,
"GenerateMigrationComment": true,
"WorkItemIDs": null,
"MaxRevisions": 0,
"UseCommonNodeStructureEnricherConfig": false,
"StopMigrationOnMissingAreaIterationNodes": true,
"NodeBasePaths": [
"Product\Area\Path1",
"Product\Area\Path2"
],
"AreaMaps": {},
"IterationMaps": {},
"MaxGracefulFailures": 0,
"SkipRevisionWithInvalidIterationPath": false,
"SkipRevisionWithInvalidAreaPath": false
},
{
"$type": "TestPlansAndSuitesMigrationConfig",
"Enabled": false,
"PrefixProjectToNodes": false,
"OnlyElementsWithTag": "transfer",
"TestPlanQueryBit": "PlanName = 'WCAG 2.x Accessibility Master Test Plan'",
"RemoveAllLinks": false,
"MigrationDelay": 0,
"UseCommonNodeStructureEnricherConfig": false,
"NodeBasePaths": [],
"AreaMaps": null,
"IterationMaps": null,
"RemoveInvalidTestSuiteLinks": false,
"FilterCompleted": false
}
],
"Version": "13.1",
"workaroundForQuerySOAPBugEnabled": false,
"WorkItemTypeDefinition": {
"sourceWorkItemTypeName": "targetWorkItemTypeName"
},
"Endpoints": {
"InMemoryWorkItemEndpoints": [
{
"Name": "Source",
"EndpointEnrichers": null
},
{
"Name": "Target",
"EndpointEnrichers": null
}
]
}
}

[MrHinsh]

"Your configuration file is malformed and cant be loaded!"

[MrHinsh]

Use `devopsmigration init" to create a well-formed config and run that. If it works, then the config above is not valid and you should use the well-formed one and add the bits that you need.

[MrHinsh]

Your config is not even valid JSON!

Any \ need to be escaped by using \\.

[yves-grenier]

Thanks Martin: I have tried using a generated config file with the same results. Here is one I tried and still getting the same. I think the json parser fails for "whatever reason" and the error displayed is not coherent with the real issue. I have not managed to run this with any config.

{
"Version": "0.0",
"LogLevel": "Verbose",
"workaroundForQuerySOAPBugEnabled": false,
"Source": {
"$type": "TfsTeamProjectConfig",
"Collection": "https://dev.azure.com/nkdagility-preview/",
"Project": "migrationSource1",
"ReflectedWorkItemIDFieldName": "Custom.ReflectedWorkItemId",
"AuthenticationMode": "Prompt",
"AllowCrossProjectLinking": false,
"PersonalAccessToken": "rrsne75npwj5ctn5vm337nrxiqlvdkfmcbkqrubl6ushts6syi5a",
"LanguageMaps": {
"AreaPath": "Area",
"IterationPath": "Iteration"
}
},
"Target": {
"$type": "TfsTeamProjectConfig",
"Collection": "https://dev.azure.com/nkdagility-preview/",
"Project": "migration Target 1",
"ReflectedWorkItemIDFieldName": "nkdScrum.ReflectedWorkItemId",
"AuthenticationMode": "Prompt",
"AllowCrossProjectLinking": false,
"PersonalAccessToken": "rrsne75npwj5ctn5vm337nrxiqlvdkfmcbkqrubl6ushts6syi5a",
"LanguageMaps": {
"AreaPath": "Area",
"IterationPath": "Iteration"
}
},
"FieldMaps": [
{
"$type": "TreeToTagMapConfig",
"WorkItemTypeName": "*",
"toSkip": 3,
"timeTravel": 1
}
],
"WorkItemTypeDefinition": {
"sourceWorkItemTypeName": "targetWorkItemTypeName"
},
"GitRepoMapping": null,
"CommonEnrichersConfig": [
{
"$type": "TfsNodeStructureOptions",
"PrefixProjectToNodes": false,
"NodeBasePaths": [],
"AreaMaps": {},
"IterationMaps": {},
"ShouldCreateMissingRevisionPaths": true
}
],
"Processors": [
{
"$type": "ExportUsersForMappingConfig",
"Enabled": false,
"LocalExportJsonFile": "c:\temp\ExportUsersForMappingConfig.json",
"WIQLQuery": "SELECT [System.Id], [System.Tags] FROM WorkItems WHERE [System.TeamProject] = @teamproject AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan') ORDER BY [System.ChangedDate] desc",
"IdentityFieldsToCheck": [
"System.AssignedTo",
"System.ChangedBy",
"System.CreatedBy",
"Microsoft.VSTS.Common.ActivatedBy",
"Microsoft.VSTS.Common.ResolvedBy",
"Microsoft.VSTS.Common.ClosedBy"
]
},
//{
// "$type": "WorkItemDeleteConfig",
// "Enabled": true,
// "WIQLQueryBit": "AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan')",
// "WIQLOrderBit": "[System.ChangedDate] desc"
//},
{
"$type": "WorkItemMigrationConfig",
"Enabled": true,
"ReplayRevisions": true,
"PrefixProjectToNodes": false,
"UpdateCreatedDate": true,
"UpdateCreatedBy": true,
"WIQLQueryBit": "AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan')",
"WIQLOrderBit": "[System.ChangedDate] desc",
"LinkMigration": true,
"AttachmentMigration": true,
"AttachmentWorkingPath": "c:\temp\WorkItemAttachmentWorkingFolder\",
"FixHtmlAttachmentLinks": false,
"SkipToFinalRevisedWorkItemType": false,
"WorkItemCreateRetryLimit": 5,
"FilterWorkItemsThatAlreadyExistInTarget": false,
"PauseAfterEachWorkItem": false,
"AttachmentMaxSize": 480000000,
"AttachRevisionHistory": false,
"LinkMigrationSaveEachAsAdded": false,
"GenerateMigrationComment": true,
"WorkItemIDs": null,
"MaxRevisions": 0,
"NodeStructureEnricherEnabled": true,
"UseCommonNodeStructureEnricherConfig": false,
"StopMigrationOnMissingAreaIterationNodes": true,
"ShouldCreateMissingRevisionPaths": false,
"NodeBasePaths": [],
"AreaMaps": {},
"IterationMaps": {
},
"MaxGracefulFailures": 0
}

]
}