[ML][Pipelines] feat: support data binding expression inside entity runsettings

[elliotzh]

Description

For now, data binding expression got some issues inside a run setting entity:

@dsl.pipeline
def my_pipeline(instance_count):
    node = component_func(component_in_number=1)
    # node.resource is a ResourceConfiguration object instead of a primitive value
    node.resources.instance_count = instance_count

Full list of similar runsettings:

• Command
  • resources
  • queue_setting - do not support for now as it involved value mapping in _to_rest_object
  • limits
• Parallel
  • resources
  • limits
• Spark
  • resources
  • identity - do not support for now as the only field for identity is type and it has not been exposed to customers
  • entry - do not support for now as entry overwrite from node is forbidden for now
• [internal] Command/Parallel/Distributed
  • resources
  • limits
• [internal] Spark
  • the same as #Spark

Sample error msg:

Exception: Unable to deserialize response data. Data: ${{parent.inputs.instance_count}}, int, ValueError: invalid literal for int() with base 10: '${{parent.inputs.instance_count}}'.
Traceback (most recent call last):
  File "D:\conda_env\smile\lib\site-packages\msrest\serialization.py", line 1605, in deserialize_data
    return self.deserialize_basic(data, data_type)
  File "D:\conda_env\smile\lib\site-packages\msrest\serialization.py", line 1748, in deserialize_basic
    return eval(data_type)(attr)
ValueError: invalid literal for int() with base 10: '${{parent.inputs.instance_count}}'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "d:\project\azure-sdk-for-python\sdk\ml\azure-ai-ml\azure\ai\ml\entities\_job\job.py", line 309, in _from_rest_object
    return PipelineJob._load_from_rest(obj)
  File "d:\project\azure-sdk-for-python\sdk\ml\azure-ai-ml\azure\ai\ml\entities\_job\pipeline\pipeline_job.py", line 526, in _load_from_rest
    sub_nodes = PipelineComponent._resolve_sub_nodes(properties.jobs) if properties.jobs else {}
  File "d:\project\azure-sdk-for-python\sdk\ml\azure-ai-ml\azure\ai\ml\entities\_component\pipeline_component.py", line 359, in _resolve_sub_nodes
    sub_nodes[node_name] = pipeline_node_factory.load_from_rest_object(obj=node)
  File "d:\project\azure-sdk-for-python\sdk\ml\azure-ai-ml\azure\ai\ml\entities\_job\pipeline\_load_component.py", line 252, in load_from_rest_object
    return self.get_load_from_rest_object_func(_type)(obj, **kwargs)
  File "d:\project\azure-sdk-for-python\sdk\ml\azure-ai-ml\azure\ai\ml\entities\_builders\base_node.py", line 369, in _from_rest_object
    init_kwargs = instance._from_rest_object_to_init_params(obj)
  File "d:\project\azure-sdk-for-python\sdk\ml\azure-ai-ml\azure\ai\ml\_internal\entities\command.py", line 110, in _from_rest_object_to_init_params
    resources = RestJobResourceConfiguration.from_dict(obj["resources"])
  File "D:\conda_env\smile\lib\site-packages\msrest\serialization.py", line 349, in from_dict
    return deserializer(cls.__name__, data, content_type=content_type)
  File "D:\conda_env\smile\lib\site-packages\msrest\serialization.py", line 1368, in __call__
    return self._deserialize(target_obj, data)
  File "D:\conda_env\smile\lib\site-packages\msrest\serialization.py", line 1442, in _deserialize
    value = self.deserialize_data(raw_value, attr_desc['type'])
  File "D:\conda_env\smile\lib\site-packages\msrest\serialization.py", line 1629, in deserialize_data
    raise_with_traceback(DeserializationError, msg, err)
  File "D:\conda_env\smile\lib\site-packages\msrest\exceptions.py", line 51, in raise_with_traceback
    raise error.with_traceback(exc_traceback)
  File "D:\conda_env\smile\lib\site-packages\msrest\serialization.py", line 1605, in deserialize_data
    return self.deserialize_basic(data, data_type)
  File "D:\conda_env\smile\lib\site-packages\msrest\serialization.py", line 1748, in deserialize_basic
    return eval(data_type)(attr)
msrest.exceptions.DeserializationError: Unable to deserialize response data. Data: ${{parent.inputs.instance_count}}, int, ValueError: invalid literal for int() with base 10: '${{parent.inputs.instance_count}}'

All SDK Contribution checklist:

• The pull request does not introduce [breaking changes]
• CHANGELOG is updated for new features, bug fixes or other significant changes.
• I have read the contribution guidelines.

General Guidelines and Best Practices

• Title of the pull request is clear and informative.
• There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

• Pull request includes test coverage for the included changes.

[azure-sdk]

API change check

APIView has identified API level changes in this PR and created following API reviews.

azure-ai-ml