Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ReleasePR azure-hdinsight-job] [HDInsight]-Add descriptions for sparkjob related definition. #12903

Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions sdk/azure-hdinsight-job/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
# Release History

## 0.1.0 (1970-01-01)

* Initial Release
5 changes: 5 additions & 0 deletions sdk/azure-hdinsight-job/MANIFEST.in
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
recursive-include tests *.py *.yaml
include *.md
include azure/__init__.py
include azure/hdinsight/__init__.py

21 changes: 21 additions & 0 deletions sdk/azure-hdinsight-job/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
# Microsoft Azure SDK for Python

This is the Microsoft Azure MyService Management Client Library.
This package has been tested with Python 2.7, 3.5, 3.6, 3.7 and 3.8.
For a more complete view of Azure libraries, see the [Github repo](https://github.com/Azure/azure-sdk-for-python/)


# Usage

For code examples, see [MyService Management](https://docs.microsoft.com/python/api/overview/azure/)
on docs.microsoft.com.


# Provide Feedback

If you encounter any bugs or have suggestions, please file an issue in the
[Issues](https://github.com/Azure/azure-sdk-for-python/issues)
section of the project.


![Impressions](https://azure-sdk-impressions.azurewebsites.net/api/impressions/azure-sdk-for-python%2Fazure-hdinsight-job%2FREADME.png)
1 change: 1 addition & 0 deletions sdk/azure-hdinsight-job/azure/__init__.py
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
__path__ = __import__('pkgutil').extend_path(__path__, __name__)
1 change: 1 addition & 0 deletions sdk/azure-hdinsight-job/azure/hdinsight/__init__.py
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
__path__ = __import__('pkgutil').extend_path(__path__, __name__)
19 changes: 19 additions & 0 deletions sdk/azure-hdinsight-job/azure/hdinsight/job/__init__.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
# coding=utf-8
# --------------------------------------------------------------------------
# Copyright (c) Microsoft Corporation. All rights reserved.
# Licensed under the MIT License. See License.txt in the project root for
# license information.
#
# Code generated by Microsoft (R) AutoRest Code Generator.
# Changes may cause incorrect behavior and will be lost if the code is
# regenerated.
# --------------------------------------------------------------------------

from ._configuration import HDInsightJobClientConfiguration
from ._hd_insight_job_client import HDInsightJobClient
__all__ = ['HDInsightJobClient', 'HDInsightJobClientConfiguration']

from .version import VERSION

__version__ = VERSION

52 changes: 52 additions & 0 deletions sdk/azure-hdinsight-job/azure/hdinsight/job/_configuration.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,52 @@
# coding=utf-8
# --------------------------------------------------------------------------
# Copyright (c) Microsoft Corporation. All rights reserved.
# Licensed under the MIT License. See License.txt in the project root for
# license information.
#
# Code generated by Microsoft (R) AutoRest Code Generator.
# Changes may cause incorrect behavior and will be lost if the code is
# regenerated.
# --------------------------------------------------------------------------
from msrestazure import AzureConfiguration

from .version import VERSION


class HDInsightJobClientConfiguration(AzureConfiguration):
"""Configuration for HDInsightJobClient
Note that all parameters used to create this instance are saved as instance
attributes.

:param credentials: Credentials needed for the client to connect to Azure.
:type credentials: :mod:`A msrestazure Credentials
object<msrestazure.azure_active_directory>`
:param endpoint: The cluster endpoint, for example
https://clustername.azurehdinsight.net.
:type endpoint: str
:param username: The user name used for running job.
:type username: str
"""

def __init__(
self, credentials, endpoint, username):

if credentials is None:
raise ValueError("Parameter 'credentials' must not be None.")
if endpoint is None:
raise ValueError("Parameter 'endpoint' must not be None.")
if username is None:
raise ValueError("Parameter 'username' must not be None.")
base_url = 'https://{endpoint}'

super(HDInsightJobClientConfiguration, self).__init__(base_url)

# Starting Autorest.Python 4.0.64, make connection pool activated by default
self.keep_alive = True

self.add_user_agent('azure-hdinsight-job/{}'.format(VERSION))
self.add_user_agent('Azure-SDK-For-Python')

self.credentials = credentials
self.endpoint = endpoint
self.username = username
Original file line number Diff line number Diff line change
@@ -0,0 +1,51 @@
# coding=utf-8
# --------------------------------------------------------------------------
# Copyright (c) Microsoft Corporation. All rights reserved.
# Licensed under the MIT License. See License.txt in the project root for
# license information.
#
# Code generated by Microsoft (R) AutoRest Code Generator.
# Changes may cause incorrect behavior and will be lost if the code is
# regenerated.
# --------------------------------------------------------------------------

from msrest.service_client import SDKClient
from msrest import Serializer, Deserializer

from ._configuration import HDInsightJobClientConfiguration
from .operations import JobOperations
from . import models


class HDInsightJobClient(SDKClient):
"""The HDInsight Job Client.

:ivar config: Configuration for client.
:vartype config: HDInsightJobClientConfiguration

:ivar job: Job operations
:vartype job: azure.hdinsight.job.operations.JobOperations

:param credentials: Credentials needed for the client to connect to Azure.
:type credentials: :mod:`A msrestazure Credentials
object<msrestazure.azure_active_directory>`
:param endpoint: The cluster endpoint, for example
https://clustername.azurehdinsight.net.
:type endpoint: str
:param username: The user name used for running job.
:type username: str
"""

def __init__(
self, credentials, endpoint, username):

self.config = HDInsightJobClientConfiguration(credentials, endpoint, username)
super(HDInsightJobClient, self).__init__(self.config.credentials, self.config)

client_models = {k: v for k, v in models.__dict__.items() if isinstance(v, type)}
self.api_version = '2018-11-01-preview'
self._serialize = Serializer(client_models)
self._deserialize = Deserializer(client_models)

self.job = JobOperations(
self._client, self.config, self._serialize, self._deserialize)
97 changes: 97 additions & 0 deletions sdk/azure-hdinsight-job/azure/hdinsight/job/models/__init__.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,97 @@
# coding=utf-8
# --------------------------------------------------------------------------
# Copyright (c) Microsoft Corporation. All rights reserved.
# Licensed under the MIT License. See License.txt in the project root for
# license information.
#
# Code generated by Microsoft (R) AutoRest Code Generator.
# Changes may cause incorrect behavior and will be lost if the code is
# regenerated.
# --------------------------------------------------------------------------

try:
from ._models_py3 import AppState
from ._models_py3 import JobDetailRootJsonObject
from ._models_py3 import JobID
from ._models_py3 import JobListJsonObject
from ._models_py3 import JobOperationsErrorResponse, JobOperationsErrorResponseException
from ._models_py3 import JobSubmissionJsonResponse
from ._models_py3 import Profile
from ._models_py3 import SparkBatchJob
from ._models_py3 import SparkBatchJobCollection
from ._models_py3 import SparkBatchJobRequest
from ._models_py3 import SparkJobDeletedResult
from ._models_py3 import SparkJobLog
from ._models_py3 import SparkJobState
from ._models_py3 import SparkSessionCollection
from ._models_py3 import SparkSessionJob
from ._models_py3 import SparkSessionJobRequest
from ._models_py3 import SparkStatement
from ._models_py3 import SparkStatementCancellationResult
from ._models_py3 import SparkStatementCollection
from ._models_py3 import SparkStatementOutput
from ._models_py3 import SparkStatementRequest
from ._models_py3 import Status
from ._models_py3 import Userargs
except (SyntaxError, ImportError):
from ._models import AppState
from ._models import JobDetailRootJsonObject
from ._models import JobID
from ._models import JobListJsonObject
from ._models import JobOperationsErrorResponse, JobOperationsErrorResponseException
from ._models import JobSubmissionJsonResponse
from ._models import Profile
from ._models import SparkBatchJob
from ._models import SparkBatchJobCollection
from ._models import SparkBatchJobRequest
from ._models import SparkJobDeletedResult
from ._models import SparkJobLog
from ._models import SparkJobState
from ._models import SparkSessionCollection
from ._models import SparkSessionJob
from ._models import SparkSessionJobRequest
from ._models import SparkStatement
from ._models import SparkStatementCancellationResult
from ._models import SparkStatementCollection
from ._models import SparkStatementOutput
from ._models import SparkStatementRequest
from ._models import Status
from ._models import Userargs
from ._hd_insight_job_client_enums import (
ApplicationState,
JobState,
SessionJobKind,
StatementState,
StatementExecutionStatus,
)

__all__ = [
'AppState',
'JobDetailRootJsonObject',
'JobID',
'JobListJsonObject',
'JobOperationsErrorResponse', 'JobOperationsErrorResponseException',
'JobSubmissionJsonResponse',
'Profile',
'SparkBatchJob',
'SparkBatchJobCollection',
'SparkBatchJobRequest',
'SparkJobDeletedResult',
'SparkJobLog',
'SparkJobState',
'SparkSessionCollection',
'SparkSessionJob',
'SparkSessionJobRequest',
'SparkStatement',
'SparkStatementCancellationResult',
'SparkStatementCollection',
'SparkStatementOutput',
'SparkStatementRequest',
'Status',
'Userargs',
'ApplicationState',
'JobState',
'SessionJobKind',
'StatementState',
'StatementExecutionStatus',
]
Original file line number Diff line number Diff line change
@@ -0,0 +1,65 @@
# coding=utf-8
# --------------------------------------------------------------------------
# Copyright (c) Microsoft Corporation. All rights reserved.
# Licensed under the MIT License. See License.txt in the project root for
# license information.
#
# Code generated by Microsoft (R) AutoRest Code Generator.
# Changes may cause incorrect behavior and will be lost if the code is
# regenerated.
# --------------------------------------------------------------------------

from enum import Enum


class ApplicationState(str, Enum):

new = "NEW"
new_saving = "NEW_SAVING"
submitted = "SUBMITTED"
accepted = "ACCEPTED"
running = "RUNNING"
finished = "FINISHED"
finishing = "FINISHING"
failed = "FAILED"
killed = "KILLED"


class JobState(str, Enum):

not_started = "not_started"
starting = "starting"
idle = "idle"
running = "running"
busy = "busy"
shutting_down = "shutting_down"
error = "error"
dead = "dead"
killed = "killed"
success = "success"
recovering = "recovering"


class SessionJobKind(str, Enum):

spark = "spark"
pyspark = "pyspark"
sparkr = "sparkr"
sql = "sql"


class StatementState(str, Enum):

waiting = "waiting"
running = "running"
available = "available"
error = "error"
cancelling = "cancelling"
cancelled = "cancelled"


class StatementExecutionStatus(str, Enum):

ok = "ok"
error = "error"
abort = "abort"
Loading