Skip to content

Commit

Permalink
feat(client-glue): Introduces new column statistics APIs to support s…
Browse files Browse the repository at this point in the history
…tatistics generation for tables within the Glue Data Catalog.
  • Loading branch information
awstools committed Nov 16, 2023
1 parent 9e1a837 commit de24311
Show file tree
Hide file tree
Showing 18 changed files with 2,801 additions and 189 deletions.
40 changes: 40 additions & 0 deletions clients/client-glue/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -828,6 +828,22 @@ GetColumnStatisticsForTable

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/classes/getcolumnstatisticsfortablecommand.html) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/getcolumnstatisticsfortablecommandinput.html) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/getcolumnstatisticsfortablecommandoutput.html)

</details>
<details>
<summary>
GetColumnStatisticsTaskRun
</summary>

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/classes/getcolumnstatisticstaskruncommand.html) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/getcolumnstatisticstaskruncommandinput.html) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/getcolumnstatisticstaskruncommandoutput.html)

</details>
<details>
<summary>
GetColumnStatisticsTaskRuns
</summary>

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/classes/getcolumnstatisticstaskrunscommand.html) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/getcolumnstatisticstaskrunscommandinput.html) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/getcolumnstatisticstaskrunscommandoutput.html)

</details>
<details>
<summary>
Expand Down Expand Up @@ -1308,6 +1324,14 @@ ListBlueprints

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/classes/listblueprintscommand.html) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/listblueprintscommandinput.html) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/listblueprintscommandoutput.html)

</details>
<details>
<summary>
ListColumnStatisticsTaskRuns
</summary>

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/classes/listcolumnstatisticstaskrunscommand.html) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/listcolumnstatisticstaskrunscommandinput.html) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/listcolumnstatisticstaskrunscommandoutput.html)

</details>
<details>
<summary>
Expand Down Expand Up @@ -1548,6 +1572,14 @@ StartBlueprintRun

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/classes/startblueprintruncommand.html) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/startblueprintruncommandinput.html) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/startblueprintruncommandoutput.html)

</details>
<details>
<summary>
StartColumnStatisticsTaskRun
</summary>

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/classes/startcolumnstatisticstaskruncommand.html) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/startcolumnstatisticstaskruncommandinput.html) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/startcolumnstatisticstaskruncommandoutput.html)

</details>
<details>
<summary>
Expand Down Expand Up @@ -1636,6 +1668,14 @@ StartWorkflowRun

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/classes/startworkflowruncommand.html) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/startworkflowruncommandinput.html) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/startworkflowruncommandoutput.html)

</details>
<details>
<summary>
StopColumnStatisticsTaskRun
</summary>

[Command API Reference](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/classes/stopcolumnstatisticstaskruncommand.html) / [Input](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/stopcolumnstatisticstaskruncommandinput.html) / [Output](https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-glue/interfaces/stopcolumnstatisticstaskruncommandoutput.html)

</details>
<details>
<summary>
Expand Down
115 changes: 115 additions & 0 deletions clients/client-glue/src/Glue.ts
Original file line number Diff line number Diff line change
Expand Up @@ -376,6 +376,16 @@ import {
GetColumnStatisticsForTableCommandInput,
GetColumnStatisticsForTableCommandOutput,
} from "./commands/GetColumnStatisticsForTableCommand";
import {
GetColumnStatisticsTaskRunCommand,
GetColumnStatisticsTaskRunCommandInput,
GetColumnStatisticsTaskRunCommandOutput,
} from "./commands/GetColumnStatisticsTaskRunCommand";
import {
GetColumnStatisticsTaskRunsCommand,
GetColumnStatisticsTaskRunsCommandInput,
GetColumnStatisticsTaskRunsCommandOutput,
} from "./commands/GetColumnStatisticsTaskRunsCommand";
import {
GetConnectionCommand,
GetConnectionCommandInput,
Expand Down Expand Up @@ -604,6 +614,11 @@ import {
ListBlueprintsCommandInput,
ListBlueprintsCommandOutput,
} from "./commands/ListBlueprintsCommand";
import {
ListColumnStatisticsTaskRunsCommand,
ListColumnStatisticsTaskRunsCommandInput,
ListColumnStatisticsTaskRunsCommandOutput,
} from "./commands/ListColumnStatisticsTaskRunsCommand";
import {
ListCrawlersCommand,
ListCrawlersCommandInput,
Expand Down Expand Up @@ -742,6 +757,11 @@ import {
StartBlueprintRunCommandInput,
StartBlueprintRunCommandOutput,
} from "./commands/StartBlueprintRunCommand";
import {
StartColumnStatisticsTaskRunCommand,
StartColumnStatisticsTaskRunCommandInput,
StartColumnStatisticsTaskRunCommandOutput,
} from "./commands/StartColumnStatisticsTaskRunCommand";
import {
StartCrawlerCommand,
StartCrawlerCommandInput,
Expand Down Expand Up @@ -793,6 +813,11 @@ import {
StartWorkflowRunCommandInput,
StartWorkflowRunCommandOutput,
} from "./commands/StartWorkflowRunCommand";
import {
StopColumnStatisticsTaskRunCommand,
StopColumnStatisticsTaskRunCommandInput,
StopColumnStatisticsTaskRunCommandOutput,
} from "./commands/StopColumnStatisticsTaskRunCommand";
import { StopCrawlerCommand, StopCrawlerCommandInput, StopCrawlerCommandOutput } from "./commands/StopCrawlerCommand";
import {
StopCrawlerScheduleCommand,
Expand Down Expand Up @@ -995,6 +1020,8 @@ const commands = {
GetClassifiersCommand,
GetColumnStatisticsForPartitionCommand,
GetColumnStatisticsForTableCommand,
GetColumnStatisticsTaskRunCommand,
GetColumnStatisticsTaskRunsCommand,
GetConnectionCommand,
GetConnectionsCommand,
GetCrawlerCommand,
Expand Down Expand Up @@ -1055,6 +1082,7 @@ const commands = {
GetWorkflowRunsCommand,
ImportCatalogToGlueCommand,
ListBlueprintsCommand,
ListColumnStatisticsTaskRunsCommand,
ListCrawlersCommand,
ListCrawlsCommand,
ListCustomEntityTypesCommand,
Expand Down Expand Up @@ -1085,6 +1113,7 @@ const commands = {
RunStatementCommand,
SearchTablesCommand,
StartBlueprintRunCommand,
StartColumnStatisticsTaskRunCommand,
StartCrawlerCommand,
StartCrawlerScheduleCommand,
StartDataQualityRuleRecommendationRunCommand,
Expand All @@ -1096,6 +1125,7 @@ const commands = {
StartMLLabelingSetGenerationTaskRunCommand,
StartTriggerCommand,
StartWorkflowRunCommand,
StopColumnStatisticsTaskRunCommand,
StopCrawlerCommand,
StopCrawlerScheduleCommand,
StopSessionCommand,
Expand Down Expand Up @@ -2313,6 +2343,40 @@ export interface Glue {
cb: (err: any, data?: GetColumnStatisticsForTableCommandOutput) => void
): void;

/**
* @see {@link GetColumnStatisticsTaskRunCommand}
*/
getColumnStatisticsTaskRun(
args: GetColumnStatisticsTaskRunCommandInput,
options?: __HttpHandlerOptions
): Promise<GetColumnStatisticsTaskRunCommandOutput>;
getColumnStatisticsTaskRun(
args: GetColumnStatisticsTaskRunCommandInput,
cb: (err: any, data?: GetColumnStatisticsTaskRunCommandOutput) => void
): void;
getColumnStatisticsTaskRun(
args: GetColumnStatisticsTaskRunCommandInput,
options: __HttpHandlerOptions,
cb: (err: any, data?: GetColumnStatisticsTaskRunCommandOutput) => void
): void;

/**
* @see {@link GetColumnStatisticsTaskRunsCommand}
*/
getColumnStatisticsTaskRuns(
args: GetColumnStatisticsTaskRunsCommandInput,
options?: __HttpHandlerOptions
): Promise<GetColumnStatisticsTaskRunsCommandOutput>;
getColumnStatisticsTaskRuns(
args: GetColumnStatisticsTaskRunsCommandInput,
cb: (err: any, data?: GetColumnStatisticsTaskRunsCommandOutput) => void
): void;
getColumnStatisticsTaskRuns(
args: GetColumnStatisticsTaskRunsCommandInput,
options: __HttpHandlerOptions,
cb: (err: any, data?: GetColumnStatisticsTaskRunsCommandOutput) => void
): void;

/**
* @see {@link GetConnectionCommand}
*/
Expand Down Expand Up @@ -3153,6 +3217,23 @@ export interface Glue {
cb: (err: any, data?: ListBlueprintsCommandOutput) => void
): void;

/**
* @see {@link ListColumnStatisticsTaskRunsCommand}
*/
listColumnStatisticsTaskRuns(
args: ListColumnStatisticsTaskRunsCommandInput,
options?: __HttpHandlerOptions
): Promise<ListColumnStatisticsTaskRunsCommandOutput>;
listColumnStatisticsTaskRuns(
args: ListColumnStatisticsTaskRunsCommandInput,
cb: (err: any, data?: ListColumnStatisticsTaskRunsCommandOutput) => void
): void;
listColumnStatisticsTaskRuns(
args: ListColumnStatisticsTaskRunsCommandInput,
options: __HttpHandlerOptions,
cb: (err: any, data?: ListColumnStatisticsTaskRunsCommandOutput) => void
): void;

/**
* @see {@link ListCrawlersCommand}
*/
Expand Down Expand Up @@ -3603,6 +3684,23 @@ export interface Glue {
cb: (err: any, data?: StartBlueprintRunCommandOutput) => void
): void;

/**
* @see {@link StartColumnStatisticsTaskRunCommand}
*/
startColumnStatisticsTaskRun(
args: StartColumnStatisticsTaskRunCommandInput,
options?: __HttpHandlerOptions
): Promise<StartColumnStatisticsTaskRunCommandOutput>;
startColumnStatisticsTaskRun(
args: StartColumnStatisticsTaskRunCommandInput,
cb: (err: any, data?: StartColumnStatisticsTaskRunCommandOutput) => void
): void;
startColumnStatisticsTaskRun(
args: StartColumnStatisticsTaskRunCommandInput,
options: __HttpHandlerOptions,
cb: (err: any, data?: StartColumnStatisticsTaskRunCommandOutput) => void
): void;

/**
* @see {@link StartCrawlerCommand}
*/
Expand Down Expand Up @@ -3772,6 +3870,23 @@ export interface Glue {
cb: (err: any, data?: StartWorkflowRunCommandOutput) => void
): void;

/**
* @see {@link StopColumnStatisticsTaskRunCommand}
*/
stopColumnStatisticsTaskRun(
args: StopColumnStatisticsTaskRunCommandInput,
options?: __HttpHandlerOptions
): Promise<StopColumnStatisticsTaskRunCommandOutput>;
stopColumnStatisticsTaskRun(
args: StopColumnStatisticsTaskRunCommandInput,
cb: (err: any, data?: StopColumnStatisticsTaskRunCommandOutput) => void
): void;
stopColumnStatisticsTaskRun(
args: StopColumnStatisticsTaskRunCommandInput,
options: __HttpHandlerOptions,
cb: (err: any, data?: StopColumnStatisticsTaskRunCommandOutput) => void
): void;

/**
* @see {@link StopCrawlerCommand}
*/
Expand Down
30 changes: 30 additions & 0 deletions clients/client-glue/src/GlueClient.ts
Original file line number Diff line number Diff line change
Expand Up @@ -221,6 +221,14 @@ import {
GetColumnStatisticsForTableCommandInput,
GetColumnStatisticsForTableCommandOutput,
} from "./commands/GetColumnStatisticsForTableCommand";
import {
GetColumnStatisticsTaskRunCommandInput,
GetColumnStatisticsTaskRunCommandOutput,
} from "./commands/GetColumnStatisticsTaskRunCommand";
import {
GetColumnStatisticsTaskRunsCommandInput,
GetColumnStatisticsTaskRunsCommandOutput,
} from "./commands/GetColumnStatisticsTaskRunsCommand";
import { GetConnectionCommandInput, GetConnectionCommandOutput } from "./commands/GetConnectionCommand";
import { GetConnectionsCommandInput, GetConnectionsCommandOutput } from "./commands/GetConnectionsCommand";
import { GetCrawlerCommandInput, GetCrawlerCommandOutput } from "./commands/GetCrawlerCommand";
Expand Down Expand Up @@ -338,6 +346,10 @@ import {
ImportCatalogToGlueCommandOutput,
} from "./commands/ImportCatalogToGlueCommand";
import { ListBlueprintsCommandInput, ListBlueprintsCommandOutput } from "./commands/ListBlueprintsCommand";
import {
ListColumnStatisticsTaskRunsCommandInput,
ListColumnStatisticsTaskRunsCommandOutput,
} from "./commands/ListColumnStatisticsTaskRunsCommand";
import { ListCrawlersCommandInput, ListCrawlersCommandOutput } from "./commands/ListCrawlersCommand";
import { ListCrawlsCommandInput, ListCrawlsCommandOutput } from "./commands/ListCrawlsCommand";
import {
Expand Down Expand Up @@ -404,6 +416,10 @@ import { ResumeWorkflowRunCommandInput, ResumeWorkflowRunCommandOutput } from ".
import { RunStatementCommandInput, RunStatementCommandOutput } from "./commands/RunStatementCommand";
import { SearchTablesCommandInput, SearchTablesCommandOutput } from "./commands/SearchTablesCommand";
import { StartBlueprintRunCommandInput, StartBlueprintRunCommandOutput } from "./commands/StartBlueprintRunCommand";
import {
StartColumnStatisticsTaskRunCommandInput,
StartColumnStatisticsTaskRunCommandOutput,
} from "./commands/StartColumnStatisticsTaskRunCommand";
import { StartCrawlerCommandInput, StartCrawlerCommandOutput } from "./commands/StartCrawlerCommand";
import {
StartCrawlerScheduleCommandInput,
Expand Down Expand Up @@ -436,6 +452,10 @@ import {
} from "./commands/StartMLLabelingSetGenerationTaskRunCommand";
import { StartTriggerCommandInput, StartTriggerCommandOutput } from "./commands/StartTriggerCommand";
import { StartWorkflowRunCommandInput, StartWorkflowRunCommandOutput } from "./commands/StartWorkflowRunCommand";
import {
StopColumnStatisticsTaskRunCommandInput,
StopColumnStatisticsTaskRunCommandOutput,
} from "./commands/StopColumnStatisticsTaskRunCommand";
import { StopCrawlerCommandInput, StopCrawlerCommandOutput } from "./commands/StopCrawlerCommand";
import {
StopCrawlerScheduleCommandInput,
Expand Down Expand Up @@ -585,6 +605,8 @@ export type ServiceInputTypes =
| GetClassifiersCommandInput
| GetColumnStatisticsForPartitionCommandInput
| GetColumnStatisticsForTableCommandInput
| GetColumnStatisticsTaskRunCommandInput
| GetColumnStatisticsTaskRunsCommandInput
| GetConnectionCommandInput
| GetConnectionsCommandInput
| GetCrawlerCommandInput
Expand Down Expand Up @@ -645,6 +667,7 @@ export type ServiceInputTypes =
| GetWorkflowRunsCommandInput
| ImportCatalogToGlueCommandInput
| ListBlueprintsCommandInput
| ListColumnStatisticsTaskRunsCommandInput
| ListCrawlersCommandInput
| ListCrawlsCommandInput
| ListCustomEntityTypesCommandInput
Expand Down Expand Up @@ -675,6 +698,7 @@ export type ServiceInputTypes =
| RunStatementCommandInput
| SearchTablesCommandInput
| StartBlueprintRunCommandInput
| StartColumnStatisticsTaskRunCommandInput
| StartCrawlerCommandInput
| StartCrawlerScheduleCommandInput
| StartDataQualityRuleRecommendationRunCommandInput
Expand All @@ -686,6 +710,7 @@ export type ServiceInputTypes =
| StartMLLabelingSetGenerationTaskRunCommandInput
| StartTriggerCommandInput
| StartWorkflowRunCommandInput
| StopColumnStatisticsTaskRunCommandInput
| StopCrawlerCommandInput
| StopCrawlerScheduleCommandInput
| StopSessionCommandInput
Expand Down Expand Up @@ -798,6 +823,8 @@ export type ServiceOutputTypes =
| GetClassifiersCommandOutput
| GetColumnStatisticsForPartitionCommandOutput
| GetColumnStatisticsForTableCommandOutput
| GetColumnStatisticsTaskRunCommandOutput
| GetColumnStatisticsTaskRunsCommandOutput
| GetConnectionCommandOutput
| GetConnectionsCommandOutput
| GetCrawlerCommandOutput
Expand Down Expand Up @@ -858,6 +885,7 @@ export type ServiceOutputTypes =
| GetWorkflowRunsCommandOutput
| ImportCatalogToGlueCommandOutput
| ListBlueprintsCommandOutput
| ListColumnStatisticsTaskRunsCommandOutput
| ListCrawlersCommandOutput
| ListCrawlsCommandOutput
| ListCustomEntityTypesCommandOutput
Expand Down Expand Up @@ -888,6 +916,7 @@ export type ServiceOutputTypes =
| RunStatementCommandOutput
| SearchTablesCommandOutput
| StartBlueprintRunCommandOutput
| StartColumnStatisticsTaskRunCommandOutput
| StartCrawlerCommandOutput
| StartCrawlerScheduleCommandOutput
| StartDataQualityRuleRecommendationRunCommandOutput
Expand All @@ -899,6 +928,7 @@ export type ServiceOutputTypes =
| StartMLLabelingSetGenerationTaskRunCommandOutput
| StartTriggerCommandOutput
| StartWorkflowRunCommandOutput
| StopColumnStatisticsTaskRunCommandOutput
| StopCrawlerCommandOutput
| StopCrawlerScheduleCommandOutput
| StopSessionCommandOutput
Expand Down
Loading

0 comments on commit de24311

Please sign in to comment.