This repository has been archived by the owner on Jul 28, 2023. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 0
Add table for workspace pipelines. #31
Merged
Merged
Changes from all commits
Commits
Show all changes
36 commits
Select commit
Hold shift + click to select a range
bd4ada0
Update SDK to v0.4.0.
sidr0cker 6cc55d2
Add table for workspace pipelines.
sidr0cker 41b7587
Add last_process_id and last_process to the pipeline table.
sidr0cker 4f696b4
Add process and workspace process table.
sidr0cker 3dfde6b
Remove `data_state` column from identity and workspace process.
sidr0cker 7be8ac3
Update process table descriptions.
sidr0cker f3cb6d7
Add a fromcamel transform for identity_id in process for it to be pop…
sidr0cker 3f4671e
Add ability to filter org workspace snapshot records by query quals.
sidr0cker 50dd256
Add filter quals and query_where for pipelines and processes.
sidr0cker 54acc31
Various doc updates.
sidr0cker df60a0a
Add documentation for process tables.
sidr0cker cf083cf
Upgrade SDK to v0.5.0.
sidr0cker 6b833d7
Add links to look up supported APIs and columns for query filter.
sidr0cker 758449e
Update steampipecloud/table_steampipecloud_process.go
sidr0cker 3efa29f
Update steampipecloud/table_steampipecloud_workspace_pipeline.go
sidr0cker 2064d70
Update steampipecloud/table_steampipecloud_workspace_pipeline.go
sidr0cker eaa4612
Update steampipecloud/table_steampipecloud_workspace_pipeline.go
sidr0cker 6909084
Update steampipecloud/table_steampipecloud_workspace_pipeline.go
sidr0cker ba13198
Update steampipecloud/table_steampipecloud_process.go
sidr0cker de3b188
Update steampipecloud/table_steampipecloud_process.go
sidr0cker 3dfeca2
Update steampipecloud/table_steampipecloud_process.go
sidr0cker daad29f
Update steampipecloud/table_steampipecloud_process.go
sidr0cker 1ee851a
Update faulty comment.
sidr0cker 9d3af27
Remove logger entries.
sidr0cker 82a7c0e
Update steampipecloud/table_steampipecloud_process.go
sidr0cker 3631604
Update steampipecloud/table_steampipecloud_process.go
sidr0cker 26e5c97
Update steampipecloud/table_steampipecloud_process.go
sidr0cker 880b02c
Update steampipecloud/table_steampipecloud_process.go
sidr0cker cc0e60b
Update steampipecloud/table_steampipecloud_process.go
sidr0cker d98aacb
Update steampipecloud/table_steampipecloud_process.go
sidr0cker ce5d37a
Update steampipecloud/table_steampipecloud_process.go
sidr0cker 5d53bda
Update steampipecloud/table_steampipecloud_process.go
sidr0cker b73be52
Update steampipecloud/table_steampipecloud_process.go
sidr0cker 4aaf394
Update steampipecloud/table_steampipecloud_process.go
sidr0cker ac4c905
Update steampipecloud/table_steampipecloud_workspace_pipeline.go
sidr0cker dad885d
Change limit logic.
sidr0cker File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,71 @@ | ||
# Table: steampipecloud_process | ||
|
||
Allows to track various activities performed on an identity in Steampipe Cloud. | ||
|
||
## Examples | ||
|
||
### Basic info | ||
|
||
```sql | ||
select | ||
id, | ||
identity_handle, | ||
identity_type, | ||
pipeline_id, | ||
type, | ||
state, | ||
created_at | ||
from | ||
steampipecloud_process; | ||
``` | ||
|
||
### List processes that are being run by an identity pipeline | ||
|
||
```sql | ||
select | ||
id, | ||
identity_handle, | ||
identity_type, | ||
pipeline_id, | ||
type, | ||
state, | ||
created_at | ||
from | ||
steampipecloud_process | ||
where | ||
pipeline_id is not null; | ||
``` | ||
|
||
### List user processes | ||
|
||
```sql | ||
select | ||
id, | ||
identity_handle, | ||
identity_type, | ||
pipeline_id, | ||
type, | ||
state, | ||
created_at | ||
from | ||
steampipecloud_process | ||
where | ||
identity_type = 'user'; | ||
``` | ||
|
||
### List running processes | ||
|
||
```sql | ||
select | ||
id, | ||
identity_handle, | ||
identity_type, | ||
pipeline_id, | ||
type, | ||
state, | ||
created_at | ||
from | ||
steampipecloud_process | ||
where | ||
state = 'running'; | ||
``` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,117 @@ | ||
# Table: steampipecloud_workspace_pipeline | ||
|
||
Pipelines allow users to run different kinds of activities in Steampipe Cloud on a schedule. | ||
|
||
**Important notes:** | ||
|
||
This table supports optional quals. Queries with optional quals in the `where` clause are optimised to use Steampipe Cloud filters. | ||
|
||
Optional quals are supported for the following columns: | ||
|
||
- `created_at` | ||
- `id` | ||
- `identity_handle` | ||
- `identity_id` | ||
- `pipeline` | ||
- `query_where` - Allows use of [query filters](https://steampipe.io/docs/cloud/reference/query-filter). For a list of supported columns for pipelines, please see [Supported APIs and Columns](https://steampipe.io/docs/cloud/reference/query-filter#supported-apis--columns). Please note that any query filter passed into the `query_where` qual will be combined with other optional quals. | ||
- `title` | ||
- `updated_at` | ||
- `workspace_handle` | ||
- `workspace_id` | ||
|
||
## Examples | ||
|
||
### Basic info | ||
|
||
```sql | ||
select | ||
id, | ||
identity_handle, | ||
workspace_handle, | ||
title, | ||
frequency, | ||
pipeline, | ||
args, | ||
tags, | ||
last_process_id | ||
from | ||
steampipecloud_workspace_pipeline; | ||
``` | ||
|
||
### List pipelines for a specific workspace | ||
|
||
```sql | ||
select | ||
id, | ||
identity_handle, | ||
workspace_handle, | ||
title, | ||
frequency, | ||
pipeline, | ||
args, | ||
tags, | ||
last_process_id | ||
from | ||
steampipecloud_workspace_pipeline | ||
where | ||
workspace_handle = 'dev'; | ||
``` | ||
|
||
### List pipelines of frequency type `interval` for a specific workspace | ||
|
||
```sql | ||
select | ||
id, | ||
identity_handle, | ||
workspace_handle, | ||
title, | ||
frequency, | ||
pipeline, | ||
args, | ||
tags, | ||
last_process_id | ||
from | ||
steampipecloud_workspace_pipeline | ||
where | ||
workspace_handle = 'dev' | ||
and frequency->>'type' = 'interval'; | ||
``` | ||
|
||
### List pipelines for the `AWS Compliance CIS v1.4.0` dashboard created in the last 7 days | ||
|
||
```sql | ||
select | ||
id, | ||
identity_handle, | ||
workspace_handle, | ||
title, | ||
frequency, | ||
pipeline, | ||
args, | ||
tags, | ||
last_process_id | ||
from | ||
steampipecloud_workspace_pipeline | ||
where | ||
args->>'resource' = 'aws_compliance.benchmark.cis_v140' | ||
and created_at >= now() - interval '7 days'; | ||
``` | ||
|
||
### List pipelines for the `AWS Compliance CIS v1.4.0` dashboard created in the last 7 days using [query filter](https://steampipe.io/docs/cloud/reference/query-filter) | ||
|
||
```sql | ||
select | ||
id, | ||
identity_handle, | ||
workspace_handle, | ||
title, | ||
frequency, | ||
pipeline, | ||
args, | ||
tags, | ||
last_process_id | ||
from | ||
steampipecloud_workspace_pipeline | ||
where | ||
query_where = 'title = ''Scheduled snapshot: CIS v1.4.0'' and created_at >= now() - interval ''7 days'''; | ||
``` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,90 @@ | ||
# Table: steampipecloud_workspace_process | ||
|
||
Allows to track various activities performed on a workspace of an identity in Steampipe Cloud. | ||
|
||
**Important notes:** | ||
|
||
This table supports optional quals. Queries with optional quals in the `where` clause are optimised to use Steampipe Cloud filters. | ||
|
||
Optional quals are supported for the following columns: | ||
|
||
- `created_at` | ||
- `id` | ||
- `identity_handle` | ||
- `identity_id` | ||
- `pipeline_id` | ||
- `query_where` - Allows use of [query filters](https://steampipe.io/docs/cloud/reference/query-filter). For a list of supported columns for workspace proceses, please see [Supported APIs and Columns](https://steampipe.io/docs/cloud/reference/query-filter#supported-apis--columns). Please note that any query filter passed into the `query_where` qual will be combined with other optional quals. | ||
- `state` | ||
- `type` | ||
- `updated_at` | ||
- `workspace_handle` | ||
- `workspace_id` | ||
|
||
## Examples | ||
|
||
### Basic info | ||
|
||
```sql | ||
select | ||
id, | ||
identity_handle, | ||
workspace_handle, | ||
pipeline_id, | ||
type, | ||
state, | ||
created_at | ||
from | ||
steampipecloud_workspace_process; | ||
``` | ||
|
||
### List processes for a pipeline | ||
|
||
```sql | ||
select | ||
id, | ||
identity_handle, | ||
workspace_handle, | ||
pipeline_id, | ||
type, | ||
state, | ||
created_at | ||
from | ||
steampipecloud_workspace_process | ||
where | ||
pipeline_id = 'pipe_cfcgiefm1tumv1dis7lg'; | ||
``` | ||
|
||
### List running processes for a pipeline | ||
|
||
```sql | ||
select | ||
id, | ||
identity_handle, | ||
workspace_handle, | ||
pipeline_id, | ||
type, | ||
state, | ||
created_at | ||
from | ||
steampipecloud_workspace_process | ||
where | ||
pipeline_id = 'pipe_cfcgiefm1tumv1dis7lg' | ||
and state = 'running'; | ||
``` | ||
|
||
### List running processes for a pipeline using [query filter](https://steampipe.io/docs/cloud/reference/query-filter) | ||
|
||
```sql | ||
select | ||
id, | ||
identity_handle, | ||
workspace_handle, | ||
pipeline_id, | ||
type, | ||
state, | ||
created_at | ||
from | ||
steampipecloud_workspace_process | ||
where | ||
query_where = 'pipeline_id = ''pipe_cfcgiefm1tumv1dis7lg'' and state = ''running'''; | ||
``` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should we also add a separate section highlighting the optional quals for this table as mentioned in https://github.com/turbot/steampipe-plugin-steampipecloud/pull/31/files#diff-1d6098679bced8287cde2de661f16aa150ee4a1566f349ad70b0206a00ad6c2bR27-R38
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we dont support optional quals in this table yet. The same has been added to the steampipecloud_workspace_process since that table supports it.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
also for the second point - I have tested the retryhydrate stuff and it works as expected.