Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added auto-detect schema info to docs #21501

Merged
merged 5 commits into from
Jan 25, 2023

Conversation

sophia-wiley
Copy link
Contributor

Added auto-detect schema info to docs.

@octavia-squidington-iv octavia-squidington-iv added the area/documentation Improvements or additions to documentation label Jan 17, 2023
|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| If your connection’s source schema has breaking changes, the syncs will be stopped and you must review the changes before continuing syncs or editing the connection. | If you choose to ignore non-breaking changes in your connection's source schema, the syncs will continue. You can change how Airbyte handles syncs when it detects non-breaking changes in the source schema by [editing the stream configuration](#edit-stream-configuration). |

To review schema changes:
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@edmundito @alovew Are the steps for reviewing a non-breaking change and a breaking change the same? I couldn't find a breaking change in a workspace to test this.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If there are breaking schema changes, the user will have to fix what is causing the connection to be broken. This will mean either selecting a new cursor field or new primary key.

To review schema changes:
1. On the [Airbyte Cloud](http://cloud.airbyte.io/) dashboard, click **Connections** and select the connection you want to review.

2. Click the **Replication** tab.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No need to click on the replication tab. the "Review changes" button is anywhere in the connection and will automatically navigate the user to the replication tab.


4. The **Refreshed source schema** dialog displays. Click the dropdowns to review the changes.

5. Click **Confirm** to close the dialog.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We will change the label in the button to OK to make it clear that the change has already been applied. PR

Copy link
Contributor

@Amruta-Ranade Amruta-Ranade left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good with minor nits

@@ -276,7 +278,70 @@ To refresh the source schema:

2. If there are changes to the schema, the **Refreshed source schema** dialog displays them.

## Review schema changes
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change "Review schema changes" > "Manage schema changes"

## Review schema changes
Airbyte detects changes in your source schema and allows you to review the changes.

### Non-breaking changes
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change "Non-breaking changes" > "Review non-breaking schema changes"


:::

### Breaking changes
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change "Breaking changes" > "Fix breaking schema changes"


### Breaking changes

To review breaking schema changes:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change "To review breaking schema changes:" > "To review and fix breaking schema changes:"


2. Click the **Replication** tab.

The **Transfer** and **Streams** settings include the following parameters:
The first section includes the following parameters:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This sentence implies there's a second section, but I didn't see any info about it in the doc. What are we trying to say here?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Amruta-Ranade I realized that the new wording here reflected the new streams table redesign, which hasn't been implemented yet. I reverted this text back.

@@ -276,7 +278,70 @@ To refresh the source schema:

2. If there are changes to the schema, the **Refreshed source schema** dialog displays them.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change "If there are changes to the schema" > "If the schema has changed"


3. The **Refreshed source schema** dialog displays the changes.

4. Click **OK** to close the dialog.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change "Click OK to close the dialog." to "Review the changes and click OK to close the dialog."


4. Click **OK** to close the dialog.

5. In the streams table, the stream with a breaking change is highlighted
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Missing (.) at end of sentence


:::note

Breaking changes can only occur in the **Cursor** or **Primary key** fields.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This info should be earlier in the doc. Right after "Airbyte detects changes in your source schema and allows you to review the changes."

## Manage schema changes

Airbyte detects changes in your source schema and allows you to review the changes.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Amruta-Ranade what do you think about grouping this information in a note here?


:::note

* Schema changes are flagged in your connection, but they will not affect your destination.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All three points don't seem to have the same level of importance. I'd leave the point about schema changes not being propagated to the destination as a note, and make the other two points simple statements.

I'd write the start of the section as follows:

Once every 24 hours, Airbyte checks for changes in your source schema and allows you to review the changes and fix breaking changes.

:::note

Schema changes are flagged in your connection but are not propagated to your destination.
:::

I know I said we could put the line about breaking changes at the top of the section, but with the new content, I think we can move it to the top of the section about breaking changes. Let me know what you think.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree. I'll add those changes :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants