Skip to content

Doc: Add SQL server CDC guide - #22541

Merged
bobbyiliev merged 6 commits into
MaterializeInc:mainfrom
bobbyiliev:doc-sql-server-cdc-guide
Nov 23, 2023
Merged

Doc: Add SQL server CDC guide#22541
bobbyiliev merged 6 commits into
MaterializeInc:mainfrom
bobbyiliev:doc-sql-server-cdc-guide

Conversation

@bobbyiliev

Copy link
Copy Markdown
Contributor

Motivation

Adding a SQL Server CDC guide that follows the exact same structure as the existing MySQL guide.

Also added a demo here for this.

Closes MaterializeInc/database-issues#3220

@bobbyiliev
bobbyiliev requested a review from a team as a code owner October 20, 2023 15:46
@bobbyiliev
bobbyiliev force-pushed the doc-sql-server-cdc-guide branch from b399869 to bc72ff2 Compare October 20, 2023 15:47
@bobbyiliev
bobbyiliev requested review from dehume and joacoc November 2, 2023 13:36
{{< tabs >}}
{{< tab "Debezium 1.5+">}}

1. Create a connector configuration file and save it as `register-sqlserver.json`:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What about using the link to the configuration example that includes also additional details rather than the json?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That example in the Debezium docs is missing some crucial configuration settings like the Avro Converter and the CSR details so we can't use it directly.

* `common-config`
* `common-utils`

1. Create a connector configuration file and save it as `register-sqlserver.json`:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same as sqlserver.json. Maybe I'm missing something.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hm I am not 100% sure what you mean here?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It was the same as the other comment, but probably you have the same answer about crucial config missing! So nothing to do here.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah I see! Thank you for the clarification.

GROUP BY field1;
```

## Known Limitations

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also Microsoft has a Known issues and errors with CDC

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good finding! I've added a link to this in the list

Comment thread doc/user/content/ingest-data/cdc-sql-server.md Outdated
bobbyiliev and others added 2 commits November 3, 2023 17:15
Co-authored-by: Joaquin Colacci <joaquincolacci@gmail.com>
@bobbyiliev
bobbyiliev requested a review from joacoc November 3, 2023 15:46
@bobbyiliev
bobbyiliev merged commit dd73e04 into MaterializeInc:main Nov 23, 2023
@bobbyiliev
bobbyiliev deleted the doc-sql-server-cdc-guide branch April 11, 2025 11:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants