Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incremental Load from ODBC to SQLClient #33

Open
DoubleDP opened this issue Jan 23, 2018 · 0 comments
Open

Incremental Load from ODBC to SQLClient #33

DoubleDP opened this issue Jan 23, 2018 · 0 comments

Comments

@DoubleDP
Copy link

DoubleDP commented Jan 23, 2018

I am busy developing an ETL that loads data from SQL Server 7.0 source via a ODBC connection and pushing into Azure destination via a SQLClient connection.

This must be done incrementally and thus a parameterized SP will be called on the source to receive the batches of data.

So far everything is working well in getting the invariant key values from the source's table and the last unique key value pairing written to the destination's table. This was achieved via an InputCommandOperation calling parameter-less SPs on the source and destination respectively.

These 2 datasets have now been merged to produce a list of parameters pairings that must be used to call the SP in iterations based on the rows of parameter pairings.

My problem is this... I cannot use SqlBatchOperation as the connection I am creating is an OdbcConnection, which makes the PrepareCommand(Row row, SqlCommand command) unusable.

Any ideas on how I can overcome the problem I have described?

@DoubleDP DoubleDP reopened this Jan 23, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant