Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FSADT1-305: Copy data from Oracle view to a local DB #19

Closed
MCatherine1994 opened this issue Aug 12, 2022 · 1 comment
Closed

FSADT1-305: Copy data from Oracle view to a local DB #19

MCatherine1994 opened this issue Aug 12, 2022 · 1 comment

Comments

@MCatherine1994
Copy link
Contributor

FSADT1-305 Copy data from Oracle view to a local DB

@mamartinezmejia
Copy link
Collaborator

mamartinezmejia commented Aug 15, 2022

This task was created to have an option in case the final user needs to query all data at once and have a better performance.

Option #1: Copy data to a local DB using NestJS, OpenShift and Postgres.
We tried this but there were some challenges:

  1. If we query the whole data, JavaScript will get the browser frozen or the computer out of memory.
  2. If we compare the existing records with the ones in the Oracle DB, we get the following error because we must do this within a loop:

Error: connect ECONNREFUSED

Note: This error doesn’t happen if we do it outside of a loop.

Option #2: Copy data with other options.

  • Oracle Procedure: This task must be done by a DBA. We will need to provide access to our local DB.
    The problem with this solution is that we don’t have any control over this procedure, so we cannot know if it works properly.

  • FME: This solution seems to be a good one, specially that other teams have used it. The problem with this one is that it doesn’t work with OpenShift and it will be a learning curve for developers.

Questions:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants