generated from amosproj/amos202Xss0Y-projname
-
Notifications
You must be signed in to change notification settings - Fork 0
Backend ‐ build
Emil Balitzki edited this page Jun 17, 2024
·
1 revision
- when running the main command
npm run deploy
the Backend api container is build and deployed. - to deploy the Data Pipeline navigate to the
/backend
directory and rundocker compose up -d
to start the docker containers for the datapipeline project and the database.
- Do develop both the Data Pipeline and the Backend Api you need Visual Studio installed. The solutions can be built and tested from within Visual Studio.
- Please look at the Configuration details given in Data Pipeline to be able to run the Datapipeline Project.
The infrastructure of the backend is split into four components:
- API Project
- Database
- Preprocessing
- Data pipeline
API Project:
The API project receives the requests from the frontend. Based on the request the data is read from the database. This data is processed and send to the frontend.
Database:
The database stores the data from the csv-source files, the pre-processed data and information about the datasets.
Preprocessing:
The preprocessing reads the raw data from the database. Does some calculations and filtering, and saves the new data in the database.
Data pipeline:
The data pipeline reads the data from a given csv-source file. This data gets parsed and filtered, and is the stored in the database.