Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Design the Integration between Drive and your Pipeline #21

Closed
pishoyg opened this issue Jul 23, 2024 · 3 comments
Closed

Design the Integration between Drive and your Pipeline #21

pishoyg opened this issue Jul 23, 2024 · 3 comments
Labels
architect How: Planning and design user Why: User convenience

Comments

@pishoyg
Copy link
Owner

pishoyg commented Jul 23, 2024

Likely, this means letting them contribute through Drive instead of Git.
List the data sources, and redirect the flow to Drive (think about this!)
A few sources that immediately come to my mind are:

  • Crum (Roots, derivations, types, meanings, and page numbers)
  • Crum's Notes
  • Crum's Scans
  • Crum's Explanatory Images
  • The Bible
  • copticsite.com's Dictionary and Suffixes
  • Dawoud's Screenshots
  • Dawoud's Page Numbers
  • future data...

Thinking about Drive, it might be even easier for users to contribute
through a sheet instead of a Drive folder (e.g. for notes). Use sheets
whenever possible.

Thought: Another possibility is for Git to continue to be the source of truth.
But what we can do is have users share their contributions via Drive, and then
we will implement a pipeline to integrate the contributions made through Drive
into Git.

  1. Marcion's pipeline should retrieve the data manually collected /
    overridden for dawoud-pages and crum-last-page, rather than simply
    write an empty placeholder column. (p2, 1-2 hours)
@pishoyg pishoyg added the P0 label Jul 23, 2024
@pishoyg pishoyg added user Why: User convenience architect How: Planning and design dev Why: Developer experience labels Jul 30, 2024
@pishoyg
Copy link
Owner Author

pishoyg commented Aug 3, 2024

Note: Removed the milestone, since this is about the pipeline that supports the site, rather than about the site itself. The site can be published, and the pipeline can be perfected later.

@pishoyg pishoyg added p2 and removed P0 labels Aug 4, 2024
@pishoyg
Copy link
Owner Author

pishoyg commented Aug 4, 2024

Note: We somewhat have a pipeline for publications (the Bible, the Kindle dictionary, the flashcards). We still need to design the data "mirror" gsheets.

Note: This was requested when the site didn't exist. We should perhaps reconsider whether we want to use Drive gsheets as a sink at all. The site might suffice, and we can just use Drive gsheets as a source for users to input augmentations.

@pishoyg pishoyg added P1 and removed dev Why: Developer experience p2 labels Aug 4, 2024
@pishoyg pishoyg assigned pishoyg and unassigned pishoyg Aug 5, 2024
@pishoyg pishoyg removed the P1 label Aug 8, 2024
@pishoyg
Copy link
Owner Author

pishoyg commented Aug 9, 2024

We prefer using the site / app as an interface for most data.
The use of Drive has become more limited. It will likely be used:

  1. As a convenient way to type augmentations in TSVS format.
  2. For publishing data, by sharing a public link to a file that gets updated with every release (this is the case for the Bible, the Kindle dictionary, and the flashcards package).

Thus, this is somewhat redundant given #78 and #109. (In the former, you are yet to build the pipeline around this future lovely sheet; in the latter, the links are there already in your vault.sh and are being used in your Makefile, you just need to list them and cement them.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
architect How: Planning and design user Why: User convenience
Projects
Archived in project
Development

No branches or pull requests

1 participant