Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Study and discoveries of embeddings and tools #118

Merged
merged 30 commits into from
Oct 24, 2024
Merged

Study and discoveries of embeddings and tools #118

merged 30 commits into from
Oct 24, 2024

Conversation

jfrverdasca
Copy link
Contributor

@jfrverdasca jfrverdasca commented Oct 8, 2024 •
edited
Loading

What this PR change:

  • Add a Jupyter notebook with all findings about embeddings optimization and tools
  • Add a Jupyter notebook to allow run different embeddings types and document findings, with examples and results
  • Add a Python parser to allow structured embeddins of python code
  • Add a structured python code embeddins logic

Reviewers:

Issues:

Print screens showing the changes:

Captura de ecrã 2024-10-18, às 16 19 33

@jfrverdasca jfrverdasca self-assigned this Oct 8, 2024
@jfrverdasca
feat: Add tools discussion
ef10298
@jfrverdasca
feat: Add "Embeddings across different projects" discussion and other…
287f53e 
… notes to improve document content
@jfrverdasca
feat: Added code to "Combine embeddings and tools"
aec188b
@jfrverdasca
feat: Litle text fix
d70afe6
@jfrverdasca
feat: Litle text fix
1196e7c
@jfrverdasca
feat: Added the details that were as TODO
f0ee721
@jfrverdasca
Merge branch 'refs/heads/main' into 113/embeddings
780b21a
@jfrverdasca
feat: Added jupyter with tests and new embeddins method
de8a1ac
@jfrverdasca
feat: Add Python code embeddins
46d8398 
* Add /labs/parsers/python with a class to parse python code files
* Add chunck vectorizer
* Add python vectorizer
* Add vectorizer factory to fast changing embeddins method
* Add embeddins jupyter notebook with results from both methods
* Add makefile zsh command to allow docker compose comands (and other) with envars set
@jfrverdasca
Merge branch 'refs/heads/main' into 113/embeddings
5fc5b3a
@jfrverdasca jfrverdasca linked an issue Oct 18, 2024 that may be closed by this pull request
Test the best approach for embeddings #113
Closed
@jfrverdasca jfrverdasca marked this pull request as ready for review October 18, 2024 15:41
JdFSilva
JdFSilva approved these changes Oct 23, 2024
View reviewed changes
labs/database/vectorize/factory.py Outdated Show resolved Hide resolved
kenvontucky
kenvontucky requested changes Oct 23, 2024
View reviewed changes
README.md Outdated Show resolved Hide resolved
@jfrverdasca jfrverdasca merged commit 12301d9 into main Oct 24, 2024
1 check passed
@jfrverdasca jfrverdasca deleted the 113/embeddings branch October 24, 2024 10:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@JdFSilva JdFSilva JdFSilva approved these changes

@sIldefonsoRR sIldefonsoRR sIldefonsoRR approved these changes

@jpb18 jpb18 jpb18 approved these changes

@kenvontucky kenvontucky kenvontucky approved these changes

Assignees

@jfrverdasca jfrverdasca

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Test the best approach for embeddings
5 participants
@jfrverdasca @kenvontucky @jpb18 @sIldefonsoRR @JdFSilva