Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support using %seed with local file path #292

Merged
merged 11 commits into from
May 11, 2023
Merged

Conversation

michaelnchin
Copy link
Member

@michaelnchin michaelnchin commented Apr 23, 2022

Issue #, if available: #44, #485

Description of changes:

  • Added new options to %seed to support loading from a specified file location.
    • --language: Specifies which language endpoint(gremlin,cypher, or sparql) to submit the queries to.
    • --source: Specifies the full path to a data file, or a directory containing multiple files, that you would like to load queries from.
    • -f/--full-file-query: If using Gremlin or openCypher, specifying this flag will submit the entire content of the file as a single query, instead of one query per line.
  • Removed sample seed data from package. Samples will now be loaded from an external S3 bucket.

Example run with arguments to load from a local file:

%seed --language Gremlin --source /Users/foo/seed_directory/data_file_0.txt -f --run

Running %seed by itself will allow you to select the same options.

Screen Shot 2022-03-30 at 4 12 18 PM

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

michaelnchin and others added 4 commits April 22, 2022 19:25
Modify datasets test

Improve widget option switching, add unit tests

Remove debug

Support Cypher query datasets, use separate --language and --model options depending on source type

Update seed command documentation

Update languages for clarity

Remove lowercasing of file path, status statements

Improve %seed error handling (#246)

* Add error handling options for seed

* Refactoring

Co-authored-by: Michael Chin <[email protected]>

Modify Cypher error handling

Revise notebooks for seed changes

Fix for test failure

Manually verify that queries are insert type

Remove hard-coded prefix checks

Add file browser UI

More file selection changes

Disable language widget on submit

Support individual seed file paths

Usability improvements and documentation

Remove --source-type option, more refactoring

Update sample notebooks and README

Add single file load unit tests

remove remaining references to source_type

Add option for Gremlin full-file queries

Modify full-file query option to also support Cypher

More graceful handling for invalid args

Preserve widget states when switching between options

Fix switching source back to custom with no current language value

Fix query progress displaying incorrectly
@michaelnchin michaelnchin merged commit 1ff8abe into main May 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant