Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(example): add an example of deploying langchain application integrated with llama2 #140

Merged
merged 6 commits into from
Feb 29, 2024

Conversation

jianzs
Copy link
Contributor

@jianzs jianzs commented Feb 29, 2024

1. Does this PR affect any open issues?(Y/N) and add issue references (e.g. "fix #123", "re #123".):

  • N
  • Y

2. What is the scope of this PR (e.g. component or file name):

  • Client SDK
  • Infra SDK
  • Examples

3. Provide a description of the PR(e.g. more details, effects, motivations or doc link):

  • Affects user behaviors
  • Contains syntax changes
  • Contains variable changes
  • Contains experimental features
  • Performance regression: Consumes more CPU
  • Performance regression: Consumes more Memory
  • Other
  • Add a regular method named endpointName for the SageMaker client, required by the SageMakerEndpoint class in LangChain application.
  • Activate Lambda's HTTP access feature. Because the Api Gateway comes with a non-adjustable 30-second timeout limit. This means that if the generation process exceeds this time window, we would receive a 503 Service Unavailable error. Therefore, we directly use Lambda functions to handle requests.
  • Enable logging for AWS API Gateway to simplify debugging.

4. Are there any breaking changes?(Y/N) and describe the breaking changes(e.g. more details, motivations or doc link):

  • N
  • Y

5. Are there test cases for these changes?(Y/N) select and add more details, references or doc links:

  • Unit test
  • Integration test
  • Benchmark (add benchmark stats below)
  • Manual test (add detailed scripts or steps below)
  • Other

@jianzs jianzs added the sdk Client SDK and Infra SDK label Feb 29, 2024
Copy link

changeset-bot bot commented Feb 29, 2024

🦋 Changeset detected

Latest commit: a94e19b

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 4 packages
Name Type
@plutolang/pluto-infra Patch
@plutolang/pluto Patch
@plutolang/cli Patch
@plutolang/simulator-adapter Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@jianzs jianzs requested a review from Peefy February 29, 2024 12:25
Copy link
Contributor

@Peefy Peefy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jianzs jianzs merged commit 778f49f into pluto-lang:main Feb 29, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
sdk Client SDK and Infra SDK
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants