Deployment template for AWS

[3coins]

This issue pertains to tasks related to creating a deployment template for deploying an API Gateway + Lambda + langchain backed service to AWS.

[3coins]

@hwchase17
I noticed that the current deployment templates are setup under separate repositories. Can you help create a new repo for this. Also, can you please assign this issue to me. Thanks for your help!

cc @ellisonbg

[hwchase17]

would love to work on this. what do you imagine this separate repo looking like?

[3coins]

@hwchase17
Thanks for helping with this. I would suggest langchain-aws-template for this repository. As for the content, I had these tasks in mind for now.

1. CDK or SAM template for setting the infra (API Gateway + Lambda)
2. Lambda handler that uses langchain to call a SageMaker endpoint with an LLM model deployed(Would like to use LLM class from Harrison/sagemaker #965)
3. README with instructions

Let me know if you have any suggestions to improve the repo.

[3coins]

@hwchase17
Can you help create a new repo for this. Here is the template I have so far; I have added you as a collaborator to this repo.
https://github.com/3coins/langchain-aws-template

[Sam1320]

Is there a way to access this template with the progress so far? seems to be a private repository.

[3coins]

@Sam1320
Thanks for your interest. I am trying to get this imported into it's own public repo, so the community can contribute openly.

[3coins]

@hwchase17
Please let me know if you have any suggestions for the deployment template. If something is missing in the current code, I can work on updating the code and making sure it meets the repo's quality bar. Looking forward to work with you on this. Thanks for your help.

[3coins]

@Sam1320
Still waiting for @hwchase17 to create a repo under langchain, but I have made the existing repo public, plz feel free to try and provide feedback.
https://github.com/3coins/langchain-aws-template

[dosubot]

Hi, @3coins! I'm Dosu, and I'm here to help the LangChain team manage their backlog. I wanted to let you know that we are marking this issue as stale.

From what I understand, you were looking to create a deployment template for deploying an API Gateway + Lambda + langchain backed service to AWS. You reached out to hwchase17 for help, and there was a discussion about creating a new repository for this purpose. You provided a template and made it public for community feedback, and it seems like there was positive feedback from several users.

Before we close this issue, we wanted to check with you if it is still relevant to the latest version of the LangChain repository. If it is, please let us know by commenting on the issue. Otherwise, feel free to close the issue yourself, or it will be automatically closed in 7 days.

Thank you for your contribution, and we appreciate your understanding as we manage our backlog. Let us know if you have any further questions or concerns!

[Agamago]

Is there any plan to complete this project? It appears as tho many Langchain users are struggling to deploy their tools to AWS lambdas because of conflicting dependencies. Is there any plan to fix this or create an official lambda layer for langchain applications ?