option to use local models vs. openai key?

[james-see]

I want to be able to pass in "local-mode" env or similar that uses a local model you put in a particular folder, etc.

[logan-markewich]

The llama-agi package supports passing in an llm from langchain, as well as using the service context to set the LLM for llama-index

I can create an example for this if you need more guidance :)

[james-see]

I am not as familiar with those packages, an example would be very helpful, thank you!

[nathanjzhao]

An example for passing an LLM from a local model would be great!

[jabogithub]

I also would like an example for passing an LLM from a local model! Especially Llama 2