Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pebblo retrieval qa/policy propagation #89

Draft
wants to merge 290 commits into
base: master
Choose a base branch
from
This pull request is big! We’re only showing the most recent 250 commits.

Commits on Sep 14, 2024

  1. Configuration menu
    Copy the full SHA
    4e6620e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    779a008 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    b47f4cf View commit details
    Browse the repository at this point in the history
  4. cli[patch]: Update the migration script message (langchain-ai#26490)

    Update the migration script message
    eyurtsev authored Sep 14, 2024
    Configuration menu
    Copy the full SHA
    77ccb4b View commit details
    Browse the repository at this point in the history
  5. docs: Fix Firecrawl v0 version (langchain-ai#26452)

    Firecrawl integration is currently on v0 - which is supported until
    version 0.0.20.
    
    @rafaelsideguide is working on a pr for v1 but meanwhile we should fix
    the docs.
    nickscamara authored Sep 14, 2024
    Configuration menu
    Copy the full SHA
    2240ca2 View commit details
    Browse the repository at this point in the history
  6. broken LangGraph docs link (langchain-ai#26438)

    Update broken langgraph link in the README.md file
    
    Co-authored-by: Jess Ou <[email protected]>
    jessicaou and Jess Ou authored Sep 14, 2024
    Configuration menu
    Copy the full SHA
    9c6aa3f View commit details
    Browse the repository at this point in the history
  7. Update google_search.ipynb (langchain-ai#26420)

    Added changes for pip installation
    bhadreshpsavani authored Sep 14, 2024
    Configuration menu
    Copy the full SHA
    f66b7ba View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2024

  1. Configuration menu
    Copy the full SHA
    4131be6 View commit details
    Browse the repository at this point in the history
  2. docs: most 0.1 redirects too (langchain-ai#26494)

    takes redirects from 0.1 docs and factors them into suggested redirects
    in 0.3 docs
    efriis authored Sep 15, 2024
    Configuration menu
    Copy the full SHA
    135afdf View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Configuration menu
    Copy the full SHA
    9f5960a View commit details
    Browse the repository at this point in the history
  2. docs: Update concepts.mdx (langchain-ai#26496)

    - Fix comments in Python
    - Fix repeated sentences
    ystkfujii authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    bd42344 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ee4e113 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1ab181f View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    88bc15d View commit details
    Browse the repository at this point in the history
  6. langchain-cli: release 0.0.31 (langchain-ai#26533)

    langchain-cli 0.0.31 release
    eyurtsev authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    8889147 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    0592c29 View commit details
    Browse the repository at this point in the history
  8. box: 0.2.0 release (langchain-ai#26539)

    Release to work with langchain 0.3
    eyurtsev authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    5b4206a View commit details
    Browse the repository at this point in the history
  9. milvus: 0.1.6 release (langchain-ai#26538)

    Release to work with langchain 0.3
    eyurtsev authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    8b985a4 View commit details
    Browse the repository at this point in the history
  10. unstructured: release 0.1.4 (langchain-ai#26540)

    Release to work with langchain 0.3
    eyurtsev authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    c2588b3 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    0154c58 View commit details
    Browse the repository at this point in the history
  12. ci: updates issue and discussion templates (langchain-ai#26542)

    Update issue and discussion templates
    eyurtsev authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    63c3cc1 View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    a319a0f View commit details
    Browse the repository at this point in the history
  14. docs: show how to use langchain-cli for migration (langchain-ai#26535)

    Update v0.3 instructions a bit
    
    ---------
    
    Co-authored-by: Bagatur <[email protected]>
    eyurtsev and baskaryan authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    c6a7813 View commit details
    Browse the repository at this point in the history
  15. docs: Fix missing self argument in _get_docs_with_query method of…

    … `Cust… (langchain-ai#26312)
    
    …omSelfQueryRetriever`
    
    This commit corrects an issue in the `_get_docs_with_query` method of
    the `CustomSelfQueryRetriever` class. The method was incorrectly using
    `self.vectorstore.similarity_search_with_score(query, **search_kwargs)`
    without including the `self` argument, which is required for proper
    method invocation.
    
    The `self` argument is necessary for calling instance methods and
    accessing instance attributes. By including `self` in the method call,
    we ensure that the method is correctly executed in the context of the
    current instance, allowing it to function as intended.
    
    No other changes were made to the method's logic or functionality.
    
    Thank you for contributing to LangChain!
    
    - [ ] **PR title**: "package: description"
    - Where "package" is whichever of langchain, community, core,
    experimental, etc. is being modified. Use "docs: ..." for purely docs
    changes, "templates: ..." for template changes, "infra: ..." for CI
    changes.
      - Example: "community: add foobar LLM"
    
    
    - [ ] **PR message**: ***Delete this entire checklist*** and replace
    with
        - **Description:** a description of the change
        - **Issue:** the issue # it fixes, if applicable
        - **Dependencies:** any dependencies required for this change
    - **Twitter handle:** if your PR gets announced, and you'd like a
    mention, we'll gladly shout you out!
    
    
    - [ ] **Add tests and docs**: If you're adding a new integration, please
    include
    1. a test for the integration, preferably unit tests that do not rely on
    network access,
    2. an example notebook showing its use. It lives in
    `docs/docs/integrations` directory.
    
    
    - [ ] **Lint and test**: Run `make format`, `make lint` and `make test`
    from the root of the package(s) you've modified. See contribution
    guidelines for more: https://python.langchain.com/docs/contributing/
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    
    Co-authored-by: Erick Friis <[email protected]>
    SQpgducray and efriis authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    724a537 View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    8a2f2fc View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    0bd98c9 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    3bcd641 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    99abd25 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Configuration menu
    Copy the full SHA
    31f61d4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d8952b8 View commit details
    Browse the repository at this point in the history
  3. doc_fix_chroma_integration (langchain-ai#26565)

    Thank you for contributing to LangChain!
    
    - [x] **PR title**: "package: description"
    docs:integrations:vectorstores:chroma:fix_typo
    
    
    - [x] **PR message**: ***Delete this entire checklist*** and replace
    with
    
    
    - **Description:** fix_typo in docs:integrations:vectorstores:chroma
    https://python.langchain.com/docs/integrations/vectorstores/chroma/
        - **Issue:** langchain-ai#26561
    
    - [ ] **Add tests and docs**: If you're adding a new integration, please
    include
    1. a test for the integration, preferably unit tests that do not rely on
    network access,
    2. an example notebook showing its use. It lives in
    `docs/docs/integrations` directory.
    
    
    - [ ] **Lint and test**: Run `make format`, `make lint` and `make test`
    from the root of the package(s) you've modified. See contribution
    guidelines for more: https://python.langchain.com/docs/contributing/
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    venkatram-dev authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    6ba3c71 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    6758894 View commit details
    Browse the repository at this point in the history
  5. community: Enhance MongoDBLoader with flexible metadata and optimized…

    … field extraction (langchain-ai#23376)
    
    ### Description:
    This pull request significantly enhances the MongodbLoader class in the
    LangChain community package by adding robust metadata customization and
    improved field extraction capabilities. The updated class now allows
    users to specify additional metadata fields through the metadata_names
    parameter, enabling the extraction of both top-level and deeply nested
    document attributes as metadata. This flexibility is crucial for users
    who need to include detailed contextual information without altering the
    database schema.
    
    Moreover, the include_db_collection_in_metadata flag offers optional
    inclusion of database and collection names in the metadata, allowing for
    even greater customization depending on the user's needs.
    
    The loader's field extraction logic has been refined to handle missing
    or nested fields more gracefully. It now employs a safe access mechanism
    that avoids the KeyError previously encountered when a specified nested
    field was absent in a document. This update ensures that the loader can
    handle diverse and complex data structures without failure, making it
    more resilient and user-friendly.
    
    ### Issue:
    This pull request addresses a critical issue where the MongodbLoader
    class in the LangChain community package could throw a KeyError when
    attempting to access nested fields that may not exist in some documents.
    The previous implementation did not handle the absence of specified
    nested fields gracefully, leading to runtime errors and interruptions in
    data processing workflows.
    
    This enhancement ensures robust error handling by safely accessing
    nested document fields, using default values for missing data, thus
    preventing KeyError and ensuring smoother operation across various data
    structures in MongoDB. This improvement is crucial for users working
    with diverse and complex data sets, ensuring the loader can adapt to
    documents with varying structures without failing.
    
    ### Dependencies: 
    Requires motor for asynchronous MongoDB interaction.
    
    ### Twitter handle: 
    N/A
    
    ### Add tests and docs
    Tests: Unit tests have been added to verify that the metadata inclusion
    toggle works as expected and that the field extraction correctly handles
    nested fields.
    Docs: An example notebook demonstrating the use of the enhanced
    MongodbLoader is included in the docs/docs/integrations directory. This
    notebook includes setup instructions, example usage, and outputs.
    (Here is the notebook link : [colab
    link](https://colab.research.google.com/drive/1tp7nyUnzZa3dxEFF4Kc3KS7ACuNF6jzH?usp=sharing))
    Lint and test
    Before submitting, I ran make format, make lint, and make test as per
    the contribution guidelines. All tests pass, and the code style adheres
    to the LangChain standards.
    
    ```python
    import unittest
    from unittest.mock import patch, MagicMock
    import asyncio
    from langchain_community.document_loaders.mongodb import MongodbLoader
    
    class TestMongodbLoader(unittest.TestCase):
        def setUp(self):
            """Setup the MongodbLoader test environment by mocking the motor client 
            and database collection interactions."""
            # Mocking the AsyncIOMotorClient
            self.mock_client = MagicMock()
            self.mock_db = MagicMock()
            self.mock_collection = MagicMock()
    
            self.mock_client.get_database.return_value = self.mock_db
            self.mock_db.get_collection.return_value = self.mock_collection
    
            # Initialize the MongodbLoader with test data
            self.loader = MongodbLoader(
                connection_string="mongodb://localhost:27017",
                db_name="testdb",
                collection_name="testcol"
            )
    
        @patch('langchain_community.document_loaders.mongodb.AsyncIOMotorClient', return_value=MagicMock())
        def test_constructor(self, mock_motor_client):
            """Test if the constructor properly initializes with the correct database and collection names."""
            loader = MongodbLoader(
                connection_string="mongodb://localhost:27017",
                db_name="testdb",
                collection_name="testcol"
            )
            self.assertEqual(loader.db_name, "testdb")
            self.assertEqual(loader.collection_name, "testcol")
    
        def test_aload(self):
            """Test the aload method to ensure it correctly queries and processes documents."""
            # Setup mock data and responses for the database operations
            self.mock_collection.count_documents.return_value = asyncio.Future()
            self.mock_collection.count_documents.return_value.set_result(1)
            self.mock_collection.find.return_value = [
                {"_id": "1", "content": "Test document content"}
            ]
    
            # Run the aload method and check responses
            loop = asyncio.get_event_loop()
            results = loop.run_until_complete(self.loader.aload())
            self.assertEqual(len(results), 1)
            self.assertEqual(results[0].page_content, "Test document content")
    
        def test_construct_projection(self):
            """Verify that the projection dictionary is constructed correctly based on field names."""
            self.loader.field_names = ['content', 'author']
            self.loader.metadata_names = ['timestamp']
            expected_projection = {'content': 1, 'author': 1, 'timestamp': 1}
            projection = self.loader._construct_projection()
            self.assertEqual(projection, expected_projection)
    
    if __name__ == '__main__':
        unittest.main()
    ```
    
    
    ### Additional Example for Documentation
    Sample Data:
    
    ```json
    [
        {
            "_id": "1",
            "title": "Artificial Intelligence in Medicine",
            "content": "AI is transforming the medical industry by providing personalized medicine solutions.",
            "author": {
                "name": "John Doe",
                "email": "[email protected]"
            },
            "tags": ["AI", "Healthcare", "Innovation"]
        },
        {
            "_id": "2",
            "title": "Data Science in Sports",
            "content": "Data science provides insights into player performance and strategic planning in sports.",
            "author": {
                "name": "Jane Smith",
                "email": "[email protected]"
            },
            "tags": ["Data Science", "Sports", "Analytics"]
        }
    ]
    ```
    Example Code:
    
    ```python
    loader = MongodbLoader(
        connection_string="mongodb://localhost:27017",
        db_name="example_db",
        collection_name="articles",
        filter_criteria={"tags": "AI"},
        field_names=["title", "content"],
        metadata_names=["author.name", "author.email"],
        include_db_collection_in_metadata=True
    )
    
    documents = loader.load()
    
    for doc in documents:
        print("Page Content:", doc.page_content)
        print("Metadata:", doc.metadata)
    ```
    Expected Output:
    
    ```
    Page Content: Artificial Intelligence in Medicine AI is transforming the medical industry by providing personalized medicine solutions.
    Metadata: {'author_name': 'John Doe', 'author_email': '[email protected]', 'database': 'example_db', 'collection': 'articles'}
    ```
    
    Thank you.
    
    ---
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    
    ---------
    
    Co-authored-by: ccurme <[email protected]>
    comsa33 and ccurme authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    0a177ec View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    3e51fdc View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    06cde06 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    f4a6523 View commit details
    Browse the repository at this point in the history
  9. core[patch]: Fix "argument of type 'NoneType' is not iterable" error …

    …in LangChainTracer (langchain-ai#26576)
    
    Thank you for contributing to LangChain!
    
    - [ ] **PR title**: "package: description"
    - Where "package" is whichever of langchain, community, core,
    experimental, etc. is being modified. Use "docs: ..." for purely docs
    changes, "templates: ..." for template changes, "infra: ..." for CI
    changes.
      - Example: "community: add foobar LLM"
    
    
    - [ ] **PR message**: ***Delete this entire checklist*** and replace
    with
        - **Description:** a description of the change
        - **Issue:** the issue # it fixes, if applicable
        - **Dependencies:** any dependencies required for this change
    - **Twitter handle:** if your PR gets announced, and you'd like a
    mention, we'll gladly shout you out!
    
    
    - [ ] **Add tests and docs**: If you're adding a new integration, please
    include
    1. a test for the integration, preferably unit tests that do not rely on
    network access,
    2. an example notebook showing its use. It lives in
    `docs/docs/integrations` directory.
    
    
    - [ ] **Lint and test**: Run `make format`, `make lint` and `make test`
    from the root of the package(s) you've modified. See contribution
    guidelines for more: https://python.langchain.com/docs/contributing/
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    
    ---------
    
    Co-authored-by: Erick Friis <[email protected]>
    nfcampos and efriis authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    5fc4498 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    145a49c View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    7c05f71 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    e1d113e View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    97b05d7 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    194adc4 View commit details
    Browse the repository at this point in the history
  15. community: modify document links for tencent vectordb (langchain-ai#2…

    …6316)
    
    - modify document links for create a tencent vectordb database instance.
    
    Co-authored-by: wlleiiwang <[email protected]>
    Co-authored-by: Erick Friis <[email protected]>
    3 people authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    2ef4c94 View commit details
    Browse the repository at this point in the history
  16. core[patch]: Add ruff rule UP006(use PEP585 annotations) (langchain-a…

    …i#26574)
    
    * Added rules `UPD006` now that Pydantic is v2+
    
    ---------
    
    Co-authored-by: Eugene Yurtsev <[email protected]>
    cbornet and eyurtsev authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    3a99467 View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    c6bdd6f View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    5ced41b View commit details
    Browse the repository at this point in the history
  19. community: Rename deployments server to AI gateway (langchain-ai#26368)

    We recently renamed `MLflow Deployments Server` to `MLflow AI Gateway`
    in mlflow. This PR updates the relevant notebooks to use `MLflow AI
    gateway`
    
    ---
    
    Thank you for contributing to LangChain!
    
    - [x] **PR title**: "package: description"
    - Where "package" is whichever of langchain, community, core,
    experimental, etc. is being modified. Use "docs: ..." for purely docs
    changes, "templates: ..." for template changes, "infra: ..." for CI
    changes.
      - Example: "community: add foobar LLM"
    
    
    - [x] **PR message**: ***Delete this entire checklist*** and replace
    with
        - **Description:** a description of the change
        - **Issue:** the issue # it fixes, if applicable
        - **Dependencies:** any dependencies required for this change
    - **Twitter handle:** if your PR gets announced, and you'd like a
    mention, we'll gladly shout you out!
    
    
    - [x] **Add tests and docs**: If you're adding a new integration, please
    include
    1. a test for the integration, preferably unit tests that do not rely on
    network access,
    2. an example notebook showing its use. It lives in
    `docs/docs/integrations` directory.
    
    
    - [x] **Lint and test**: Run `make format`, `make lint` and `make test`
    from the root of the package(s) you've modified. See contribution
    guidelines for more: https://python.langchain.com/docs/contributing/
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    
    ---------
    
    Signed-off-by: harupy <[email protected]>
    Co-authored-by: Erick Friis <[email protected]>
    harupy and efriis authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    6ed50e7 View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    1a62f98 View commit details
    Browse the repository at this point in the history
  21. Improvement[Community] Improve streamlit_callback_handler (langchai…

    …n-ai#26373)
    
    - add decorator for static methods
    
    Co-authored-by: Erick Friis <[email protected]>
    ZhangShenao and efriis authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    1a8e902 View commit details
    Browse the repository at this point in the history
  22. community[patch]: o1-preview and o1-mini costs (langchain-ai#26411)

    updated OpenAI cost definitions according to the following:
    https://openai.com/api/pricing/
    
    Co-authored-by: Erick Friis <[email protected]>
    ogawa65a and efriis authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    e2245fa View commit details
    Browse the repository at this point in the history
  23. Improvement[Community] Improve api doc of BeautifulSoupTransformer (l…

    …angchain-ai#26423)
    
    - Add missing args
    
    Co-authored-by: Erick Friis <[email protected]>
    ZhangShenao and efriis authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    c3b3f46 View commit details
    Browse the repository at this point in the history
  24. docs: Fix typo in conda environment code block in rag.ipynb (langchai…

    …n-ai#26487)
    
    Thank you for contributing to LangChain!
    
    - [x] **PR title**: Fix typo in conda environment code block in
    rag.ipynb
      - In docs/tutorials/rag.ipynb
    
    Co-authored-by: Erick Friis <[email protected]>
    IT-Bill and efriis authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    418b170 View commit details
    Browse the repository at this point in the history
  25. docs: fix the ImportError in google_speech_to_text.ipynb (langcha…

    …in-ai#26522)
    
    fix langchain-ai#26370
    
    - langchain-ai#26370 
    
    `GoogleSpeechToTextLoader` is a deprecated method in
    `langchain_community.document_loaders.google_speech_to_text`.
    
    The new recommended usage is to use `SpeechToTextLoader` from
    `langchain_google_community`.
    
    When importing from `langchain_google_community`, use the name
    `SpeechToTextLoader` instead of the old `GoogleSpeechToTextLoader`.
    
    
    ![image](https://github.com/user-attachments/assets/3a8bd309-9858-4938-b7db-872f51b9542e)
    
    Co-authored-by: Erick Friis <[email protected]>
    gbaian10 and efriis authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    6fe2536 View commit details
    Browse the repository at this point in the history
  26. docs: fix typo on amazon_textract.ipynb (langchain-ai#26493)

    - **Description:** fixed a typo on amazon textract page
    
    Co-authored-by: Erick Friis <[email protected]>
    marcorossiIT and efriis authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    f62d454 View commit details
    Browse the repository at this point in the history
  27. docs: update hybrid search example with Elasticsearch retriever (lang…

    …chain-ai#26328)
    
    - **Description:** the example to perform hybrid search with the
    Elasticsearch retriever is out of date
    - **Issue:** N/A
    - **Dependencies:** N/A
    
    Co-authored-by: Erick Friis <[email protected]>
    miguelgrinberg and efriis authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    52729ac View commit details
    Browse the repository at this point in the history
  28. docs: fix typo in clickhouse vectorstore doc (langchain-ai#26598)

    - **Description:** typo in clickhouse vectorstore doc
    - **Issue:** langchain-ai#26597
    - **Dependencies:** none
    - **Twitter handle:** sanjay920
    
    Co-authored-by: Erick Friis <[email protected]>
    sanjay920 and efriis authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    b246052 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. Configuration menu
    Copy the full SHA
    df38d52 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    de58942 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    d158401 View commit details
    Browse the repository at this point in the history
  4. docs: fixed typo in XML document loader (langchain-ai#26613)

    Fixed typo `Unstrucutred`
    pmcgleenon authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    0f07cf6 View commit details
    Browse the repository at this point in the history
  5. core: Put Python version as a project requirement so it is considered…

    … by ruff (langchain-ai#26608)
    
    Ruff doesn't know about the python version in
    `[tool.poetry.dependencies]`. It can get it from
    `project.requires-python`.
    
    Notes:
    * poetry seems to have issues getting the python constraints from
    `requires-python` and using `python` in per dependency constraints. So I
    had to duplicate the info. I will open an issue on poetry.
    * `inspect.isclass()` doesn't work correctly with `GenericAlias`
    (`list[...]`, `dict[..., ...]`) on Python <3.11 so I added some `not
    isinstance(type, GenericAlias)` checks:
    
    Python 3.11
    ```pycon
    >>> import inspect
    >>> inspect.isclass(list)
    True
    >>> inspect.isclass(list[str])
    False
    ```
    
    Python 3.9
    ```pycon
    >>> import inspect
    >>> inspect.isclass(list)
    True
    >>> inspect.isclass(list[str])
    True
    ```
    
    Co-authored-by: Eugene Yurtsev <[email protected]>
    cbornet and eyurtsev authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    a47b332 View commit details
    Browse the repository at this point in the history
  6. core: remove [project] tag from pyproject (langchain-ai#26633)

    makes core incompatible with uv installs
    efriis authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    84b8313 View commit details
    Browse the repository at this point in the history
  7. core: use ruff.target-version instead (langchain-ai#26634)

    tested on one of the replacement cases and seems to work! 
    ![ScreenShot 2024-09-18 at 02 02
    43PM](https://github.com/user-attachments/assets/7170975a-2542-43ed-a203-d4126c6a2c81)
    efriis authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    9909354 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    e0c36af View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. box: Add searchoptions for BoxRetriever, documentation for BoxRetriev…

    …er as agent tool (langchain-ai#26181)
    
    Thank you for contributing to LangChain!
    
    - [x] **PR title**: "package: description"
    - Where "package" is whichever of langchain, community, core,
    experimental, etc. is being modified. Use "docs: ..." for purely docs
    changes, "templates: ..." for template changes, "infra: ..." for CI
    changes.
      - Example: "community: add foobar LLM"
    
    
    Added search options for BoxRetriever and added documentation to
    demonstrate how to use BoxRetriever as an agent tool - @BoxPlatform
    
    
    - [x] **Add tests and docs**: If you're adding a new integration, please
    include
    1. a test for the integration, preferably unit tests that do not rely on
    network access,
    2. an example notebook showing its use. It lives in
    `docs/docs/integrations` directory.
    
    
    - [x] **Lint and test**: Run `make format`, `make lint` and `make test`
    from the root of the package(s) you've modified. See contribution
    guidelines for more: https://python.langchain.com/docs/contributing/
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    shurrey authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    acbb4e4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    03b9aca View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    8fb643a View commit details
    Browse the repository at this point in the history
  4. docs[community]: Fix raw string in docstring (langchain-ai#26350)

    Fixes langchain-ai#26212: replaced the raw string with backslashes. Alternative:
    raw-stringif the full docstring.
    
    ---------
    
    Co-authored-by: Erick Friis <[email protected]>
    tibor-reiss and efriis authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    85caaa7 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    7835c06 View commit details
    Browse the repository at this point in the history
  6. core: Add N(naming) ruff rules (langchain-ai#25362)

    Public classes/functions are not renamed and rule is ignored for them.
    
    Co-authored-by: Erick Friis <[email protected]>
    cbornet and efriis authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    fd21ffe View commit details
    Browse the repository at this point in the history
  7. community: Add warning when page_content is empty (langchain-ai#25955)

    Page content sometimes is empty when PyMuPDF can not find text on pages.
    For example, this can happen when the text of the PDF is not copyable
    "by hand". Then an OCR solution is need - which is not integrated here.
    
    This warning should accurately warn the user that some pages are lost
    during this process.
    
    Thank you for contributing to LangChain!
    
    - [ ] **PR title**: "package: description"
    - Where "package" is whichever of langchain, community, core,
    experimental, etc. is being modified. Use "docs: ..." for purely docs
    changes, "templates: ..." for template changes, "infra: ..." for CI
    changes.
      - Example: "community: add foobar LLM"
    
    
    - [ ] **PR message**: ***Delete this entire checklist*** and replace
    with
        - **Description:** a description of the change
        - **Issue:** the issue # it fixes, if applicable
        - **Dependencies:** any dependencies required for this change
    - **Twitter handle:** if your PR gets announced, and you'd like a
    mention, we'll gladly shout you out!
    
    
    - [ ] **Add tests and docs**: If you're adding a new integration, please
    include
    1. a test for the integration, preferably unit tests that do not rely on
    network access,
    2. an example notebook showing its use. It lives in
    `docs/docs/integrations` directory.
    
    
    - [ ] **Lint and test**: Run `make format`, `make lint` and `make test`
    from the root of the package(s) you've modified. See contribution
    guidelines for more: https://python.langchain.com/docs/contributing/
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    
    ---------
    
    Co-authored-by: Erick Friis <[email protected]>
    erikinfo and efriis authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    4e0a6eb View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    a8561bc View commit details
    Browse the repository at this point in the history
  9. community : [bugfix] Use document ids as keys in AzureSearch vectorst…

    …ore (langchain-ai#25486)
    
    # Description
    [Vector store base
    class](https://github.com/langchain-ai/langchain/blob/4cdaca67dc51dba887289f56c6fead3c1a52f97d/libs/core/langchain_core/vectorstores/base.py#L65)
    currently expects `ids` to be passed in and that is what it passes along
    to the AzureSearch vector store when attempting to `add_texts()`.
    However AzureSearch expects `keys` to be passed in. When they are not
    present, AzureSearch `add_embeddings()` makes up new uuids. This is a
    problem when trying to run indexing. [Indexing code
    expects](https://github.com/langchain-ai/langchain/blob/b297af5482ae7c6d26779513d637ec657a1cd552/libs/core/langchain_core/indexing/api.py#L371)
    the documents to be uploaded using provided ids. Currently AzureSearch
    ignores `ids` passed from `indexing` and makes up new ones. Later when
    `indexer` attempts to delete removed file, it uses the `id` it had
    stored when uploading the document, however it was uploaded under
    different `id`.
    
    **Twitter handle: @martintriska1**
    MacanPN authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    3fc0ea5 View commit details
    Browse the repository at this point in the history
  10. community: remove sambaverse (langchain-ai#26265)

    removing Sambaverse llm model and references given is not available
    after Sep/10/2024
    
    <img width="1781" alt="image"
    src="https://github.com/user-attachments/assets/4dcdb5f7-5264-4a03-b8e5-95c88304e059">
    jhpiedrahitao authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    37b7202 View commit details
    Browse the repository at this point in the history
  11. community: fix error in sambastudio embeddings (langchain-ai#26260)

    fix error in samba studio embeddings  result unpacking
    jhpiedrahitao authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    55b641b View commit details
    Browse the repository at this point in the history
  12. [community] Added PebbloTextLoader for loading text data in PebbloSaf…

    …eLoader (langchain-ai#26582)
    
    - **Description:** Added PebbloTextLoader for loading text in
    PebbloSafeLoader.
    - Since PebbloSafeLoader wraps document loaders, this new loader enables
    direct loading of text into Documents using PebbloSafeLoader.
    - **Issue:** NA
    - **Dependencies:** NA
    - [x] **Tests**: Added/Updated tests
    Raj725 authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    60dc19d View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    4d3d62c View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    f91bdd1 View commit details
    Browse the repository at this point in the history
  15. docs: highlight styling (langchain-ai#26636)

    MERGE ME PLEASE
    efriis authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    28dd656 View commit details
    Browse the repository at this point in the history
  16. unstructured[patch]: add to integration tests (langchain-ai#26666)

    - Add to tests on parsed content;
    - Add tests for async + lazy loading;
    - Add a test for `strategy="hi_res"`.
    ccurme authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    7d49ee9 View commit details
    Browse the repository at this point in the history
  17. [community] Fix WorkspaceClient error with pydantic validation (langc…

    …hain-ai#26649)
    
    Thank you for contributing to LangChain!
    
    Fix error like
    <img width="1167" alt="image"
    src="https://github.com/user-attachments/assets/2e219b26-ec7e-48ef-8111-e0ff2f5ac4c0">
    
    After the fix:
    <img width="584" alt="image"
    src="https://github.com/user-attachments/assets/48f36fe7-628c-48b6-81b2-7fe741e4ca85">
    
    
    - [ ] **Add tests and docs**: If you're adding a new integration, please
    include
    1. a test for the integration, preferably unit tests that do not rely on
    network access,
    2. an example notebook showing its use. It lives in
    `docs/docs/integrations` directory.
    
    
    - [ ] **Lint and test**: Run `make format`, `make lint` and `make test`
    from the root of the package(s) you've modified. See contribution
    guidelines for more: https://python.langchain.com/docs/contributing/
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    
    ---------
    
    Signed-off-by: serena-ruan <[email protected]>
    Co-authored-by: Erick Friis <[email protected]>
    serena-ruan and efriis authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    c77c28e View commit details
    Browse the repository at this point in the history
  18. core, community: move graph vectorstores to community (langchain-ai#2…

    …6678)
    
    remove beta namespace from core, add to community
    efriis authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    311f861 View commit details
    Browse the repository at this point in the history
  19. unstructured[patch]: support loading URLs (langchain-ai#26670)

    `unstructured.partition.auto.partition` supports a `url` kwarg, but
    `url` in `UnstructuredLoader.__init__` is reserved for the server URL.
    Here we add a `web_url` kwarg that is passed to the partition kwargs:
    ```python
    self.unstructured_kwargs["url"] = web_url
    ```
    ccurme authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    eef18de View commit details
    Browse the repository at this point in the history
  20. ci: restore qa template that was known to work (langchain-ai#26684)

    Restore qa template that was working
    eyurtsev authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    e8236e5 View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    409f353 View commit details
    Browse the repository at this point in the history
  22. core[patch]: Fix load of ChatBedrock (langchain-ai#26679)

    Complementary PR to master for langchain-ai#26643.
    
    Co-authored-by: Bagatur <[email protected]>
    3coins and baskaryan authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    f087ab4 View commit details
    Browse the repository at this point in the history
  23. Configuration menu
    Copy the full SHA
    c453b76 View commit details
    Browse the repository at this point in the history
  24. Configuration menu
    Copy the full SHA
    f7bb364 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. Update tool_calling.ipynb (langchain-ai#26699)

    There is a small bug in "TypedDict class" sample source.
    
    Thank you for contributing to LangChain!
    
    - [ ] **PR title**: "package: description"
    - Where "package" is whichever of langchain, community, core,
    experimental, etc. is being modified. Use "docs: ..." for purely docs
    changes, "templates: ..." for template changes, "infra: ..." for CI
    changes.
      - Example: "community: add foobar LLM"
    
    
    - [ ] **PR message**: ***Delete this entire checklist*** and replace
    with
        - **Description:** a description of the change
        - **Issue:** the issue # it fixes, if applicable
        - **Dependencies:** any dependencies required for this change
    - **Twitter handle:** if your PR gets announced, and you'd like a
    mention, we'll gladly shout you out!
    
    
    - [ ] **Add tests and docs**: If you're adding a new integration, please
    include
    1. a test for the integration, preferably unit tests that do not rely on
    network access,
    2. an example notebook showing its use. It lives in
    `docs/docs/integrations` directory.
    
    
    - [ ] **Lint and test**: Run `make format`, `make lint` and `make test`
    from the root of the package(s) you've modified. See contribution
    guidelines for more: https://python.langchain.com/docs/contributing/
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    guoqiang0401 authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    8f0c04f View commit details
    Browse the repository at this point in the history
  2. fix:fix ChatZhipuAI tool call bug (langchain-ai#26693)

    - [ ] **PR title**: "community:fix ChatZhipuAI tool call bug"
    
    - [ ] **Description:** ZhipuAI api response as follows:
    {'id': '20240920132549e379a9152a6a4d7c', 'created': 1726809949, 'model':
    'glm-4-flash', 'choices': [{'index': 0, 'finish_reason': 'tool_calls',
    'delta': {'role': 'assistant', 'tool_calls': [{'id':
    'call_20240920132549e379a9152a6a4d7c', 'index': 0, 'type': 'function',
    'function': {'name': 'get_datetime_offline', 'arguments': '{}'}}]}}]}
    so, tool_calls = dct.get("tool_call", None) in
    _convert_delta_to_message_chunk should be "tool_calls"
    stein1988 authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    9159492 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    eeab6a6 View commit details
    Browse the repository at this point in the history
  4. docs: Add migration instructions for v0.0.x memory abstractions (lang…

    …chain-ai#26668)
    
    This PR adds a migration guide for any code that relies on old memory
    abstractions.
    eyurtsev authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    acf8c2c View commit details
    Browse the repository at this point in the history
  5. Improvement[text-splitter] Fix import of `ExperimentalMarkdownSyntaxT…

    …extSplitter` (langchain-ai#26703)
    
    langchain-ai#26028 
    
    Export `ExperimentalMarkdownSyntaxTextSplitter` in __init__
    
    Co-authored-by: Erick Friis <[email protected]>
    ZhangShenao and efriis authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    baef763 View commit details
    Browse the repository at this point in the history
  6. support epsilla cloud vector database in langchain (langchain-ai#26065)

    Description
    
    - support epsilla cloud in langchain
    
    ---------
    
    Co-authored-by: Leonid Ganeline <[email protected]>
    Co-authored-by: Chester Curme <[email protected]>
    3 people authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    90031b1 View commit details
    Browse the repository at this point in the history
  7. Avoid copying runs (langchain-ai#26689)

    Also, re-unify run trees. Use a single shared client.
    hinthornw authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    19ce95d View commit details
    Browse the repository at this point in the history
  8. core[patch],langchain[patch]: deprecate memory and entity abstraction…

    …s and implementations (langchain-ai#26717)
    
    This PR deprecates the old memory, entity abstractions and implementations
    eyurtsev authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    91f4711 View commit details
    Browse the repository at this point in the history
  9. docs: Update trim message usage in migrating_memory (langchain-ai#26722)

    Make sure we don't end up with a ToolMessage that precedes an AIMessage
    eyurtsev authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    8a9f709 View commit details
    Browse the repository at this point in the history
  10. core/langchain: fix version used in deprecation (langchain-ai#26724)

    in core deprecation should be version 0.3.3 instead of 0.3.4
    in langchain deprecation should be version 0.3.1 instead of 0.3.4
    eyurtsev authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    79b224f View commit details
    Browse the repository at this point in the history
  11. core[patch]: Fix defusedxml import (langchain-ai#26718)

    Fix defusedxml import. Haven't investigated what's actually going on
    under the hood -- defusedxml probably does some weird things in __init__
    eyurtsev authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    4fc69d6 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    465e43c View commit details
    Browse the repository at this point in the history
  13. core: In astream_events propagate cancellation reason to inner task (l…

    …angchain-ai#26727)
    
    Thank you for contributing to LangChain!
    
    - [ ] **PR title**: "package: description"
    - Where "package" is whichever of langchain, community, core,
    experimental, etc. is being modified. Use "docs: ..." for purely docs
    changes, "templates: ..." for template changes, "infra: ..." for CI
    changes.
      - Example: "community: add foobar LLM"
    
    
    - [ ] **PR message**: ***Delete this entire checklist*** and replace
    with
        - **Description:** a description of the change
        - **Issue:** the issue # it fixes, if applicable
        - **Dependencies:** any dependencies required for this change
    - **Twitter handle:** if your PR gets announced, and you'd like a
    mention, we'll gladly shout you out!
    
    
    - [ ] **Add tests and docs**: If you're adding a new integration, please
    include
    1. a test for the integration, preferably unit tests that do not rely on
    network access,
    2. an example notebook showing its use. It lives in
    `docs/docs/integrations` directory.
    
    
    - [ ] **Lint and test**: Run `make format`, `make lint` and `make test`
    from the root of the package(s) you've modified. See contribution
    guidelines for more: https://python.langchain.com/docs/contributing/
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    nfcampos authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    345edeb View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    4a27450 View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    f228537 View commit details
    Browse the repository at this point in the history
  16. huggingface; fix huggingface_endpoint.py (initialize clients only wit…

    …h supported kwargs) (langchain-ai#26378)
    
    ## Description
    
    By default, `HuggingFaceEndpoint` instantiates both the
    `InferenceClient` and the `AsyncInferenceClient` with the
    `"server_kwargs"` passed as input. This is an issue as both clients
    might not support exactly the same kwargs. This has been highlighted in
    huggingface/huggingface_hub#2522 by
    @morgandiverrez with the `trust_env` parameter. In order to make
    `langchain` integration future-proof, I do think it's wiser to forward
    only the supported parameters to each client. Parameters that are not
    supported are simply ignored with a warning to the user. From a
    `huggingface_hub` maintenance perspective, this allows us much more
    flexibility as we are not constrained to support the exact same kwargs
    in both clients.
    
    ## Issue
    
    huggingface/huggingface_hub#2522
    
    ## Dependencies
    
    None
    
    ## Twitter 
    
    https://x.com/Wauplin
    
    ---------
    
    Co-authored-by: Erick Friis <[email protected]>
    Wauplin and efriis authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    a2023a1 View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    e49c413 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    58f339a View commit details
    Browse the repository at this point in the history
  19. core: fix "template" not allowed as prompt param (langchain-ai#26060)

    - **Description:**  fix "template" not allowed as prompt param
    - **Issue:** langchain-ai#26058
    - **Dependencies:** none
    
    
    - [ ] **Add tests and docs**: If you're adding a new integration, please
    include
    1. a test for the integration, preferably unit tests that do not rely on
    network access,
    2. an example notebook showing its use. It lives in
    `docs/docs/integrations` directory.
    
    
    - [ ] **Lint and test**: Run `make format`, `make lint` and `make test`
    from the root of the package(s) you've modified. See contribution
    guidelines for more: https://python.langchain.com/docs/contributing/
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    
    ---------
    
    Co-authored-by: Erick Friis <[email protected]>
    ikbenale and efriis authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    4ac9a6f View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    a8b2413 View commit details
    Browse the repository at this point in the history
  21. Refining Skip Count Calculation by Filtering Documents with `session_…

    …id` (langchain-ai#26020)
    
    In the previous implementation, `skip_count` was counting all the
    documents in the collection. Instead, we want to filter the documents by
    `session_id` and calculate `skip_count` by subtracting `history_size`
    from the filtered count.
    
    ---------
    
    Co-authored-by: Chester Curme <[email protected]>
    kk9393 and ccurme authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    c6c508e View commit details
    Browse the repository at this point in the history
  22. couchbase: Add ttl support to caches & chat_message_history (langchai…

    …n-ai#26214)
    
    **Description:** Add support to delete documents automatically from the
    caches & chat message history by adding a new optional parameter, `ttl`.
    
    
    - [x] **Add tests and docs**: If you're adding a new integration, please
    include
    1. a test for the integration, preferably unit tests that do not rely on
    network access,
    2. an example notebook showing its use. It lives in
    `docs/docs/integrations` directory.
    
    
    - [x] **Lint and test**: Run `make format`, `make lint` and `make test`
    from the root of the package(s) you've modified. See contribution
    guidelines for more: https://python.langchain.com/docs/contributing/
    
    ---------
    
    Co-authored-by: Nithish Raghunandanan <[email protected]>
    Co-authored-by: Erick Friis <[email protected]>
    3 people authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    2d21274 View commit details
    Browse the repository at this point in the history
  23. Configuration menu
    Copy the full SHA
    864020e View commit details
    Browse the repository at this point in the history
  24. openai: embeddings: supported chunk_size when check_embedding_ctx_len…

    …gth is disabled (langchain-ai#23767)
    
    Chunking of the input array controlled by `self.chunk_size` is being
    ignored when `self.check_embedding_ctx_length` is disabled. Effectively,
    the chunk size is assumed to be equal 1 in such a case. This is
    suprising.
    
    The PR takes into account `self.chunk_size` passed by the user.
    
    ---------
    
    Co-authored-by: Erick Friis <[email protected]>
    adubovik and efriis authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    3e2cb4e View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2024

  1. [LangChainTracer] Omit Chunk (langchain-ai#26602)

    in events / new llm token
    hinthornw authored Sep 21, 2024
    Configuration menu
    Copy the full SHA
    55af6fb View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    238a31b View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2024

  1. community[patch]: Handle empty PR body in get_pull_request in Github …

    …utility (langchain-ai#26739)
    
    **Description:**
    When PR body is empty `get_pull_request` method fails with bellow
    exception.
    
    
    **Issue:**
    ```
    TypeError('expected string or buffer')Traceback (most recent call last):
    
    
      File ".../.venv/lib/python3.9/site-packages/langchain_core/tools/base.py", line 661, in run
        response = context.run(self._run, *tool_args, **tool_kwargs)
    
    
      File ".../.venv/lib/python3.9/site-packages/langchain_community/tools/github/tool.py", line 52, in _run
        return self.api_wrapper.run(self.mode, query)
    
    
      File ".../.venv/lib/python3.9/site-packages/langchain_community/utilities/github.py", line 816, in run
        return json.dumps(self.get_pull_request(int(query)))
    
    
      File ".../.venv/lib/python3.9/site-packages/langchain_community/utilities/github.py", line 495, in get_pull_request
        add_to_dict(response_dict, "body", pull.body)
    
    
      File ".../.venv/lib/python3.9/site-packages/langchain_community/utilities/github.py", line 487, in add_to_dict
        tokens = get_tokens(value)
    
    
      File ".../.venv/lib/python3.9/site-packages/langchain_community/utilities/github.py", line 483, in get_tokens
        return len(tiktoken.get_encoding("cl100k_base").encode(text))
    
    
      File "....venv/lib/python3.9/site-packages/tiktoken/core.py", line 116, in encode
        if match := _special_token_regex(disallowed_special).search(text):
    
    
    TypeError: expected string or buffer
    ```
    
    **Twitter:**  __gorros__
    gorros authored Sep 22, 2024
    Configuration menu
    Copy the full SHA
    f97ac92 View commit details
    Browse the repository at this point in the history
  2. Remove pydantic restricted namespaces from HuggingFaceInferenceAPIEmb…

    …edings (langchain-ai#26744)
    
    without this `model_config` importing this package produces warnings
    about "model_name" having conflicts with protected namespace "model_".
    
    Thank you for contributing to LangChain!
    
    - [ ] **PR title**: "package: description"
    - Where "package" is whichever of langchain, community, core,
    experimental, etc. is being modified. Use "docs: ..." for purely docs
    changes, "templates: ..." for template changes, "infra: ..." for CI
    changes.
      - Example: "community: add foobar LLM"
    
    
    - [ ] **PR message**: ***Delete this entire checklist*** and replace
    with
        - **Description:** a description of the change
        - **Issue:** the issue # it fixes, if applicable
        - **Dependencies:** any dependencies required for this change
    - **Twitter handle:** if your PR gets announced, and you'd like a
    mention, we'll gladly shout you out!
    
    
    - [ ] **Add tests and docs**: If you're adding a new integration, please
    include
    1. a test for the integration, preferably unit tests that do not rely on
    network access,
    2. an example notebook showing its use. It lives in
    `docs/docs/integrations` directory.
    
    
    - [ ] **Lint and test**: Run `make format`, `make lint` and `make test`
    from the root of the package(s) you've modified. See contribution
    guidelines for more: https://python.langchain.com/docs/contributing/
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    
    ---------
    
    Co-authored-by: Chester Curme <[email protected]>
    galtay and ccurme authored Sep 22, 2024
    Configuration menu
    Copy the full SHA
    bb40a0f View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. openai[patch]: enable Azure structured output, parallel_tool_calls=Fa… (

    langchain-ai#26599)
    
    …lse, tool_choice=required
    
    response_format=json_schema, tool_choice=required, parallel_tool_calls
    are all supported for gpt-4o on azure.
    baskaryan authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    e1e4f88 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    fb9ac8d View commit details
    Browse the repository at this point in the history
  3. langchain[patch]: fix extended tests (langchain-ai#26788)

    Broken by addition of `disabled_params`
    ccurme authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    97b27f0 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    bba7af9 View commit details
    Browse the repository at this point in the history
  5. core[patch]: On Chain Start Fix for Chain Class (langchain-ai#26593)

    - **Issue:** langchain-ai#26588
    
    ---------
    
    Co-authored-by: Eugene Yurtsev <[email protected]>
    keenborder786 and eyurtsev authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    154a5ff View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    1ce056d View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    2a4c571 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. docs: make docs mdxv2 compatible (langchain-ai#26798)

    prep for docusaurus migration
    efriis authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    603d38f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    35081d2 View commit details
    Browse the repository at this point in the history
  3. docs: fix mdx codefences (langchain-ai#26802)

    ```
    git grep -l -E '"```\{=mdx\}\\n",' | xargs perl -0777 -i -pe 's/"```\{=mdx\}\\n",\n    (\W.*?),\n\s*"```\\?n?"/$1/s'
    ```
    efriis authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    e40a2b8 View commit details
    Browse the repository at this point in the history
  4. community[patch]: callback before yield for bedrock llm (langchain-ai…

    …#26804)
    
    **Description:** Moves yield to after callback for
    `_prepare_input_and_invoke_stream` and
    `_aprepare_input_and_invoke_stream` for bedrock llm in community
    package.
    **Issue:** langchain-ai#16913
    subroy13 authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    997d95c View commit details
    Browse the repository at this point in the history
  5. community[patch]: Fix tool_calls parsing when streaming from DeepIn…

    …fra (langchain-ai#26813)
    
    - **Description:** This PR fixes the response parsing logic for
    `ChatDeepInfra`, more specifially `_convert_delta_to_message_chunk()`,
    which is invoked when streaming via `ChatDeepInfra`.
    - **Issue:** Streaming from DeepInfra via `ChatDeepInfra` is currently
    broken because the response parsing logic doesn't handle that
    `tool_calls` can be `None`. (There is no GitHub issue for this problem
    yet.)
    - **Dependencies:** –
    - **Twitter handle:** –
    
    Keeping this here as a reminder:
    > If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    thunze authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    2b83c7c View commit details
    Browse the repository at this point in the history
  6. community: Add Sambanova Cloud Chat model community integration (lang…

    …chain-ai#26333)
    
    **Description:** : Add SambaNova Cloud Chat model community integration
    Includes 
    - chat model integration (following Standardize ChatModel docstrings)
    -  tests
    - docs usage notebook (following Standardize ChatModel integration docs)
    
    https://cloud.sambanova.ai/
    
    ---------
    
    Co-authored-by: luisfucros <[email protected]>
    Co-authored-by: ccurme <[email protected]>
    3 people authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    408a930 View commit details
    Browse the repository at this point in the history
  7. core: Run LangChainTracer inline (langchain-ai#26797)

    - this flag ensures the tracer always runs in the same thread as the run
    being traced for both sync and async runs
    - pro: less chance for ordering bugs and other oddities
    - blocking the event loop is not a concern given all code in the tracer
    holds the GIL anyway
    nfcampos authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    de70a64 View commit details
    Browse the repository at this point in the history
  8. community[patch]: callback before yield for deepsparse llm (langchain…

    …-ai#26822)
    
    **Description:** Moves yield to after callback for `_stream` and
    `_astream` function for the deepsparse model in the community package
    **Issue:** langchain-ai#16913
    subroy13 authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    b1da532 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    f9ef688 View commit details
    Browse the repository at this point in the history
  10. experimental[major]: CVE-2024-46946 fix (langchain-ai#26783)

    Description: Resolve CVE-2024-46946 by switching out sympify with
    parse_expr with a very specific allowed set of operations.
    
    https://nvd.nist.gov/vuln/detail/cve-2024-46946
    
    Sympify uses eval which makes it vulnerable to code execution.
    parse_expr is limited to specific expressions.
    
    Bandit results
    
    ![image](https://github.com/user-attachments/assets/170a6376-7028-4e70-a7ef-9acfb49c1d8a)
    
    ---------
    
    Co-authored-by: aqiu7 <[email protected]>
    Co-authored-by: Eugene Yurtsev <[email protected]>
    Co-authored-by: Eugene Yurtsev <[email protected]>
    4 people authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    0414be4 View commit details
    Browse the repository at this point in the history
  11. partners/unstructured: release 0.1.5 (langchain-ai#26831)

    **Description:** update package version to support loading URLs langchain-ai#26670
    **Issue:**  langchain-ai#26697
    Coniferish authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    6c3ea26 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    425c0f3 View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    9526936 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    3796e14 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Configuration menu
    Copy the full SHA
    9b6ac41 View commit details
    Browse the repository at this point in the history
  2. [Core] Add more interops tests (langchain-ai#26841)

    To test that the client propagates both ways
    hinthornw authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    82b5b77 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    13acf9e View commit details
    Browse the repository at this point in the history
  4. community[patch]: callback before yield for friendli (langchain-ai#26842

    )
    
    **Description:** Moves yield to after callback for `_stream` and
    `_astream` function for the friendli model in the community package
    **Issue:** langchain-ai#16913
    subroy13 authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    b61fb98 View commit details
    Browse the repository at this point in the history
  5. community[patch]: [SharePointLoader] Fix validation error in _O365Set…

    …tings due to extra fields in .env file (langchain-ai#26851)
    
    **Description:** Fix validation error in _O365Settings by ignoring extra
    fields in .env file
    **Issue:** langchain-ai#26850
    **Dependencies:** NA
    Raj725 authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    92003b3 View commit details
    Browse the repository at this point in the history
  6. community[minor]: [Pebblo] Enhance PebbloSafeLoader to take anonymize…

    … flag (langchain-ai#26812)
    
    - **Description:** The flag is named `anonymize_snippets`. When set to
    true, the Pebblo server will anonymize snippets by redacting all
    personally identifiable information (PII) from the snippets going into
    VectorDB and the generated reports
    - **Issue:** NA
    - **Dependencies:** NA
    - **docs**: Updated
    Raj725 authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    7e5a9c3 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    3a1b925 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    27c1214 View commit details
    Browse the repository at this point in the history
  9. Update main README.md to reference latest version of documentation (l…

    …angchain-ai#26854)
    
    Update README.md to point at latest docs
    DGaffney authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    d502858 View commit details
    Browse the repository at this point in the history
  10. community[patch]: Fix validation error in SettingsConfigDict across m…

    …ultiple Langchain modules (langchain-ai#26852)
    
    - **Description:** This pull request addresses the validation error in
    `SettingsConfigDict` due to extra fields in the `.env` file. The issue
    is prevalent across multiple Langchain modules. This fix ensures that
    extra fields in the `.env` file are ignored, preventing validation
    errors.
      **Changes include:**
        - Applied fixes to modules using `SettingsConfigDict`.
    
    - **Issue:** NA, similar
    langchain-ai#26850
    - **Dependencies:** NA
    Raj725 authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    51c4393 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    eaffa92 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    a001006 View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    87e2149 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    ef2ab26 View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    9a31ad6 View commit details
    Browse the repository at this point in the history
  16. 0.3.1 release community (langchain-ai#26872)

    Release for 0.3.1
    
    ---------
    
    Co-authored-by: Erick Friis <[email protected]>
    eyurtsev and efriis authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    25cb44c View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    e068407 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    6f3c831 View commit details
    Browse the repository at this point in the history
  19. docs: update extraction_examples.ipynb (langchain-ai#26874)

    The `Without examples 😿` and `With examples 😻` should have different
    outputs to illustrate their point.
    
    See v0.2 docs.
    https://python.langchain.com/docs/how_to/extraction_examples/#without-examples-
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    jackpeplinski authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    edf879d View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Configuration menu
    Copy the full SHA
    c750600 View commit details
    Browse the repository at this point in the history
  2. experimental: migrate to external repo (langchain-ai#26879)

    security scanners can't distinguish monorepo sources from each other.
    this will resolve issues for folks trying to use e.g. langchain-core but
    getting security issues from experimental flagged!
    efriis authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    2ea5f60 View commit details
    Browse the repository at this point in the history
  3. openai[patch]: increase token limit in azure integration tests (langc…

    …hain-ai#26901)
    
    `test_json_mode` occasionally runs into this
    ccurme authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    7091a1a View commit details
    Browse the repository at this point in the history
  4. core: Fix IndexError when trim_messages invoked with empty list (l…

    …angchain-ai#26896)
    
    This prevents `trim_messages` from raising an `IndexError` when invoked
    with `include_system=True`, `strategy="last"`, and an empty message
    list.
    
    Fixes langchain-ai#26895
    
    Dependencies: none
    sudosays authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    121e79b View commit details
    Browse the repository at this point in the history
  5. community[patch]: callback before yield for google palm (langchain-ai…

    …#26882)
    
    **Description:** Moves yield to after callback for `_stream` function
    for the google palm model in the community package
    **Issue:** langchain-ai#16913
    subroy13 authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    11e703a View commit details
    Browse the repository at this point in the history
  6. community[patch]: callback before yield for gigachat (langchain-ai#26881

    )
    
    **Description:** Moves yield to after callback for `_stream` and
    `_astream` function for the gigachat model in the community llm package
    **Issue:** langchain-ai#16913
    subroy13 authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    ba467f1 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    7a99a4d View commit details
    Browse the repository at this point in the history
  8. docs: Fix trim_messages invocations in the memory migration guide (la…

    …ngchain-ai#26902)
    
    Should only be start_on="human", not start_on=("human", "ai")
    eyurtsev authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    2a0d9d0 View commit details
    Browse the repository at this point in the history
  9. voyageai: new models (langchain-ai#26907)

    Co-authored-by: fzowl <[email protected]>
    Co-authored-by: fzowl <[email protected]>
    3 people authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    8bc12df View commit details
    Browse the repository at this point in the history
  10. community: add sqlite-vec vectorstore (langchain-ai#25003)

    **Description**:
    
    Adds a vector store integration with
    [sqlite-vec](https://alexgarcia.xyz/sqlite-vec/), the successor to
    sqlite-vss that is a single C file with no external dependencies.
    
    Pretty straightforward, just copy-pasted the sqlite-vss integration and
    made a few tweaks and added integration tests. Only question is whether
    all documentation should be directed away from sqlite-vss if it is
    defacto deprecated (cc @asg017).
    
    ---------
    
    Co-authored-by: Erick Friis <[email protected]>
    Co-authored-by: philippe-oger <[email protected]>
    3 people authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    696114e View commit details
    Browse the repository at this point in the history
  11. docs: add api referencs to langgraph (langchain-ai#26877)

    Add api references to langgraph
    eyurtsev authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    02f5962 View commit details
    Browse the repository at this point in the history
  12. core[fix]: using async rate limiter methods in async code (langchain-…

    …ai#26914)
    
    **Description:** Replaced blocking (sync) rate_limiter code in async
    methods.
    
    **Issue:** langchain-ai#26913
    
    **Dependencies:** N/A
    
    **Twitter handle:** no need 🤗
    esciara authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    c6350d6 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. community[patch]: callback before yield for titan takeoff (langchain-…

    …ai#26930)
    
    **Description:** Moves yield to after callback for `_stream` function
    for the titan takeoff model in the community llm package
    **Issue:** langchain-ai#16913
    subroy13 authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    5f2cc4e View commit details
    Browse the repository at this point in the history
  2. community[patch]: callback before yield for textgen (langchain-ai#26929)

    **Description:** Moves callback to before yield for `_stream` and
    `_astream` function for the textgen model in the community llm package
    **Issue:** langchain-ai#16913
    subroy13 authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    adcfecd View commit details
    Browse the repository at this point in the history
  3. community[patch]: callback before yield for mlx pipeline (langchain-a…

    …i#26928)
    
    **Description:** Moves yield to after callback for `_stream` function
    for the MLX pipeline model in the community llm package
    **Issue:** langchain-ai#16913
    subroy13 authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    7037ba0 View commit details
    Browse the repository at this point in the history
  4. Fix typo in mlflow code example in mlflow.py (langchain-ai#26931)

    - [x] PR title: Fix typo in code example in mlflow.py
    - In libs/community/langchain_community/chat_models/mlflow.py
    Youshin authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    2d9a09d View commit details
    Browse the repository at this point in the history
  5. community[patch]: callback before yield for cloudflare (langchain-ai#…

    …26927)
    
    **Description:** Moves yield to after callback for `_stream` function
    for the cloudfare workersai model in the community llm package
    **Issue:** langchain-ai#16913
    subroy13 authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    7f37fd8 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    39987eb View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    836c2a4 View commit details
    Browse the repository at this point in the history
  8. core: Add ruff rules for PIE (langchain-ai#26939)

    All auto-fixes.
    cbornet authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    f4e738b View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    c38ea7a View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    135164e View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    9eb26c5 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    67df944 View commit details
    Browse the repository at this point in the history
  13. infra[patch]: update notebooks workflow (langchain-ai#26956)

    Addressing some lingering comments from
    langchain-ai#26944, adding parameters
    for
    - python version
    - working directory
    
    ![Screenshot 2024-09-27 at 3 33
    21 PM](https://github.com/user-attachments/assets/dfa45772-fddb-4489-a148-c9ed83d844d0)
    ccurme authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    44eddd3 View commit details
    Browse the repository at this point in the history
  14. docs: Upgrade examples with RunnableWithMessageHistory to langgraph m…

    …emory (langchain-ai#26855)
    
    This PR updates the documentation examples that used
    RunnableWithMessageHistory to show how to achieve the same
    implementation with langgraph memory.
    
    Some of the underlying PRs (not all of them):
    
    - docs[patch]: update chatbot tutorial and migration guide (langchain-ai#26780)
    - docs[patch]: update chatbot memory how-to (langchain-ai#26790)
    - docs[patch]: update chatbot tools how-to (langchain-ai#26816)
    - docs: update chat history in rag how-to (langchain-ai#26821)
    - docs: update trim messages notebook (langchain-ai#26793)
    - docs: clean up imports in how to guide for rag qa with chat history
    (langchain-ai#26825)
    - docs[patch]: update conversational rag tutorial (langchain-ai#26814)
    
    ---------
    
    Co-authored-by: ccurme <[email protected]>
    Co-authored-by: Vadym Barda <[email protected]>
    Co-authored-by: mercyspirit <[email protected]>
    Co-authored-by: aqiu7 <[email protected]>
    Co-authored-by: John <[email protected]>
    Co-authored-by: Erick Friis <[email protected]>
    Co-authored-by: William FH <[email protected]>
    Co-authored-by: Subhrajyoty Roy <[email protected]>
    Co-authored-by: Rajendra Kadam <[email protected]>
    Co-authored-by: Christophe Bornet <[email protected]>
    Co-authored-by: Devin Gaffney <[email protected]>
    Co-authored-by: Bagatur <[email protected]>
    13 people authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    de0b48c View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    7809b31 View commit details
    Browse the repository at this point in the history
  16. community: Add conversions from GVS to networkx (langchain-ai#26906)

    These allow converting linked documents (such as those used with
    GraphVectorStore) to networkx for rendering and/or in-memory graph
    algorithms such as community detection.
    bjchambers authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    29bf89d View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    b2c3159 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2024

  1. docs: update code interpreter tool table to reflect riza file upload …

    …support (langchain-ai#26960)
    
    **Description:** Update the code interpreter tools feature table to
    reflect Riza file upload support (blog announcement here:
    https://riza.io/blog/adding-support-for-input-files-and-http-credentials)
    **Issue:** N/A
    **Dependencies:** N/A
    andrewmbenton authored Sep 29, 2024
    Configuration menu
    Copy the full SHA
    ce2669c View commit details
    Browse the repository at this point in the history
  2. openai[patch]: exclude http client (langchain-ai#26891)

    httpx clients aren't serializable
    baskaryan authored Sep 29, 2024
    Configuration menu
    Copy the full SHA
    9404e7a View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. Configuration menu
    Copy the full SHA
    db8845a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c7120d8 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    0078493 View commit details
    Browse the repository at this point in the history
  4. core[patch]: fix structured prompt template format (langchain-ai#27003)

    template_format is an init argument on ChatPromptTemplate but not an
    attribute on the object so was getting shoved into
    StructuredPrompt.structured_ouptut_kwargs
    baskaryan authored Sep 30, 2024
    Configuration menu
    Copy the full SHA
    248be02 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    34bd718 View commit details
    Browse the repository at this point in the history
  6. Merge pull request langchain-ai#26794

    * [chore]: Agent Observation should be casted to string to avoid errors
    
    * Merge branch 'master' into fix_observation_type_streaming
    
    * [chore]: Using Json.dumps
    
    * [chore]: Exact same logic as  when casting agent oobservation to string
    keenborder786 authored Sep 30, 2024
    Configuration menu
    Copy the full SHA
    e12f570 View commit details
    Browse the repository at this point in the history
  7. docs: Fix typo in list of PDF loaders (langchain-ai#26774)

    Description: Fix typo in list of PDF loaders.
    
    Co-authored-by: Eugene Yurtsev <[email protected]>
    ronnix and eyurtsev authored Sep 30, 2024
    Configuration menu
    Copy the full SHA
    19ed316 View commit details
    Browse the repository at this point in the history
  8. community[patch]: Add docstring for Links (langchain-ai#25969)

    Co-authored-by: Eugene Yurtsev <[email protected]>
    cbornet and eyurtsev authored Sep 30, 2024
    Configuration menu
    Copy the full SHA
    2a6abd3 View commit details
    Browse the repository at this point in the history
  9. core[patch]: Add kwargs to Runnable (langchain-ai#27008)

    Fixes langchain-ai#26685
    
    ---------
    
    Co-authored-by: Tibor Reiss <[email protected]>
    eyurtsev and tibor-reiss authored Sep 30, 2024
    Configuration menu
    Copy the full SHA
    7fde279 View commit details
    Browse the repository at this point in the history
  10. core[patch]: improve index/aindex api when batch_size<n_docs (langcha…

    …in-ai#25754)
    
    - **Description:** prevent index function to re-index entire source
    document even if nothing has changed.
    - **Issue:** langchain-ai#22135
    
    I worked on a solution to this issue that is a compromise between being
    cheap and being fast.
    In the previous code, when batch_size is greater than the number of docs
    from a certain source almost the entire source is deleted (all documents
    from that source except for the documents in the first batch)
    My solution deletes documents from vector store and record manager only
    if at least one document has changed for that source.
    
    Hope this can help!
    
    ---------
    
    Co-authored-by: Eugene Yurtsev <[email protected]>
    federico-pisanu and eyurtsev authored Sep 30, 2024
    Configuration menu
    Copy the full SHA
    2538963 View commit details
    Browse the repository at this point in the history
  11. docs: GremlinGraph Remove = in the URL (langchain-ai#26705)

    - **Description:** URL is appended with = which is not working
        - **Issue:** removing the = symbol makes the URL valid
        - **Twitter handle:** @arunprakash_com
    
    Co-authored-by: Erick Friis <[email protected]>
    arunprakash and efriis authored Sep 30, 2024
    Configuration menu
    Copy the full SHA
    870bd42 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    446144e View commit details
    Browse the repository at this point in the history
  13. doc: grammar fix on index.mdx (langchain-ai#26771)

    Thank you for contributing to LangChain!
    
    - [x] **PR title**: "package: description"
    - Where "package" is whichever of langchain, community, core,
    experimental, etc. is being modified. Use "docs: ..." for purely docs
    changes, "templates: ..." for template changes, "infra: ..." for CI
    changes.
      - Example: "community: add foobar LLM"
    
    
    The PR is an adjustment on few grammar adjustments on the page.
    @leomofthings is my twitter handle
    
    
    
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    
    Co-authored-by: Erick Friis <[email protected]>
    CodeLeom and efriis authored Sep 30, 2024
    Configuration menu
    Copy the full SHA
    5346c7b View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    6a861b0 View commit details
    Browse the repository at this point in the history
  15. Update FeatureTables.js to add Weaviate (langchain-ai#26824)

    Thank you for contributing to LangChain!
    
    
    - [x] **PR message**: 
        - Add Weaviate to the vector store list.
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    
    Co-authored-by: Erick Friis <[email protected]>
    erika-cardenas and efriis authored Sep 30, 2024
    Configuration menu
    Copy the full SHA
    4a32cc3 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. Configuration menu
    Copy the full SHA
    7ecd720 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    35f6393 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a8e1577 View commit details
    Browse the repository at this point in the history
  4. Bug-Fix[Community] Fix FastEmbedEmbeddings (langchain-ai#26764)

    langchain-ai#26759 
    
    - Fix langchain-ai#26759 
    - Change `model` param from private to public, which may not be
    initiated.
    - Add test case
    ZhangShenao authored Oct 1, 2024
    Configuration menu
    Copy the full SHA
    e317d45 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    95a8729 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    f758319 View commit details
    Browse the repository at this point in the history
  7. core[patch]: fix init of RunnableAssign (langchain-ai#26903)

    Example in API ref currently raises ValidationError.
    
    Resolves langchain-ai#26862
    ccurme authored Oct 1, 2024
    Configuration menu
    Copy the full SHA
    9d10151 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    b5e28d3 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    5f2e93f View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    099235d View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    e806e9d View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. core[patch]: Support injected tool args that are arbitrary types (lan…

    …gchain-ai#27045)
    
    This adds support for inject tool args that are arbitrary types when
    used with pydantic 2.
    
    We'll need to add similar logic on the v1 path, and potentially mirror
    the config from the original model when we're doing the subset.
    eyurtsev authored Oct 2, 2024
    Configuration menu
    Copy the full SHA
    74bf620 View commit details
    Browse the repository at this point in the history
  2. core[patch]: Release 0.3.8 (langchain-ai#27046)

    0.3.8 release for core
    eyurtsev authored Oct 2, 2024
    Configuration menu
    Copy the full SHA
    635c55c View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. Configuration menu
    Copy the full SHA
    907c758 View commit details
    Browse the repository at this point in the history
  2. community[patch]: chore warn deprecate the wandb callback handler (la…

    …ngchain-ai#27062)
    
    - **Description:**: This PR deprecates the wandb callback handler in
    favor of the new
    [WeaveTracer](https://weave-docs.wandb.ai/guides/integrations/langchain#using-weavetracer)
    in W&B
    - **Dependencies:** No dependencies, just a deprecation warning.
    - **Twitter handle:** @parambharat
    
    
    @baskaryan
    parambharat authored Oct 3, 2024
    Configuration menu
    Copy the full SHA
    103e573 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2a54448 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    47a9199 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    7f730ce View commit details
    Browse the repository at this point in the history
  6. docs: Documentation update for Document Parse (langchain-ai#26844)

    Renamed `Layout Analysis` to `Document Parser` in the doc as we have
    recently renamed it!
    
    ---------
    
    Co-authored-by: Erick Friis <[email protected]>
    chosh0615 and efriis authored Oct 3, 2024
    Configuration menu
    Copy the full SHA
    cc1b8b3 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    546dc44 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    c09da53 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    87fc5ce View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    ab4dab9 View commit details
    Browse the repository at this point in the history
  11. docs: Integrations NVIDIA llm documentation (langchain-ai#26934)

    **Description:**
    
    Add Notebook for NVIDIA prompt completion llm class.
    
    cc: @sumitkbh @mattf @dglogo
    
    ---------
    
    Co-authored-by: Erick Friis <[email protected]>
    raspawar and efriis authored Oct 3, 2024
    Configuration menu
    Copy the full SHA
    47142eb View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    2715bed View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. openai: fix None token detail (langchain-ai#27091)

    happens in Azure
    efriis authored Oct 4, 2024
    Configuration menu
    Copy the full SHA
    e8e5d67 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0495b7f View commit details
    Browse the repository at this point in the history
  3. core,integrations[minor]: Dont error on fields in model_kwargs (langc…

    …hain-ai#27110)
    
    Given the current erroring behavior, every time we've moved a kwarg from
    model_kwargs and made it its own field that was a breaking change.
    Updating this behavior to support the old instantiations /
    serializations.
    
    Assuming build_extra_kwargs was not something that itself is being used
    externally and needs to be kept backwards compatible
    baskaryan authored Oct 4, 2024
    Configuration menu
    Copy the full SHA
    4935a14 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1e768a9 View commit details
    Browse the repository at this point in the history
  5. box: Add citation support to langchain_box.retrievers.BoxRetriever wh…

    …en used with Box AI (langchain-ai#27012)
    
    Thank you for contributing to LangChain!
    
    **Description:** Box AI can return responses, but it can also be
    configured to return citations. This change allows the developer to
    decide if they want the answer, the citations, or both. Regardless of
    the combination, this is returned as a single List[Document] object.
    
    **Dependencies:** Updated to the latest Box Python SDK, v1.5.1
    **Twitter handle:** BoxPlatform
    
    
    - [x] **Add tests and docs**: If you're adding a new integration, please
    include
    1. a test for the integration, preferably unit tests that do not rely on
    network access,
    2. an example notebook showing its use. It lives in
    `docs/docs/integrations` directory.
    
    
    - [x] **Lint and test**: Run `make format`, `make lint` and `make test`
    from the root of the package(s) you've modified. See contribution
    guidelines for more: https://python.langchain.com/docs/contributing/
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    
    Co-authored-by: Erick Friis <[email protected]>
    shurrey and efriis authored Oct 4, 2024
    Configuration menu
    Copy the full SHA
    558fb4d View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    11df1b2 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    414fe16 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    98942ed View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    827bdf4 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    bd5b335 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    64a16f2 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    0b8416b View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    06ce5d1 View commit details
    Browse the repository at this point in the history
  14. docs: update Google Spanner Vector Store documentation (langchain-ai#…

    …27124)
    
    Thank you for contributing to LangChain!
    
    - [X] **PR title**: "package: description"
    - Where "package" is whichever of langchain, community, core, etc. is
    being modified. Use "docs: ..." for purely docs changes, "templates:
    ..." for template changes, "infra: ..." for CI changes.
      - Example: "community: add foobar LLM"
    
    
    - [x] **PR message**: ***Delete this entire checklist*** and replace
    with
        - **Description:** Update Spanner VS integration doc
        - **Issue:** None
        - **Dependencies:** None
        - **Twitter handle:** NA
    
    
    - [x] **Add tests and docs**: If you're adding a new integration, please
    include
    1. a test for the integration, preferably unit tests that do not rely on
    network access,
    2. an example notebook showing its use. It lives in
    `docs/docs/integrations` directory.
    
    
    - [x] **Lint and test**: Run `make format`, `make lint` and `make test`
    from the root of the package(s) you've modified. See contribution
    guidelines for more: https://python.langchain.com/docs/contributing/
    
    Additional guidelines:
    - Make sure optional dependencies are imported within a function.
    - Please do not add dependencies to pyproject.toml files (even optional
    ones) unless they are required for unit tests.
    - Most PRs should not touch more than one package.
    - Changes should be backwards compatible.
    - If you are adding something to community, do not re-import it in
    langchain.
    
    If no one reviews your PR within a few days, please @-mention one of
    baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.
    
    Co-authored-by: Erick Friis <[email protected]>
    averikitsch and efriis authored Oct 4, 2024
    Configuration menu
    Copy the full SHA
    7a07196 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. community[patch]: update gpt-4o cost (langchain-ai#27038)

    updated OpenAI cost definition according to the following:
    https://openai.com/api/pricing/
    ogawa65a authored Oct 7, 2024
    Configuration menu
    Copy the full SHA
    07dd8dd View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. Policy propagation draft 1

    # Conflicts:
    #	libs/community/langchain_community/chains/pebblo_retrieval/utilities.py
    Raj725 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    2f48164 View commit details
    Browse the repository at this point in the history
  2. Fix lint errors

    Raj725 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    e3c45d1 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    d7a8e71 View commit details
    Browse the repository at this point in the history
  4. Fix types

    Raj725 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    baf92a4 View commit details
    Browse the repository at this point in the history
  5. Fix errors

    Raj725 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    2631299 View commit details
    Browse the repository at this point in the history
  6. Update logs

    Raj725 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    614ba03 View commit details
    Browse the repository at this point in the history
  7. Set Cloud as Policy source

    Raj725 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    170964f View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. Merge branch 'PebbloRetrievalQA/policy_propagation' of github.com:Raj…

    …725/langchain into PebbloRetrievalQA/policy_propagation
    Raj725 committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    4c46f05 View commit details
    Browse the repository at this point in the history