Skip to content

Latest commit

 

History

History
208 lines (108 loc) · 7.3 KB

langchain_evaluation.md

File metadata and controls

208 lines (108 loc) · 7.3 KB

Project Evaluation Activity

Project Name:
Langchain

Finding info about contributing on the website.

In the following section you should only enter the information that you found on the project website. Some of the answers will be impossible to find, others may be very hard to find. Do not google for answers.

Project website: Langchain

What is the purpose of the project: Provide tools and framework to use LLMs

How easy was it to find information about contributing on the website? I had to click around but they have a page for it.

Contributing instructions: Contributing

URL for the code repository: Code repository

Bug/Issue tracker link: Bug/Issue tracker Mailing list: [Mailing list](insert link here)

Chat channel: Chat channel

Other communication channels:

Finding info at the project repository and bug/issue tracker.

License: MIT

Is it OSI approved license: Yes

Programming Language(s): Python or JS/TS

URL for contributing instructions: Contributing instructions

Are the contributing instructions clear? Yes

URL for code of conduct / community norms / community guildelines: Community Guidelines

URL for instructions for users to download and install the package: here.

Are these instructions clear? Do you think they would be easy to follow? Yes, simple pip installation

URL for instructions for how to install development environment: here

Are these instruction clear? Do you think they would be easy to follow? There is a lot of information and things to do, but seems straightforward

Number of contributors: 2390 contributors

Usernames of three contributors with largest number of commits; for each of them list the link to their latest commit:

All on March 1, 2024

  1. [hwchase17] (1474 commits) - Their Latest Commit
  2. [baskaryan] (1292 commits) - Their Latest Commit
  3. [efriis] (451 commits) - Their Latest Commit

Number of commits: 7842 commits

Latest commit March 2, 2024

  • link to the commit: Latest commit

  • who made that commit: hwchase17

  • what type of work was commited? (was it a fix to a bug, implementation of a new feature, ...) More Documentation

Issues

  • how many open issues are there: 1329 Open Issues

    • url for the last issue created: Last issue created

    • how many users discuss the issue: 0 people

    • when was the issue reported: 4 hours ago

  • how many closed issues are there: 4851 closed issues

    • url for the last issue closed: Last issue closed
    • how many users discussed the issue: 2 people
    • when was the issue reported: 2 days ago
    • when was the issue closed: 20 hours ago

  • how active is the discussion on the issues:

    • example of a lot of good discussion: Good discussion

    • example of an issue that does not have much discussion: Not much discussion a lot of issues are closed when the person figures it out themselves

  • are there issues marked "good for newbies", "beginner" or some other indicators that imply that they are good for beginner contributors:

  • Yes

    • how many of such issues are there? 7 issues

    • look at a few of them, do they look beginner friendly? Yes, but not the most simple, it still seems to require some effort

  • are there issues marked "documentation" or some other indicators that imply that they are documentation (user or developer specific):

    • how many of such issues are there? 129

    • look at a few of them, do you think you could submit a fix? Might be tough, a lot of open issues are fixed already and wating for merges

Pull requests

  • how many open pull requests are there: 479 pull requests

  • how many closed pull requests are there: 9923

    • url for the last pull request closed: Last Pull Request closed

    • how many users discussed the pull request: 0 users

    • when was the pull request made: 5 hours ago

    • when was the pull request closed: 5 hours ago

  • do maintainers respond quickly to pull requests when they are opened? Yes they do, but there seems to be no discussion in the pull requests

Development Environment

Each member of your group should attempt to configure the development environemnt for this project. Complete the following for each member:

Name: Henry

Operating system: MacOS

Was the installation successful? (if not, explain what went wrong and what you did to try to remedy it) Yes

How long did the whole process take? 10+ minutes. there are a lot of things to keep track off, such as making tests and different dependencies for different projects.

Summary assesment

How friendly is this project for beginner contributors? Not the most friendly for beginners

Do the maintainers respond helpfully to questions in issues? No, they are very conscise and matter-of-fact

Are people friendly in the issues, discussion forum, and chat (for example, IRC or Slack)? They are very professional, not very friendly

Do pull requests get reviewed? Yes

Do maintainers thank people for their contributions? No

Are there special skills required to contribute to the project? If so, what are they? Yes, it emphasises unit tests and integration tests Otherwise, no, just familiarity with the project

Are there any special hardware/software requirements to be able to contribute to the project? If so, what are they? you need to use poetry for your dependencies