Code Intelligence 3.22 Tracking issue #14802
Comments
efritz
added
team/graph
macraig
changed the title
|
Last Week [Oct 19 to Oct 23]
Next Week [Oct 26 to Oct 30]
|
|
General notes We began revisiting our team's goals. I don't think our plan is wrong, but the prose we use to describe it in our team page and in the product roadmap has been identified as problematic. We're having meetings as a team to better define the terminology we need to effectively communicate this to the greater Sourcegraph community. Doing this before a new manager onboards will certainly help them understand/align with the current heading of the team more effectively. Completed 2020/10/20-23 Wrote and received approvals for RFC 253: Sunset the bundle manager. Started implementing the storage layer to replace the bundle manager so we can remove an entire service worth of complexity from the the code intel path. Waiting on reviews. Met with @AlicjaSuska to get feedback on the code intel administrative UI and reworked it visually. This was a necessary pre-step to adding additional features into these pages (particularly the configuration of auto-index jobs) as the code was written by a react amateur (still am, but was too) in a way that would have made it tedious to modify. Feels nice now. Waiting on an approval from someone who knows frontend things. Met with @sourcegraph/campaigns to have them live-review some PRs for the auto-indexer code. I am currently refactoring the auto-indexer code into a generic firecracker executor service, and a generic queue service that feeds the executor jobs. This may or may not be used by campaigns or other teams in the future, but was still an effective way to refresh the code now that we understand the use cases a little better. Code is organized better and the tests are more comprehensive. These reviews are approved and I'm waiting to merge these Monday. Planned 2020/10/26-30 Will merge the approved executor/executor-queue PRs and continue working on https://github.com/sourcegraph/sourcegraph/issues/14822. The work here is already done in an experimental branch, so I just have to cut the remaining pieces into digestible PRs. The remainder of the work only affects the executor proxy in the frontend to the (which already exists as the precise-code-intel-indexer service, but targets slightly different routes). The deployment of this code should coincide with the deployment of the new executors in the sourcegraph-code-intel GCP project. Not doing so will make it so nothing is consuming the index queue. Will continue to excise the bundle manager from the rest of the code base. The hard part here is mostly done. The rest may go slowly but it's due to deployment barriers (simply the turn around time of having something merged into cloud). Might try to select a few of the open issues that aren't nested in another tracking issue to get them out of the way. Then, I'll jump back into https://github.com/sourcegraph/sourcegraph/issues/13891 as my next big focus. |
|
Completed 2020/10/20 - 2020/10/23
Planned 2020/10/27 - 2020/10/30
|
|
Last Week [Oct 26 to Oct 30]
Next Week [Nov 2 to Nov 6]
|
|
Completed 2020.10.26-30 Got very sidetracked by the surprise IDE summit so didn't make as much progress as I had planned. MinIO containers have been added to all deployment environments, and we have the cloud instance pointed to GCS to store LSIF upload files. The frontends are currently still contacting the bundle manager, but it will be removed for everything except upload fallback in 3.22, and will be removed completely in 3.23. Planned 2020.11.02-06 Will continue to merge outstanding effort to get rid of the bundle manager and clean up the scar tissue that accumulated around these changes. Have a goals refresh meeting to ensure that we're still focusing on the right thing (and that communicate what the right things are clearly outside the team). We also have a training session that we will prepare for and present to CEs. Time allowing, will try to tackle updates to metrics and ping data this week. |
|
Completed 2020/10/27 - 2020/10/30
Planned 2020/11/02 - 2020/11/06
|
|
Completed 2020/11/02 - 2020/11/06
Planned 2020/11/09 - 2020/11/13
|
|
Completed 2020/11/02 - 2020/11/06
Planned 2020/11/09 - 2020/11/13
|
|
Completed 2020/11/02 - 2020/11/06
Planned 2020/11/09 - 2020/11/13
|
|
Completed 2020/11/09 - 2020/11/13
Planned 2020/11/16 - 2020/11/20
|
|
Completed 2020/11/09 - 2020/11/12 Updated metrics and pings. Planned 2020/11/16 - 2020/11/20 Will concentrate on lsif-clang knowledge share. |
|
This week the team mostly focused on knowledge-sharing before @gbrik's extended leave. We're switching to two-week sprints starting Monday. Follow new progress at https://github.com/sourcegraph/sourcegraph/issues/16036. |
Plan
Goal: Provide precise code intel for the primary programming languages that combined cover > 50% of usage across customer projects. Garo is forging ahead with lsif-clang bugs, and will aim to index 10 more open source repositories as preparation to ship to a wider audience. Noah is forging ahead with lsif-java features, and will aim to have Gradle support by the end of the milestone.
Goal: LSIF indexers can operate in monorepos architecture. Garo will be merging their work on incremental indexing into the main branch of the relevant repositories. After this is complete, we should be able incrementally index source code in customer environments (for at least Go) and accept partial indexes in the backend.
Goal: Provide best effort auto-indexing for supported languages. Eric will continue building out the auto-indexing infrastructure so we can provide a wide coverage of code intelligence in the cloud environment. By the end of the milestone we should have updated metrics and UI, and will deep-dive into errors we see currently in production to harden the system and make it more reliable.
Uncategorized. Eric and Maria will also be spending time updating metrics, pings, and documentation across the code intelligence feature space.
Availability
If you have planned unavailability this iteration (e.g., vacation), you can note that here.
@efritz 21d
@macraig 21d
@gbrik 14d
@Strum355 20d (26/10/2020)
Tracked issues
@Strum355
#74)#42)#53)#55; PRs:#65)#59)#60)#62; PRs:#75)#63)#68)#77)Completed
#60)#53)#63)#55; PRs:#65)#59)#68)#42)#62; PRs:#75)#74)#77)#31)@efritz: 13.00d
Update RFC 236(#14007) 1.00dLSIF quickstart is not quick(#14422) 1.00dcodeintel: Topologically sort git log in gitserver(#14618) 0.50d 🧶Write POC LSIF indexer testing utility(#14821) 1.00dcodeintel: git diffing fails graphql requests related to force-pushed commits(#12588) 0.50d 🐛Completed: 9.00d
#14842)#14550)#14881)#15117)#14679)#15200)#15190)#15136)#15282)#14822) 2.50d#15356)#15358)#15359)#15357)#15364)#15366)#15368)#15369)#15372)#15375)#15374)#15405)#15404)#15407)#15408)#15411)codeintel: Refactor bundle interfaces(#15371)#15360)#15419)#15421)#15422)#15424)#15425)#15468)#15469)#15474)#15481)#15485)#15487)#15489)#15492)#15494)#15495)#15496)#15497)#15498)#15499)#15501)#15502)#15504)#15505)#15507)#15508)#15490)#14609; PRs:#15534) 1.00d 🧶#15541)#15594)#15595)#14820) 3.00d#14015) 🐛#15665)#15666)#14574; PRs:#15635) 0.50d#14673; PRs:#15635) 0.50d#15804)#15808)#15192)#15818)#13891) 1.50d@gbrik
Completed
#24)#14; PRs:#28) 🐛#15987)@macraig: 1.00d
Completed: 1.00d
#13802) 0.50d 🐛#14574; PRs:#15635) 0.50dLegend
The text was updated successfully, but these errors were encountered: