Skip to content
This repository has been archived by the owner on May 15, 2024. It is now read-only.

Motion telemetry through Singularity #174

Closed
Tracked by #139
xinaxu opened this issue Oct 20, 2023 · 0 comments · Fixed by #181
Closed
Tracked by #139

Motion telemetry through Singularity #174

xinaxu opened this issue Oct 20, 2023 · 0 comments · Fixed by #181
Assignees
@xinaxu

Comments

@xinaxu
Copy link
Collaborator

xinaxu commented Oct 20, 2023 •
edited
Loading

Singularity already collects metrics about

  1. CAR files prepared
  2. Deals made through Singularity

Motion would like to have visibility into who is using and the volume of data onboarded.
The ask is to make Singularity support a way to tag the metrics with Motion

  1. Add a field into https://github.com/data-preservation-programs/singularity/blob/main/analytics/model.go
  2. Add an API in Singularity to set the user identity (motion)
  3. In motion singularity store initialization, set the user identity to motion
  4. In Singularity, use the user identity as part of the metrics payload
  5. Update https://github.com/data-preservation-programs/singularity-metrics
  6. Create a Grafana dashboard
@xinaxu xinaxu converted this from a draft issue Oct 20, 2023
@celine3650 celine3650 mentioned this issue Oct 20, 2023
Closed
@xinaxu xinaxu self-assigned this Oct 20, 2023
@xinaxu xinaxu moved this from Todo to In Progress in Motion Team Oct 20, 2023
@xinaxu xinaxu mentioned this issue Oct 21, 2023
Merged
xinaxu added a commit to data-preservation-programs/singularity that referenced this issue Oct 23, 2023
@xinaxu
Add a way to tag identity to Motion for Singularity telemetry (#398)
7f1f6fc 
Offer an API to set the identity as a global variable in the database.
This identity is only settable via API call.
All telemetries published will include this identity as part of payload.

This is the first step for
filecoin-project/motion#174
@xinaxu xinaxu mentioned this issue Oct 23, 2023
Merged
xinaxu added a commit that referenced this issue Oct 23, 2023
@xinaxu
Tag singularity metrics to motion (#177)
bb873c7 
Context: 
- #174 

Previous steps
- data-preservation-programs/singularity#398
-
data-preservation-programs/singularity-metrics@46bc0d3

Next step:
- Create Grafana dashboard with tagged motion telemetry
@xinaxu xinaxu mentioned this issue Oct 24, 2023
Merged
xinaxu added a commit to data-preservation-programs/singularity that referenced this issue Oct 24, 2023
@xinaxu
Allow setting identity during admin init (#402)
673b052 
Due to how Motion docker compose is structured, the best way to set the
identity to motion is through the admin init CLI command.

This is part of filecoin-project/motion#174
@xinaxu xinaxu mentioned this issue Oct 24, 2023
Merged
xinaxu added a commit that referenced this issue Oct 25, 2023
@xinaxu
Set identity during admin init (#181)
28811ff 
Follow-up of 
#177 

Motion container starts after other Singularity container starts hence
setting identity inside motion container does not take effect until the
user restart the docker compose.

To address above issue, we can set the identity to Motion during Admin
init script.

Tested end to end and see data reflected on Dashboard

https://dataprograms.grafana.net/d/f49ba403-a767-4243-af44-607dec1e7100/usage?orgId=1

fixes #174
@github-project-automation github-project-automation bot moved this from In Progress to Done in Motion Team Oct 25, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@xinaxu xinaxu

Labels
None yet
Projects
Motion Team
Status: Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Set identity during admin init filecoin-project/motion
1 participant
@xinaxu