Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New data model #126

Merged
merged 5 commits into from
Nov 26, 2024
Merged

New data model #126

merged 5 commits into from
Nov 26, 2024

Conversation

xoolive
Copy link
Owner

@xoolive xoolive commented Nov 25, 2024

  • new data model fitted for when messages can come from several receivers
  • payload stored as Vec<u8>
  • also ~ is now accepted in path for configuration file and output file
  • --expire becomes --history-expire
  • messages are decoded in their async task to benefit from potential multi-thread/core
  • new option --stats true to explore statistics

- new data model fitted for when messages can come from several receivers
- payload stored as `Vec<u8>`
- also ~ is now accepted as a configuration option
- --expire becomes --history-expire
- messages are decoded in their async task to benefit from potential multi-thread/core
@xoolive
Copy link
Owner Author

xoolive commented Nov 25, 2024

@emctoo would you have a quick look, even after merging?
(it actually also reveals some performance issues, but that's for later)

@xoolive
Copy link
Owner Author

xoolive commented Nov 25, 2024

According to this graph, the decoding time if an order of magnitude faster than the throughput time.

throughput
decode_time

Yet there seems to be some drift in the reception of messages (i.e. system_timestamp - gnss_timestamp) when we decode many receivers: here only one receiver is drifting, but in daytime it may be all of them.

drift

It is a bit hard to investigate right now (maybe to be transformed into an issue)

DF20 and DF21 (about 25% of the received messages) are slower to decode because their payload is of an unknown type.

@xoolive xoolive mentioned this pull request Nov 26, 2024
@xoolive xoolive merged commit ad66ace into master Nov 26, 2024
30 checks passed
@xoolive xoolive deleted the pr-msg-model branch November 26, 2024 08:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant