Skip to content

Why is this Rust program handling CSV data "only" 3-4 times faster than an equivalent Python program? #341

Answered by BurntSushi
BurntSushi asked this question in Q&A
Discussion options

You must be logged in to vote

Okay, here's what I did to get my baseline. First, I cloned and built your program:

$ git clone https://github.com/jan24/checklog
$ cd checklog
$ cargo build --manifest-path checklog_rs/Cargo.toml --release

Next I ran the programs to check that they at least appear to behave the same (i.e., have the same output):

$ ./checklog_rs/target/release/checklog app_logs_fake.csv
 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
trying to process 1 csv files:
    app_logs_fake.csv
 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
csv file: app_logs_fake.csv
BQ4 csv logs format verify pass
Output 3 logs:
Log_name            Lines_count  …

Replies: 2 comments 3 replies

Comment options

You must be logged in to vote
2 replies
@jan24
Comment options

@jan24
Comment options

Answer selected by BurntSushi
Comment options

You must be logged in to vote
1 reply
@BurntSushi
Comment options

BurntSushi Oct 26, 2023
Maintainer Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants