Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Being able to do Prediction (task=prediction) on bin files. #6613

Closed
wil70 opened this issue Aug 16, 2024 · 1 comment
Closed

Being able to do Prediction (task=prediction) on bin files. #6613

wil70 opened this issue Aug 16, 2024 · 1 comment

Comments

@wil70
Copy link

wil70 commented Aug 16, 2024

Summary

Being able to do Prediction (task=prediction) on bin files.

Motivation

I need to analyze some stat on some huge files (train, validate, test) that are converted to bin format for speed purposes. Bin files seems to be very efficient. The time saved is considerable when you need to use those files several time. The loading time is in order of magnitude faster with bin vs csv. For info the file I use are huge, several TB .

Description

Being able to do

task=prediction
data = data_2004_2006_split_validate.csv.bin

Right now I get

[LightGBM] [Info] Finished loading parameters
[LightGBM] [Info] Finished initializing prediction, total used 4 iterations
[LightGBM] [Fatal] Unknown format of training data. Only CSV, TSV, and LibSVM (zero-based) formatted text files are supported.
Met Exceptions:
Unknown format of training data. Only CSV, TSV, and LibSVM (zero-based) formatted text files are supported.

Thanks!
-- w

@jameslamb
Copy link
Collaborator

Thanks for the feature request. I've added it to #2302 along with the requests documenting the desire to predict on Dataset objects for the R package (#2666) and Python package (#6285).

Following this repo's policy for feature requests, I'm going to close this (since we track it over in #2302) until someone is actively working on it. Anyone reading this, just comment here if you'd like to work on this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants