Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reload previous model in a new training #56

Closed
jinhangw opened this issue May 25, 2017 · 6 comments
Closed

reload previous model in a new training #56

jinhangw opened this issue May 25, 2017 · 6 comments

Comments

@jinhangw
Copy link

Hello,

I have a model trained with 500 images (Kitti data and ~200 images of my own). Now I want to add new images to improve this model.
My question is, instead of re-train with all 520 images, can I reload this model and add 20 new images to re-train and improve this model? Maybe something like saver = tf.train.import_meta_graph('my_test_model-1000.meta') in tensorflow. How can I achieve it with minimal modification on train.py or tensorvision code?

Thank you very much!

@MarvinTeichmann
Copy link
Owner

MarvinTeichmann commented May 25, 2017

Go to your logdir, increase max_iterations in hyoes and use 'tv-continue' to continue training.

@jinhangw
Copy link
Author

Thanks!
Do you mean hypes[solver][max_steps] and the continue_training(logdir) function in tensorvision.train? I'm still a bit confused about 'tv-continue'.

@StuvX
Copy link

StuvX commented May 25, 2017

I've successfully done what you're asking - in your RUNS directory there should be the saved model, go to model_files/hypes.json and increase max_iterations. Make sure that you have the new images referenced in your train.txt and val.txt files and that hypes.json points to these. Then to continue training use tv-continue --logdir RUNS/your_model/

@StuvX
Copy link

StuvX commented May 25, 2017

Oh, if you haven't already make sure you follow Marvin's instructions for installing tensorvision that are toward the bottom of the intro page.

@jinhangw
Copy link
Author

Thank you very much for your help!

@jk7g14
Copy link

jk7g14 commented Sep 1, 2017

thanks guys I could do what I wanted to do after seeing these answers.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants