Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[question] Example for Cusom Policy for SAC with combined image and box type observation #1025

Closed
ajishbabu opened this issue Oct 20, 2020 · 3 comments
Closed

[question] Example for Cusom Policy for SAC with combined image and box type observation #1025

ajishbabu opened this issue Oct 20, 2020 · 3 comments
Labels
duplicate This issue or pull request already exists question Further information is requested

Comments

@ajishbabu
Copy link

I am trying to use SAC for a custom robot env which has both image and box type data as observations. The plan is to use a custom network which looks something like this.

image

Does anyone have an example of how to implement this? Any help would be appreciated.
@araffin araffin added duplicate This issue or pull request already exists question Further information is requested labels Oct 20, 2020
@araffin
Copy link
Collaborator

araffin commented Oct 20, 2020 •
edited
Loading

Hello,
Duplicate of #947 and #133 (comment)

Anyway, I would recommend you to use Stable-Baselines3 as such modifications should be easier to implement.
EDIT: we need to fix DLR-RM/stable-baselines3#135 in SB3 first...

@ajishbabu
Copy link
Author

@araffin Thanks a lot

@araffin
Copy link
Collaborator

araffin commented Oct 23, 2020

Update for SB3: the fix will be merged with master soon ;)
DLR-RM/stable-baselines3#198

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
duplicate This issue or pull request already exists question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@araffin @ajishbabu