From b24fa66046f9fa8ce52fc8a7751138992708c49a Mon Sep 17 00:00:00 2001 From: NishanthJKumar Date: Sun, 3 Nov 2024 22:26:47 -0500 Subject: [PATCH] fix vila --- predicators/approaches/vlm_planning_prompts/few_shot.txt | 5 +++-- predicators/approaches/vlm_planning_prompts/no_few_shot.txt | 3 ++- 2 files changed, 5 insertions(+), 3 deletions(-) diff --git a/predicators/approaches/vlm_planning_prompts/few_shot.txt b/predicators/approaches/vlm_planning_prompts/few_shot.txt index 002ed0ec14..f15c946241 100644 --- a/predicators/approaches/vlm_planning_prompts/few_shot.txt +++ b/predicators/approaches/vlm_planning_prompts/few_shot.txt @@ -9,7 +9,7 @@ Here are a number of example demonstrations of solving a range of goals from an with the goal the demonstrator was trying to achieve, the plan (i.e., sequence of skills with discrete and continuous arguments specified), as well as images corresponding to the state of the environment at every timestep (starting at 0, when the 0th skill is executed). Note that the state images are annotated with text indicating which demonstration and timestep they belong to. Additionally, note that a state might have more than one image -associated with it. +associated with it. {demonstration_trajs} @@ -30,7 +30,8 @@ Finally, here is an expression corresponding to the current task goal that must Please return a plan that achieves the provided goal from an initial state depicted by the image(s) below. Please provide your output in the following format (excluding the angle brackets and ellipsis, which are just for illustration purposes). Be sure to include the parens '(' and ')', as well as square brackets '[' and ']' even if there are no objects/continuous parameters. -Do not bold or italicize or otherwise apply any extra formaating to the plan text: +Do not bold or italicize or otherwise apply any extra formaating to the plan text. Do not provide any numbers for steps in the plan, or +any reasoning for each step below the 'Plan:' heading: Plan: (:, :, ...)[, , ...] diff --git a/predicators/approaches/vlm_planning_prompts/no_few_shot.txt b/predicators/approaches/vlm_planning_prompts/no_few_shot.txt index da7fbc66c6..41101ff346 100644 --- a/predicators/approaches/vlm_planning_prompts/no_few_shot.txt +++ b/predicators/approaches/vlm_planning_prompts/no_few_shot.txt @@ -20,7 +20,8 @@ Finally, here is an expression corresponding to the current task goal that must Please return a plan that achieves the provided goal from an initial state depicted by the image(s) below. Please provide your output in the following format (excluding the angle brackets and ellipsis, which are just for illustration purposes). Be sure to include the parens '(' and ')', as well as square brackets '[' and ']' even if there are no objects/continuous parameters. -Do not bold or italicize or otherwise apply any extra formaating to the plan text: +Do not bold or italicize or otherwise apply any extra formaating to the plan text. Do not provide any numbers for steps in the plan, or +any reasoning for each step below the 'Plan:' heading: Plan: (:, :, ...)[, , ...]