Will code for the benchmark generation be open sourced?

[samching]

It seemed to be alluded to in the paper, but was wondering if the code for the automated benchmark generation will be open sourced.

Thank you for your efforts!

[dorm-ai21]

We intend to release the benchmark generation code in the near future. Meanwhile, note that the paper includes prompts for generating non-factual completions, as well as references to all the open-source models utilized in the pipeline.

[samching]

Great, thanks for the update!

…

On Sat, Dec 2, 2023 at 11:20 PM dor.muhlgay ***@***.***> wrote: We intend to release the benchmark generation code in the near future. Meanwhile, note that the paper includes prompts for generating non-factual completions, as well as references to all the open-source models utilized in the pipeline. — Reply to this email directly, view it on GitHub <#4 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AD4HOBANSV6DHKVOEJUHDBTYHQR37AVCNFSM6AAAAABABXWWHWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMZXGM4TIMBVHA> . You are receiving this because you authored the thread.Message ID: ***@***.***>