healthbench-professional

简介

Contains the data for the HealthBench Professional eval. Each example contains: conversation: list of user / assistant messages, ending in a user message rubric_items: list of rubric items, each containing criterion_text and points use_case: one of consult, writing, or research type: one of good_faith or red_teaming difficulty: physician-assigned difficulty rating (difficult for Likert 1-2, typical for Likert 3-7) specialty: medical specialty or sub-specialty physician_response: response… See the full description on the dataset page: https://huggingface.co/datasets/openai/healthbench-professional.