The Q&A set is used to evaluate the system's performance. If you have already created one, you can load it. You can search for its name, date of creation or ID.

If you want to create a new Q&A set, follow the instructions below.

Please note that naming your Q&A set something meaningful will help you identify it later if you want to use it again.

Option 1. You can upload a pre-defined set of relevant QA test cases in JSON format.

    [{
            "question": "What is the capital of France?",
            "reference_answer": "The capital of France is Paris."
            "reference_chunks":["doc_id-chunk_id", ...]
        },...]

If you want to evaluate Expert answers or compare them to the RAG system's responses, you would need to add an extra field containing the "expert_answer" for each Q&A object.

Option 2. You can upload a pre-defined set of relevant to the dataset questions in JSON format and let the system generate the rest based on the dataset.

    {
        "questions": [
                "What is the capital of France?",
                "Who wrote '1984'?"
        ]
    }

Option 3. Alternatively, let the system generate a set of Q&As for you by simply specifying the number of Q&A pairs you want, and the system will take care of the rest.