Skip to content

Commit

Permalink
Update benchmark_generation.md
Browse files Browse the repository at this point in the history
  • Loading branch information
aorogat authored Nov 3, 2022
1 parent 8f8c962 commit 22766f3
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions benchmark_generation.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,9 +4,9 @@ This document shows you how to configure Maestro to generate a new benchmark and
* __Run SmartBenchh.java__
* __Configure Maestro__ This is the first step after running Maestro. You have to configure the system as shown. Until now, Maestro supports 5 KGs, and we are working on adding more.
![Image](Images/benhmark_generation_conf.PNG)
* The System then preprocess the seed entities that will work as the answers for the questions or a subset of the answers, and print triples examples for these entities as in the figure below. QALD-1 has 100 questions, just 3 of them are shown.
* The System then preprocess the seed entities that will work as the answers for the questions or a subset of the answers, and print triples examples for these entities as in the figure below.
![Image](Images/Seeds_selection.PNG)
* The System then prints the generated questions one by one. Each question consists of the natural language question, the formal query used to reterive the correct answer, the answer, and some properties about the question (e.g., number of tokens, query shapt, etc.).
* The System then prints the generated questions one by one. Each question consists of the natural language question, the formal query used to reterive the correct answer, the answer, and some properties about the question (e.g., number of tokens, query shape, etc.).
![Image](Images/question_example.PNG)
* In the end, the system save the benchmark as a JSON file.

Expand Down

0 comments on commit 22766f3

Please sign in to comment.