AI Question Generation¶
Built-in EMS exams use AI to generate questions from source documents. This is the only question creation method for built-in EMS.
Prerequisites¶
- The exam must use the SES (built-in) EMS brand
- The institute must have an LLM Configuration set up
LLM Configuration¶
Navigate to /<institute>/admin/ems/institutellmconfig/. One configuration per institute.
Provider Settings¶
| Field | Description |
|---|---|
| Provider | openai, azure_openai, mistral, anthropic, google, or custom |
| Model | Model identifier (e.g., gpt-4o) or Azure deployment name |
| API Key | Encrypted at rest; blank on edit keeps existing key |
| Base URL | API endpoint (auto-set for standard providers; required for Azure/custom) |
| API Version | Required for Azure OpenAI only |
| Max Tokens | Maximum response tokens (default: 4096) |
| Temperature | 0.00–9.99 (default: 0.7) |
Prompt Settings¶
| Prompt | Purpose |
|---|---|
| System Prompt | Instructions for question generation (has sensible defaults) |
| Negative Prompt | Things the LLM should NOT do |
| Grading System Prompt | Instructions for AI-assisted grading |
| Grading Negative Prompt | Constraints for AI grading |
Starting AI Generation¶
- Go to the Exam Assembly page for a SES exam
- Click Start AI Generation
- Configure:
- Question Count: 5–100 questions
- Question Type Mix: Percentages per type (must sum to 100%)
- Bloom's Level Distribution: Percentages per level (must sum to 100%)
- Language: nl, en, de, fr
- Exam AI Prompt: Optional exam-specific instructions
- Upload source documents (PDF, DOCX, PPTX, or plain text)
- Save — generation starts in the background
Question Types¶
| Type | Description | Auto-gradable |
|---|---|---|
| Multiple Choice (MC) | Single correct answer | Yes |
| Multiple Response (MR) | Multiple correct answers | Yes |
| Numerical | Numeric answer | Yes |
| Fill in the Blank (FIB) | Text in blanks | Yes |
| Matching | Match items | Yes |
| Ordering | Order items | Yes |
| Hotspot (Image) | Click on image areas | Yes |
| Essay | Free text | No (AI-assisted) |
| Code | Programming code | No (AI-assisted) |
Grading¶
AI-assisted grading is available for essay and code questions. You can: - Grade all responses for one question at once (batch grading) - Review and adjust AI-generated scores - Export grades as CSV