Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add consistency check between exam mode exercise variants #10316

Open
9 tasks
krusche opened this issue Feb 12, 2025 · 0 comments
Open
9 tasks

Add consistency check between exam mode exercise variants #10316

krusche opened this issue Feb 12, 2025 · 0 comments
Labels
assessment Pull requests that affect the corresponding module exam Pull requests that affect the corresponding module exercise Pull requests that affect the corresponding module feature programming Pull requests that affect the corresponding module quiz Pull requests that affect the corresponding module

Comments

@krusche
Copy link
Member

krusche commented Feb 12, 2025

It would be great if Artemis can check the consistency between exam mode exercise variants on the exercise groups page. For each exercise group the following checks could be implemented, ideally we start simple and iterate over this multiple times

Do all exercises have the same config?

For programming exercises, this could include different options such as

  • same programming language and same project type
  • static code analysis enabled/disabled
  • same build config (build script, docker image, etc.)
  • same dependency version (e.g. Gradle Wrapper, Gradle dependencies in Java) in the different repos
  • similar problem statement length
  • same grading config (e.g. related to tests and to submission policies)

For quiz exercises, this could include

  • same number of questions
  • same question types
  • similar amount of answer options / dnd items / sa items

There should be a button in the exercise group header to trigger the check. Ideally it is automatically executed when opening the page and in case there are inconsistencies a warning triangle is shown. If there are no inconsistencies, a green checkmark is shown

@github-actions github-actions bot added assessment Pull requests that affect the corresponding module exam Pull requests that affect the corresponding module exercise Pull requests that affect the corresponding module programming Pull requests that affect the corresponding module quiz Pull requests that affect the corresponding module labels Feb 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
assessment Pull requests that affect the corresponding module exam Pull requests that affect the corresponding module exercise Pull requests that affect the corresponding module feature programming Pull requests that affect the corresponding module quiz Pull requests that affect the corresponding module
Projects
None yet
Development

No branches or pull requests

1 participant