Skip to content

Redesign: Improve Grading Pipeline #443

Open
@geshuming

Description

@geshuming

Just to log the issue down first.

The current pipeline:

  • Submission does not exist
  • Student submits at least 1 answer, submission is created, marked as attempting
  • Student answers all the questions, submission marked as attempted
  • Student betcha's, submission marked as submitted, autograder invoked.
  • At 3am, regardless of submission status, a submission is created where there is none, and all submissions marked as submitted, autograder invoked regardless of status.
  • Manual grading should be done after this stage, or the grade adjustment is reset.

Proposed pipeline:
Use Not Attempted, Attempted, Submitted for submission status, as discussed in source-academy/frontend#738

  • Submission does not exist.
  • Student submits at least 1 answer, submission is created, marked as attempted
  • Student answers all the questions
  • Student betcha's, submission marked as submitted, autograder invoked.
  • At 3am, regardless of submission status, a submission is created where there is none and marked as Not Attempted. autograder invoked for non-Submitted submissions and the corresponding graded submissions marked as Submitted
  • Manual grading can be done at any stage after the submission is marked as Submitted

Metadata

Metadata

Assignees

No one assigned

    Labels

    EnhancementNew feature or request_infrastructureThe issue concerns infrastructure component

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions