You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: _docs/developer/development_instructions/automated_grading.md
+3-1Lines changed: 3 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -118,12 +118,14 @@ number:
118
118
119
119
---
120
120
121
-
## Debugging
121
+
## Debugging
122
122
123
123
To debug new features for autograding, it can be helpful to run
124
124
`submitty_autograding_shipper.py` and `submitty_autograding_worker.py`
125
125
interactively and inspect the output.
126
126
127
+
_NOTE: A cron job runs hourly to detect autograding shipper outages on the primary machine. To avoid interference during debugging, this job should be disabled before proceeding. See [Capture Cron Error Messages](/sysadmin/installation/system_customization#capture-cron-error-messages) for instructions on disabling the script._
128
+
127
129
To do this:
128
130
129
131
1. Stop the daemons (on each server, as appropriate)
Copy file name to clipboardExpand all lines: _docs/developer/development_instructions/index.md
+9Lines changed: 9 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -250,6 +250,15 @@ these changes.
250
250
missing the hundreds of sample student submissions present in the
251
251
full installation.
252
252
253
+
You can append the `--test_only_grading` flag to the above command to
254
+
more closely mimic the version that is on the Cypress CI.
255
+
256
+
If you only need a certain courses, you can append each course name to
257
+
the above command to only create the courses you want.
258
+
259
+
_NOTE: If you mistype a course, that course will not be created. If you
260
+
only have mistyped courses, then no courses gets created._
261
+
253
262
254
263
NOTE: This command will also have to be run twice a year on July 1st and January 1st when the test semester will change from fall to spring or vice versa.
_Note: This project may be combined with the previous project idea._
56
91
57
92
_Expected Outcomes_: The primary goals for this project include the
58
93
expansion of our automated testing of the TA Grading pages and to
@@ -68,20 +103,18 @@ developers.
68
103
teaching assistant with grading experience design will be
69
104
beneficial.
70
105
71
-
_Possible Mentors_: William Allen, Nia Heermance, Barb Cutler
72
-
73
-
_GSoC Project Size_: 90 or 175 hours
74
-
106
+
_Possible Mentors_: William Allen, Cameron Peterson, Barb Cutler
107
+
_GSoC Project Size_: 90 or 175 hours
75
108
_Difficulty Level_: introductory to medium
76
109
77
110
78
111
79
112
80
-
2.**Refactor and Performance Improvements for the Manual/TA Rubric Grading Interface**
113
+
3.**Refactor and Performance Improvements for the Manual/TA Rubric Grading Interface**
81
114
82
115
[Overview of Rubric Grading Interface](/grader/rubric_grading/index)
83
116
84
-
_Note: This project may be combined with the previous project idea._
117
+
_Note: This project may be combined with one of the previous project ideas._
85
118
86
119
The Manual/TA rubric grading interface is elaborate,
87
120
highly-featured, and customizable; however, the performance of
@@ -112,16 +145,14 @@ developers.
112
145
and and having served as a teaching assistant with grading
113
146
experience design is beneficial but not required.
114
147
115
-
_Possible Mentors_: Nia Heermance, William Allen, Barb Cutler
116
-
117
-
_GSoC Project Size_: 175 or 350 hours
118
-
148
+
_Possible Mentors_: William Allen, Barb Cutler
149
+
_GSoC Project Size_: 175 or 350 hours
119
150
_Difficulty Level_: medium to challenging
120
151
121
152
122
153
123
154
124
-
3.**Notebook Builder: UI To Streamline Instructor Configuration of Automated Grading**
155
+
4.**Notebook Builder: UI To Streamline Instructor Configuration of Automated Grading**
125
156
126
157
Our system for automated testing and grading of student work is
127
158
very powerful, but the configuration process that instructors must
@@ -147,7 +178,8 @@ developers.
147
178
in compiled languages.
148
179
149
180
[Open Issues related to Autograding](https://github.com/Submitty/Submitty/labels/Autograding)
150
-
[Open Issues related to Notebook / Notebook Builder](https://github.com/Submitty/Submitty/issues?q=is%3Aopen+is%3Aissue+label%3A%22Notebook+%2F+Notebook+Builder%22)
181
+
[Open Issues related to Notebook / Notebook Builder](https://github.com/Submitty/Submitty/issues?q=is%3Aopen+is%3Aissue+label%3A%22Notebook+%2F+Notebook+Builder%22)
0 commit comments