National Central University
Uedu Main Site
Explore Uedu
Student Console
Register as Member/Login
Research Informed Consent Center
Survey Center
Teacher Console
Course Setup
Support & Messages
Uptime Data

UeduGPTs

--

Jupyters

7

Local AI

--

Uedu Code

--

AI Reply Desktop Notifications

Show a desktop notification when the AI TA finishes replying

Chat Message Notifications

Notify me when classmates post messages in the forum

Sound notification

Play an alert sound whenever there is a new notification

METHODOLOGY

AI Interact
interactive assignment methodology

Explain how Uedu's AI interactive assignments enable Instructors to design conversational assignments, and use LLM automated marking and instructor review mechanisms to assess Students' dialogue quality.

1. Overview

AI Interact (AI interactive assignment) is the conversational assignment module of the Uedu platform. Teachers can create learning tasks centred on AI dialogue, students complete the assignment through multi-turn conversations with the AI TA, and the system then automatically grades it with an LLM.

The core idea of this module is: conversation itself is the learning process. Through carefully designed System Prompt and assignment modes (mode_code), instructors can guide students through Socratic questioning, role-play, case analysis and other diverse learning activities, and obtain immediate feedback through automatic marking.

2. Assignment mode design

Each AI interactive assignment is set up by the Instructor with the following core elements:

Setting itemsDescription
Assignment mode (mode_code)Define AI interaction patterns, such as Socratic questioning, role-play, case analysis, and so on
System PromptAI prompts written by the instructor that define the AI's role, code of conduct and response style
Scoring criteria (scoring_criteria)Multidimensional scoring rules in JSON format (see Section 3)
Grading methoduse_default_scoring (use platform default) or custom_scoring (teacher-defined)

2.1 Dialogue flow

  1. When the student enters the assignment page, the system loads the System Prompt configured by the instructor
  2. The Student and AI carry out multi-turn dialogue to complete the assignment requirements
  3. After a student submits an assignment, the system automatically triggers LLM grading
  4. Marks are returned in real time, and Students can view the marks and feedback for each item

3. Grading criteria

3.1 Grading criteria structure

The marking criteria are defined in JSON format (scoring_criteria), with each dimension including a name, description and points allocation:

FieldTypeDescription
nameStringMarking dimension name (for example, "Problem depth" or "Logical coherence")
descriptionStringScoring notes and criteria for this dimension
max_scoreNumberMaximum score for this dimension

3.2 Defaults and customisation

  • Default scoring (use_default_scoring): the platform provides a general multi-dimensional scoring rubric, suitable for general AI dialogue assignments
  • Custom scoring (custom_scoring): Instructors can customise scoring dimensions and criteria for specific assignment needs, for example by adding a “code correctness” dimension to programming assignments

4. AI automated marking process

4.1 Scoring model

Automatic grading uses the gpt-5-mini model, and response_format=json_object is used to ensure a structured JSON response.

4.2 Scoring process

  1. The system assembles the complete conversation record (Student messages + AI replies) and the marking criteria into a Prompt
  2. Call the LLM API and require item-by-item scoring according to scoring_criteria
  3. LLM returns JSON, including the score and comments for each dimension
  4. Validate the JSON format and score validity

4.3 Output format

The scoring results returned by the LLM include the following structure:

FieldTypeDescription
criteria_scoresArrayScore and comments for each assessment dimension (score + comment)
total_scoreNumberSum of scores across dimensions
overall_commentStringOverall feedback summarising the Student's dialogue performance
Mark transparency

Students can view the score for each dimension and the specific feedback (comment) provided by the LLM, so they can see where they are doing well or need to improve.

5. Teacher review

Once AI auto-marking is complete, the Instructor can review the marking results and perform a check:

Mark source (score_source)Description
autoAutomatic LLM scoring result, default value
manualScores manually reviewed by the instructor overwrite automatic grading

During Instructor review, you can:

  • View the full conversation record and AI automatic scoring results
  • Modify scores on any dimension
  • Edit overall feedback
  • After review, score_source is automatically marked as manual
Research notes

If using grading data for research analysis, it is recommended to distinguish score_source as auto or manual to clarify the impact of grading source on the data.

6. Data storage

The grading results for the AI interactive assignment are stored in the ai_interact_evaluations table. The main fields include:

FieldDescription
criteria_scoresJSON format, scores and comments by dimension
total_scoreTotal Score
overall_commentOverall Feedback
score_sourceauto (automatic) or manual (manual review)

Conversation records and scoring results are fully retained, supporting subsequent learning analysis and research export.

7. Research citation guidance

Methodology description template

A Student's AI interaction assignment grade is automatically assessed by the AI Interact module on the Uedu platform. The Instructor pre-sets the assignment mode (mode_code) and System Prompt. After the Student completes the assignment through multi-turn dialogue with the AI TA, the system uses an LLM (OpenAI gpt-5-mini) to grade each dimension according to the structured scoring criteria (scoring_criteria JSON), and outputs a JSON result containing the scores for each criterion (criteria_scores), the total score (total_score), and the overall comment (overall_comment), using response_format=json_object to ensure a consistent format. The scoring criteria may use the platform default or be custom-set by the Instructor. The Instructor can review the automatic grading result and manually verify it (score_source marked as auto or manual). See https://uedu.tw/doc/ai-interact for a detailed methodological explanation.

It is recommended to provide the following:

  • Assignment mode_code and System Prompt summary
  • Names and scoring weights of each dimension in the scoring criteria (scoring_criteria) used
  • Proportion of automatic grading and teacher review
  • Data collection period and number of participating Students