Bubble Grader

6 minute read Last updated on October 08, 2021

The Bubble Grader process is part of the overall test grading and assessment solution for educators and administrators in K-12 as well as colleges and universities. With the Bubble Grader process, Optical Mark Recognition (OMR) bubble sheets are automatically graded and reports are generated.

Notes:

  • This node works only with tests, weight sheets, and answer keys that have been created by the Bubble Sheet Generator Tool.

  • This node supports only TIFF and PDF file formats. Please note that the following PDF compression methods are not supported:

    • CCITTFaxDecode
    • JBIG2Decode
    • JPXDecode
    • Crypt

  • When complete, the test packet will be in the following order:

    • answer key
    • optional weight sheets
    • student answer sheets

To open the Bubble Grader Node window, add a process node for Bubble Grader and double-click on it.

Do the following:

  1. Check the Enabled box so that the process will be run. When unchecked, this process will be ignored. Documents will pass through as if the node was not present (i.e., continue along the default or ‘positive’ path). Note that a disabled node will not check for logic or error conditions.

  2. In the Node Name field, enter a meaningful name for the Bubble Grader node.

  3. In the Description field, enter a description for the Bubble Grader Node. This is not required, but helpful to distinguish one process from another. If the description is long, you can hover the mouse over the field to read its entire contents.

  4. In the Output Settings area, choose which files you want to be outputted. Options are:

    • Output the original file - This box should be enabled in order to output the original files along with the corrected tests.

    • Enforce Test ID - This box should be enabled if teachers want to ensure that they’ve collected the right group of tests. When enabled, the Test ID on the answer sheets and optional weight sheets MUST match the Test ID on the answer key in order for processing/grading to occur. In addition, if the Test ID listed on an answer sheet does not match the Test ID on the answer key, processing will not occur.

    • Output corrected answer sheets - This box should be enabled in order to output corrected tests.

    • Grade test results - This drop-down gives you the option to display the test score on each of the students’ answer sheets.

      • Do not grade test results - This is the default setting if you choose not to have the test score displayed on the printed Student Answer Sheets.
      • Grade as a percentage - This option allows you to display test scores in the form of a percent on the Student Answer Sheets.
      • Grade as a fraction - This option allows you to display test scores in the form of a fraction on the Student Answer Sheets.

  5. In the Reports Settings area, choose which reports you want to generate as well as their file format. Options are:

    • Comprehensive Test Report (PDF only)

    • Item Analysis Report (CSV or Excel 2003 XML)

    • Student Response Report (CSV or Excel 2003 XML)

    • Test Summary Statistics Report (CSV or Excel 2003 XML)

  6. Select the Start Bubble Sheet Generator button to create your own answer key/answer sheets.

Test Requirements

When filling out the Student Answer Sheets, test-takers should:

  • Use black/blue ballpoint pen or #2 pencil to completely fill out the bubbles.

  • Avoid partially filling out bubbles. Do not leave the center of the bubble empty.

  • Mark responses only in the space provided for that purpose. No other areas of the answer sheets should be written on.

  • Completely erase any changed answers.

Corrected Tests

Bubble Grader automatically grades the student answer sheets, as follows:

  • Right answers are circled in green. In the following illustration, E was answered correctly by the student:

  • Wrong answers are marked with a red X and the correct answer is circled in red. In the following illustration, E was answered incorrectly by the student and the correct answer is C:

  • Test grades can be displayed as either a percent or a fraction at the top right corner of the page as shown below: Percent Grade Fraction Grade

Generated Reports

Bubble Grader can generate the following reports:

  • Comprehensive Test Report – This report combines all data in an all-encompassing PDF report.

  • Item Analysis Report – This report provides a breakdown of each item and the frequency/percentage of students that responded to each question correctly and incorrectly.

  • Student Response Report – This report provides data on each individual student’s responses to each question.

  • Test Summary Statistics Report - This summary report gives basic statistics on test grades as a class overall. Statistics include mean, median, standard deviation and range. 

Creating a Bubble Grader Index Form

The Bubble Grader process can be set up to run automatically or you can create a Bubble Grader Index Form to allow the MFP user to specify Bubble Grader settings directly at the MFP. To create a Bubble Grader index form, do the following:

  1. Add a MFP Panel node to your workflow.

  2. Double-click on the MFP Panel node to open up its node properties window.

  3. Check the Attach Index Form button; then click on the + icon to create a new Index Form.

  4. On the Create new index form window, select the Blank Index Form button.

  5. On the Index Form Builder, you should see a button for Bubble Grader on the bottom left hand side of the window, as in the following illustration:

  6. Drag-drop the Bubble Grader button to the canvas area of the Index Form Builder window. Bubble Grader fields will be automatically created, allowing the MFP user to specify Bubble Grader settings. Refer to the following illustration for an example:

Bubble Grader Metadata

The Bubble Grader process outputs the following metadata:

Document Level

Document level metadata is added to all documents that leave the Bubble Grader process on a “Normal” transition.

  • {omr:questions} - Number of questions graded
  • {omr:students} - Number of tests graded
  • {omr:teacher} - Teacher ID, if set
  • {omr:test} - Test ID from Answer Key, if set
  • {omr:course} - Course Code from Answer Key, if set
  • {omr:total_points} - Total number of points on test
  • {omr:stats.max} - Maximum score (if number of tests graded is greater than/or equal to 1)
  • {omr:stats.min} - Minimum score (if number of tests graded is greater than/or equal to 1)
  • {omr:stats.mean.raw} - Mean score (if number of tests graded is greater than/or equal to 1)
  • {omr:stats.mean.percent} - Mean percent score (if number of tests graded is greater than/or equal to 1)
  • {omr:stats.range} - Range of scores (if number of tests graded is greater than/or equal to 1)
  • {omr:stats.deviation} - Standard deviation (if number of tests graded is greater than/or equal to 1)
  • {omr:stats.variance} - Variance (if number of tests graded is greater than/or equal to 1)

Page Level

Student-specific metadata is added to outputted student test sheets.

  • {omr:student.correct[page]} - Total
  • {omr:student.grade[page]} - Percent (without percent sign)
  • {omr:student.id[page]} - Student ID, if set
  • {omr:student.first_name[page]} - First name, if set
  • {omr:student.last_name[page]} - Last name, if set
  • {omr:student.num_correct} - Total number of correct answers
  • {omr:student.unanswered} - Unanswered questions (if number is greater than/or equal to 1)