SMART TEACHING
www.SmartTeaching.org

24. An Example of Using Data

©2006 Ron Fitzgerald, D. Ed.

Previously we reviewed general information on Using Data in the Classroom (Topic #23).  Now let us look at a powerful example of such use.

Two important tools.  A rubric is a list of quality standards for a task, process, or product.  Consider this example of a simple rubric for writing paragraphs:
Paragraph Construction Rubric
Quality Standard (1 point @)
Yes 
No

+
-
1. Has a clear topic sentence.

2. Has supporting sentences. 

3. Has a clincher sentence.

4. Has a clear focus.

5. Has good word choice and tone.

6. Has current grammar, capitalization, punctuation, and spelling.

7. Has transition sentence(s) as needed.  or N/A

Total =
  

  
SCORE
 #NO
Comment:
This rubric addresses the important basic skill of writing and can be used by students for self-evaluation of their own writing or for evaluation of their writing by the teacher.  Then the score or performance trend can be analyzed over a period of time with a run chart.  This analysis gives the student and the teacher a clear visual picture of degree of progress on meeting quality standards.  Let us take a look at an example analysis and how it can be used to achieve higher quality scores in learning.

Consider the run chart shown below for a small writing class of ten students:

  1. In each week (R-1, R-2, etc.) the class average score was recorded on a run or line chart.
  2. Normal or general instruction was given prior to the weeks R-1, R-2, and R-3 evaluation and charting.  The teacher was not satisfied with the 6.4% rise in scores between the weeks R-2 and R-3.
  3. So, after the R-3 test, she placed an analysis chart on the whiteboard by asking each student to raise his or her hand if the student received a “NO” (deficiency) score on a standard.  The teacher totaled the number of students receiving a point loss on each standard.  Note the high result of 5 for standard #2; that is 5 students of 10 received a point loss for proper construction of support sentences.
  4. Since standard #2 have clearly provides the most potential for improvement in the class writing performance, the teacher then structured three days of special instructional concentration on this standard - - a focused intervention to promote higher quality.  This involved clarification of the definition of a supporting sentence, classwide evaluation of sample supporting sentences, and special drills and discussion on recognizing good and inadequate supporting sentences.
  5. When a writing exercise was scored at the end of week R-4, the number of students losing a point on standard #2 dropped from 5 to 1.  The total class average score rose 16% above the average for week R-3.  In other words, focused intervention worked as a strategy for quality or improvement.

Important observations.  There are three important observations to keep in mind here.  First, the use of data to focus instructional intervention is a powerful procedure for improving learning.  Second, if students are partners in summarizing data, in this case the quick oral survey of “NO” ratings or point loss on the rubric standards, gathering useful data need not be time consuming.  Third, as the specific example described here shows, the rubric/run chart combination is a simple and useful approach to promoting winning scores in learning.  Use that approach with pride in your service to students.

Suggestions for instructional leaders.  Finally, these three suggestions are offered for administrators and teacher leaders who want to help teachers implement the tremendous power of using this type of data analysis in the classroom:

  1. Give teachers the gift of focused training and study resources on both using rubrics and then using simple statistical analysis of evaluations.  The web site www.SmartTeaching.org has been designed to identify appropriate resources.
  2. Consider establishing an extra duty position called “Data Facilitator” in each school.  This person can be given the training to help teachers apply and expand the power of data analysis.  He or she can establish an important business/industry connection by joining the American Society for Quality (ASQ) and participating in its regional chapter meetings.
  3. Make basic software available to teachers and students.  Examples are Microsoft Excel, QI Macros for Excel www.qimacros.com, and the great software for younger students available from Tom Snyder Productions www.tomsynder.com such as Graph Master (grades 4-8) and Scholastic Keys (grades K-5) with its spreadsheet connection MaxCount to Microsoft Office.