ࡱ > M Y bjbj== W W Q l Y Y Y 8 LY L Y [ L [ \ \ \ \ \ \ $ Ƌ ! E \ \ \ \ \ ! a \ \ f a a a \ & \ \ a \ a a h V /o @ o \ [ 8% ZU Y 0^ oo o t | 0 {o n a n o a SENATE AGENDA ITEM III.C.1. 8 March 2005 APPROVED SENATE 8 March 2005 Plus/Minus Grading System CAGAS Report to Faculty Senate Introduction In September, 2004, the Council on Admission, Graduation and Academic Standards was requested to provide a recommendation regarding the adoption of plus/minus final grades for undergraduates at ϲʷ¼. A subcommittee was formed consisting of Kenneth Clontz, Karen Mann, and Martin Maskarinec. The following information is the result of research that examines analyses of plus/minus grading, grading systems used at other institutions, and a survey of faculty and student opinions at ϲʷ¼. That survey was conducted online during November and December 2004. Advantages The single most important argument in favor of a system of final grades that includes plus and minus grades is the increased accuracy of the grade as a reflection of student performance. A report on plus/minus grades provided to the Academic Senate of Arizona State University in 2002 summarizes a computer model developed at Wake Forest University that estimates an error in grade assignment at between a root mean of 0.3 and 0.7 in a system not using +/-. That error drops to between 0.3 and 0.33 for a +/- system (see Appendix A, also Matthews). As a justification for preferring a +/- system, faculty members responding to the ϲʷ¼ survey of attitudes commented on the unfairness of the present system for students who achieve an average of 89: their final grade of B is not distinguishable from the B that a student with an average of 81 receives. Some advocates of a +/- system argue that it will reduce grade inflation, since students who barely reach a grade level will receive a minus grade (an A-, for instance) rather than a full grade (an A). The Arizona State University report summarizes the impact of +/- grades on students with various GPAs, based on the Wake Forest model and data from impact studies at MIT and North Carolina State University (see also Matthews and Gosselin). About 10% of those in the A range would see their GPA decrease through receiving A- grades. For the remainder of the categories (even for those averaging 3.5, often the cut-off point for awards), there was no appreciable effect on GPA from the use of a +/- system. Even if a +/- system is not a means to decrease grade inflation, proponents do argue that such a system will motivate students to work for a higher grade: moving from a B- to a B will be acknowledged in a higher final grade. An even greater motivation may be students efforts to avoid receiving a lower grade. In addition, some proponents assume that faculty members will be more willing to assign lower grades that cost students less than a full point in GPA: a student between a B and a C would be more likely to receive a C+ rather than a B- under a plus/minus system, whereas a faculty member might be more likely to give the student a B instead of a C in a full grade system. Although this could result in lower grades for individual courses, the fact that a student can receive a B+ in other courses instead of a B would mean that, on average, a plus/minus system has a zero net effect on the students overall GPA. Last, some argue that more prestigious universities make use of plus/minus grading, in order to distinguish between groups of students who have largely similar abilities: 19 out of 20 top national universities (from Harvard, through Northwestern University, to the University of California at Berkeley) use such a system. Over all, colleges and universities have been moving toward some form of plus/minus grading (Admissions and Standards Committee, Georgia State University). Disadvantages Those opposed to a +/- system are concerned about the negative effect on GPA for students in the 3.5 to 4.0 range. Students responding to the ϲʷ¼ survey whose GPA falls into this category were the most opposed to adopting the +/- system. It seems that these students believe such a system is less fair, although it is more accurate. A small number of schools, in an attempt to alleviate the drop in GPA for this category of student, have adopted an A+ grade worth 4.33. To minimize the divergence from practices at other schools, a university may use the A+ for individual grades, but cap the overall GPA at 4.0. A second concern is the increase in student appeals of grades, either unofficially to individual faculty members or officially to a grade appeal committee. Since there can be triple the number of borderlines, there might be a greater number of requests for changes of grade. As the Arizona State University report argues, Although the narrower grade increments in a +/- system suggest that there is less to gain in a grade change, narrower increments also suggest that any change should be easier to attain (Appendix A 10). This would be the case in particular for a C- (1.67) grade, since a number of decisions regarding students are dependent upon achieving a C (2.0) average. At ϲʷ¼, 28% of faculty believed that there would be more grade appeals; 41% of undergraduates also believed there would be more appeals. Although not directly discussed in recent literature, there is the possibility that faculty members will have a more difficult time in determining grades if they must discriminate between as many as 12 or 13 different grade categories. In response to the ϲʷ¼ survey, 31% of faculty said that assigning grades would be harder. Almost 34% of faculty indicated that they do not use plus or minus grades now on course assignments. This suggests that a certain number of faculty members would not give plus or minus grades even under a new system that permitted them. Possible Systems Arizona State University provides in its report a table of possible grading systems, indicating which institutions use them. Virtually all schools use an increment of 0.33 for a plus grade, and a decrement of 0.33 for a minus grade (B+ = 3.33 and B- = 2.67). Differences depend on the willingness of universities to provide a full range of plus and minus grades at each level (A+ to F). Variations on this pattern include: No A+ No A+ or F+ No C- or plus/minus grades for D or F. Each of these is an attempt to counteract the mathematical disadvantages of plus/minus grading at the extremes for academic success (the A and the C- grade). One system, at Rutgers University, uses only plus grades for Bs and Cs, the numerical value for which is 0.5. The materials in Appendix B provide information about the kinds of systems in use at ϲʷ¼ peer institutions and at other universities in the state of Illinois. Implementation The greatest difficulty in adopting a plus/minus system is its implementation. Some students will have grades based on both the original and the plus/minus system. However, since research suggests that overall GPA is not significantly different between systems, this should not skew the GPA of this cohort in relation to those whose average is based solely on one system or the other. Further, as with the conversion from the quarter to the semester system carried out in the 1970s, a clear statement on transcripts can identify the nature of the grades for each system. For the registrar, the difficulties are larger. In response to a query from the subcommittee, Dallas Mowen (IMS assistant manager) asserts the following: In order to convert to plus/minus grading, we will not only need to expand the grade fields from one to two characters, but we will also need to expand all honors points fields to 3 decimal places. Eleven database fields will need to be updated to accomplish this. Five will need expansion . . . . There are 270 COBOL programs that would need to be updated . . . the number of program changes would probably be at least 750. I would guess the number of Easytrieve Plus jobs that would require updating at about 275. . . . In addition to database changes, we would have to convert back-up files. . . . It looks like we would need a minimum of a year and a half to fully implement plus/minus grading. In the next few years, the registrars office expects to have capability built into their system that would make it easy to implement a plus-minus grading scheme. However, that is not the case at the current time. CAGAS Recommendation CAGAS voted 6 to 5 to recommend a plus minus grading system. Given the nearly even split, the Faculty Senate will need to closely examine the arguments and information to reach their decision. Implementation of any change should await the conversion of the universitys information system as noted above. References Admissions and Standards Committee (1998). Resolution Concerning Plus/Minus Grading. Atlanta: Georgia: Georgia State University. HYPERLINK "http://www2.gsu.edu/~wwwphl/adandst/plusmin.html" http://www2.gsu.edu/~wwwphl/adandst/plusmin.html Gosselin, L. (1997). Plus Minus Grading Study, Fall 1994 Through Spring 1997. Raleigh, NC: North Carolina State University. HYPERLINK "http://www2.acs.ncsu.edu/UPA/otherdata/GRADANAL.HTM" http://www2.acs.ncsu.edu/UPA/otherdata/GRADANAL.HTM Matthews, R. (1997). Evaluation of the plus-minus system: A computer model. Wake Forest, North Carolina: Wake Forest University. HYPERLINK "http://www.wfu.edu/~matthews/plus_minus/plus_minus.html" http://www.wfu.edu/~matthews/plus_minus/plus_minus.html Appendix A: Peer Institutions Report Appendix B: A Comparison of Various Systems Appendix C: ϲʷ¼ Survey Report Appendix D: Arizona State University Report available for viewing on Faculty Senate website ( HYPERLINK "http://www.wiu.edu/FacultySenate" www.wiu.edu/FacultySenate) or in Faculty Senate office, 323 Stipes Hall Appendix A Analysis of Plus/Minus Grading at Peer Institutionsand other Illinois Colleges and Universities Eight peer institutions and fifty-one 4-year Colleges and Universities were surveyed in regards to their grading systems. The eight peer institutions were identified by the University Professionals of Illinois as being similar to ϲʷ¼. The following schools are included as peer institutions: Townson UniversityCalifornia StateUniversity of Northern IowaWestern Washington University*Montclair State University*Southwest Missouri State UniversityUniversity of Nebraska at Omaha*Western Kentucky University Of these, four schools do not use a plus/minus system. These schools have an asterisk beside their names. Of the four schools with a plus/minus system, the grading scale is shown below: Letter GradeName of InstitutionsCalifornia StateTownson UniversityUniversity of Nebraska at OmahaWestern Washington UniversityA+((A((((A-((((B+((((B((((B-((((C+((((C((((C-((((D+((((D((((D-(((F+((F((((F-( In Illinois, the following are state institutions: University of Illinois at ChicagoUniversity of Illinois at SpringfieldUniversity of Illinois at Urbana-ChampaignIllinois State UniversityNortheastern Illinois UniversityChicago State UniversitySouthern Illinois University at CarbondaleNorthern Illinois UniversityEastern Illinois UniversitySouthern Illinois University at Edwardsvilleϲʷ¼Governors State University None of these 12 state universities use a plus/minus system. Of the remaining 42 colleges and universities in Illinois, 19 systems do not use the plus/minus system. Institution NameGrading ScaleA+AA-B+BB-C+CC-D+DD-F+FF-Augustana College(((((((((((Columbia College((((((((((Concordia University((((((((((((DePaul University((((((((((Dominican University((((((((((Illinois Wesleyan University((((((((((Judson College((((((((((((Knox College(((((((((((((Lewis University((((((((((((Lincoln Christian College((((((((((((Loyola University((((((((McKendree College((((((((((Monmouth College((((((((((((Moody Bible Institution((((((((((((North Central College((((((((((North Park University((((((((((((Northwestern University((((((((((Olivet Nazarene University((((((((((((Principia College((((((((((((Quincy University(((((((((((Rockford College(((((((((((Trinity International University(((((((((((University of Chicago((((((((((( Among peer and Illinois institutions, 32 out of 59 colleges and universities do not have a plus/minus system. Of the 27 schools that utilize the plus/minus system, only one (Towson University) has a F- grade. Only Townson University and the University of Nebraska at Omaha have an F+ grade. Augustana College, Knox College, Townson University, and the University of Nebraska at Omaha allow students to receive an A+ grade. Loyola University is unique in awarding plus grades, but no minus grades. Twelve schools award plus/minus grades for the grade range of A to C-, but students with lower grades only receive D or F. Ten colleges and universities award from A to D-, with no plus/minus for the grade of F. Appendix B Comparison of Different Plus/Minus Systems Systems: ABCDE A+ = 4.33 A = 4.00 A- = 3.67 B+ = 3.33 B = 3.00 B- = 2.67 C+ = 2.33 C = 2.00 C- = 1.67 D+ = 1.33 D = 1.00 D- = 0.67 F = 0.00 A = 4.00 A- = 3.67 B+ = 3.33 B = 3.00 B- = 2.67 C+ = 2.33 C = 2.00 C- = 1.67 D+ = 1.33 D = 1.00 D- = 0.67 F = 0.00 A = 4.0 A/B = 3.5 B = 3.0 B/C = 2.5 C = 2.0 C/D = 1.5 D = 1.0 F = 0.0 A = 4.0 B+ = 3.5 B = 3.0 C+ = 2.5 C = 2.0 D = 1.0 F = 0.0 A = 4.0 B = 3.0 C = 2.0 D = 1.0 F = 0.0 IssueABCDEWill allow differentiation between a high and low B (that is, an 89 vs. an 81) " " " " W i l l c o m p e n s a t e f o r a l o w A w i t h t h e p o s s i b i l i t y f o r a h i g h A " W i l l n o t c a u s e s t u d e n t s w h o r e c e i v e a C - t o b e c o m e i n e l i g i b l e f o r c e r t a i n r e q u i r e m e n t s " " " W i l l p r o v i d e a n i n c e n t i v e t o c o n t i n u e w o r k i n g e v e n w h e n o n e h a s a l o w A , B , o r C . " " " " W i l l a v o i d g r a d e i n f l a t i o n t h r o u g h t h e a v a i l a b i l i t y o f b o t h a p l u s a n d a m i n u s g r a d e " " " I s s i m i l a r t o t h e m a j o r i t y o f o t h e r s y s t e m s a t c o l l e g e s a n d u n i v e r s i t i e s " " W i l l n o t r e q u i r e o t h e r a g e n c i e s t o r e c o m p u t e d G P A t o t h e s t a n d a r d 0 t o 4 . 0 r a n g e " " " " A p p e n d i x C W I U S u r v e y R e p o r t G e n e r a l R e s u l t s S o m e 3 4 9 f a c u l t y a n d 2 9 a d v i s e r s c o m p l e t e d t h e o p i n i o n s u r v e y d u r i n g N o v e m b e r a n d D e c e m b e r ; w h i l e 1 6 1 7 u n d e r g r a d u a t e a n d g r a d u a t e s t u d e n t s d i d s o . O f t h o s e , 6 0 . 1 % o f t h e f a c u l t y f a v o r e d a plus/minus system for undergraduates, 31.2% opposed it, and 8.6% had no opinion. Judgments of advisers were the reverse: only 24.1% were in favor, 69.0% were opposed, and 6.9% believed it would make no difference. Among students, 39.9% were in favor, 47.6% were opposed, and 12.5% had no opinion [undergraduates were slightly more favorably inclined than graduate students]. Most faculty believe that such a system would have a positive (46.3%) or neutral (35.9%) impact on undergraduate courses. Advisers are much more negative: while only 64 or 18.4% of faculty believe in a negative impact, 15 or 51.7% of advisers do. Undergraduate students are evenly split about the impact: 35.1% believe it will be positive, while 34.3% believe it will be negative. Details of the responses for the remaining questions are attached. Association Data Mining Run IntroductionData mining is a set of techniques used to find previously unknown relationships in (usually) large data sets. Association mining is one such technique; it is designed to find items that usually occur together in data sets that have repeated items of the same type. The common example of where association mining is used is the supermarket shopping cart. Supermarkets may track what items individuals purchase over a relatively long period of time. An association mining run may then be made to determine what items people tend to purchase together. The supermarket may use this data to determine what types of coupons to issue, where to place items relative to other items, etc. With respect to the Plus/Minus Questionnaire, each answer to each question may be viewed as an item in a respondents shopping cart. Once the data was properly formatted, we were able to use readily available software to look for responses that generally occurred together. This report describes the results of this run. Association Mining ResultsData mining results are usually presented as a set of rules of the form X ( Y. In a shopping cart, this would be interpreted as people who buy X tend to buy Y as well. In our case, such a rule would be interpreted as people who answered X also tended to answer Y. Note that each question from the questionnaire must have a unique set of possible answers. The original data was modified to make this possible. Our ResultsGenerally, the results of mining the questionnaire verified what was previously conjecture. For example, people who thought an A would be fairer tended to indicate a B would be more fair. This was true for Cs, Ds, and Fs as well. Also, those who indicated the letter grades would be fairer also indicated that GPA would be a better indicator of academic performance.However, there were a few interesting results. Respondents who indicated their GPA was between 3.5 and 4.0 tended to also indicate that As would be less fair. This follows logically since these students generally receive As and might feel their As would be split between A and A grades, thus lowering their GPA. Not surprisingly, these students tended to not favor a change to plus/minus grading, although a smaller percentage of them thought GPA would be a better indicator of academic performance. One other interesting relationship that came out of this run is that undergraduates tended to not favor plus/minus grading at the graduate level. The following table is a few rules we found most interesting from the association mining run. The actual run produced over 2,400 rules. Support is the number of respondents who indicated this ruleConfidence is the conditional probability; i.e. of the number who indicated the body of the rule, what percentage indicated the headLift is a measure of how much the body is a better indicator of the headKind is related to lift: + is good, - is not, . Is in the middleThe rules may be read as "people who indicated