1. LANGUAGERESARCH PROJECT XLRI Jan. 2014
(Phase I. WritingMatters Jan 2014)
Tentative PROPOSALforevaluationof essayatXLRI MDP between20th
Jan and 2nd
Feb.2014
Stages:
1. Designingfeaturesandbandsforassessment
2. Creatingratingscale
3. Fieldtesting
4. Analysingandmarking 6 samples assessedscripts fortrainingworkshopand6 more for
calibration
5. Identifyingtesting team:a.training, b.calibration, c.testing
6. Assessment–rerating10% of scriptsfor reliability
Work inprogressto be completedby30th
Dec.
Assistance needed
24 answerscriptsof yesteryearsrangingfromthe novice toexpertlevel - by12th
Nov.2103
6 assessors(accreditedevaluators,sub-editorsof publications) requested -By1st
of Dec. 2013
Budgetwith breakup
6 evaluators @ XLRI
Travel air,rail,and road 6 x 18000 1,08,000
Standardisation&calibration1/2day 10,000
Scriptmarking 3000 x Rs.150 4,50,000
Interratingforreliability 10% 300 x Rs.200 60,000
Stationary& Secretarial work(2) 15,000
Coordinatorfees 80,000
Varia 27,000
Total. Rs 7,50,000
2. Draft Letterto the invitedassessors
Welcome toXLRI – the firstmanagementschool of India.Thankyouforacceptingourinvitationtoassist
inthisimportantproject.All beingwell,we hope tobe able tocall youback for twoshort spellsinthe
nextyearwhenwe take thisprojectforward.
The Schedule
A three hourorientationtofamiliarize assessorswiththe expectationsfromthisexercise,andto
calibrate andstandardize the procedure isthe firstactivityonthe agenda.Those whoaftertrainingand
at the testapproximate tothe ratingsof the premarkedscripts(1band varience intwoof the four
factors andthe total not toexceed2 of the 5 scriptsevaluatedishe permissiblelimit) couldproceed
withthe evealuation.The resultsof the calibrationassessmentwouldbe announcedinabout2hours
aftercompletionof the test.Anyone whomayrequire furthertuningupmaybe recalledfora short
retest.
The day starts at 9.00 a.m.eachdayand goesontill 4 p.m. interspersedwithneededcomfortbreaks.
You wouldbe givensome 100 scripts of a one page essayeachday.You wouldbe expectedtotake
between3to 4 minutesperscript.The scriptswouldbe markedonthe 4 featureswithbrief comments
where necessary.Assessorswouldbe expectednottoleave the venue beforeteatime.
The projectmay last6 days includingthe trainingday.We will be payingyouRs.120/- per script.XLRI
wouldbe happyto take care of your board andlodge.We shall alsoreimburse youractual IIAC train/air
(economy) fare.
Needlesstosaythe projectdemandsutmostconfidentialityandsono informationormaterial (script,
scores,descriptor,instructionetc.) canbe takenawayfrom the premisesordiscussedwithothers.
On Projectdays
1. Assessorstoreachthe venue by8:45 a.m.
2. Signand collectscriptsforassessment,pencil box,scoringsheetsandratingcriteria.
3. Fill inrequiredpersonaldetailsinthe scoringsheetandenteryourscore onall 4 feature break
up foreach individual,withremarkswhere necessary.
4. Coffee breakbetween10.00& 10:30; Lunchat 12.30; Valuationresumesat2.30 p.m. withteaat
4.00
5. 10% of the scripts will be reratedforreliability;those exhibitingdeviationsof 1grade or more
wouldhave tospendtime familiarizingthemselveswiththe descriptorsandrate twoscripts
demonstrate paritywiththe official grades.
6. You will be signingaconfidentialitystatementandreturnall material andpaperstothisoffice.
Contact persons:
Secretary : Ms Phone at.
Guestmaster Mr.
Research Coordinator
Main gate no.
3. Assessment Scale & Proficiency Levels
WRITING ASSESSMENT SCALE
Level XL BAND GRADE
Above MinimumExpected
9 A +
8 A
7 A-
MeetsMinimumExpectation
6 B+
5 B
4 B-
BelowMinimumExpectation
3 C+
2 C
1 C
Model Scoring Sheet
Name ofAssessor Date ofassessing
S.No Dummy
No.
Relevance &
Appropriacy
Cohesion&
Organisation
Range &
variety
Grammar &
mechanics
REMARKS
Signature of the assessorwithdate Initialsof centre incharge
Raw scoresto be supplied - entry,percentile,factoranalysis,etc.byAdmissionoffice
RATINGSCALE & BandDescriptors NOT for sharing