The document discusses the Aviation Selection Test Battery (ASTB), which is used to select student pilots and flight officers for the US Navy, Marine Corps, and Coast Guard. It provides an overview of the ASTB, including its purpose, administration, scoring components, minimums required, and relationship to performance in flight school. The ASTB consists of six multiple choice subtests and has been in use since 1942, with revisions over time. It is primarily used to predict success in aviation training programs.

1. Aviation Selection Test Battery (ASTB)
22 Nov 10 – 1100 Central Time
Audio Conferencing Dial In Line: 1-866-711-1482
Participant Passcode: 7418049
Please, be considerate of other participants…
Use your MUTE button (*6 if you don’t have a Mute
button)

2. Overview
 Background on ASTB
 Current ASTB administration rules
 APEX web-based test delivery platform
 Release of ASTB-E
• New content
• New administration rules
08/29/12 2

3. Question # 1
A Testing All Officers Eligibility.
 What is the purpose of B Developed by statistical methods to
predict the success of students in aviation
ASTB? officer training programs.
C Testing for applicants to join the JAG
Program.
D. Identifying the trends of all Officer
candidates.
Answer: B
3

4. Aviation Selection Test Battery (ASTB)
 Primary tool used to select student pilots and
student flight officers for the USN, USMC, and USCG
 Sections of the battery are also used to select
candidates for OCS
 ASTB was first implemented in 1942, with revisions
in 1953, 1971, and 1992
 In July 2004, three new forms (Forms 3, 4, and 5)
were released to address a test compromise
08/29/12 4

5. ASTB Administration
 Approximately 10,000 ASTBs administered every year
 243 permanent custody locations:
• OSOs, NRDs, NROTCs, Military Institutes, selected NAS and
MCAS in CONUS and overseas
 Available in paper/pencil and secure web-based
format via APEX platform
 On-line delivery system for the ASTB (APEX) is in use
at over 100 sites CONUS and OCONUS
08/29/12 5

6. Question # 2
 The ASTB tests which A Spatial Apperception
of the following Test
categories? B Navigational Skills
C Vision
D Essay Writing
Answer: A
6

7. Current Structure & Content
 The current battery (Forms 3, 4, & 5) consists of six
multiple choice subtests
• Math Skills Test
• Reading Comprehension Test
• Mechanical Comprehension Test
• Spatial Apperception Test
• Aviation & Nautical Information Test
• Aviation Supplemental Test
08/29/12 7

8. ASTB Score Components
 Officer Aptitude Rating (OAR)
• MST, RCT, MCT
• Predicts academic performance in OCS
• Range 20-80 (higher is better)
 Academic Qualifications Rating (AQR)
• Predictor of performance in academic portions of API and ground
school and attrition
• Range 1-9 (higher is better)
 Pilot & Flight Officer Flight Aptitude Ratings
(PFAR & FOFAR)
• Predictors of flight grades in primary flight training and attrition
• Range 1-9 (higher is better)
08/29/12 8

9. ASTB Minimums
 USN Pilot: 4/5 (AQR/PFAR)
 USN FO: 4/5 (AQR/FOFAR)
 USMC Pilot: 4/6 (AQR/PFAR)
 USMC ECMO/RIO: 4/6 (AQR/FOFAR)
 USCG Pilot: 4/5 (AQR/PFAR)
Minimums specified in PAs
106, 107, 150D, & 150E
08/29/12 9

10. ASTB Score and Flight School Grades
SNA AQR and Ground School Grades SNA PFAR and Flight Grades
80 80
70 70
3
4
Primary Flight NSS
60 4 60
5
5
API NSS
6
50 6 50
7
7
8
40 8 40
9
9
30 30
20 20
USN USMC USN USMC
Service Service
SNFO AQR and Ground School Grades SNFO FOFAR and Flight Grades
80 80
70 70
3
4
Primary Flight NSS
60 4 60
5
5
API NSS
6
50 6 50
7
7
8
40 8 40
9
9
30 30
20 20
USN USMC USN USMC
Service Service
NOTE: Error bars represent one standard deviation.
08/29/12 10

11. ASTB & Attrition
- Current ASTB does an
AQR and SNA Attrition
45%
40%
35%
excellent job of
30%
predicting
% Attrition
25% USN
whether USN USNAs &
20% USMC
15%
USNFOs will attrite from
10%
5%
training
0%
3 4 5 6 7 8 9
AQR
PFAR and SNA Attrition FOFAR and Attrition for SNFOs
35% 35%
30% 30%
25% 25%
% Attrition
% Attrition
20% 20%
USN USN
USMC USMC
15% 15%
10% 10%
5% 5%
0% 0%
4 5 6 7 8 9 4 5 6 7 8 9
PFAR FOFAR
08/29/12 11

12. ASTB: The Bottom Line
 The current ASTB is calculated to save the U.S.
Government $38 Million in training costs annually
08/29/12 12

13. ASTB Administration
Continued success of the ASTB depends on:
1. Security of test materials
2. Adherence to test procedures
3. Timely processing of completed tests
08/29/12 13

14. ASTB Security
 Per OPNAVINST 1532.1, custodians of ASTB testing material
shall:
• Prohibit access to test materials by personnel who may
later wish to take the test
• Prevent disclosure of any information about the test and
test materials
• Perform strict accounting of all test materials before and
after each test administration, including page checks of all
booklets
• NEVER give information to applicants about specific items
on any subtests, or right/wrong answers for any test
questions
08/29/12 14

15. ASTB Security
Loss or Compromise of the ASTB Materials
(1) NAVCRUITDIST personnel shall immediately contact NOMI
(Code 0341), commercial 850-452-2257x1060, or DSN
922-2257x1060, and NAVCRUITCOM (N311).
(2) Commanding Officers
(a.) Direct an investigation of the circumstances
surrounding the loss or compromise of testing material
(b.) Provide a report to NAVCRUITCOM (N311) and (00IG)
via the appropriate chain of command.
08/29/12 15

16. Current ASTB Retest Rules
Student AQR Means by Retakes
 Limit of 3 administrations
• One shot at forms 3, 4, & 5
100 9
90 8
80
5.91 7
 Only the most recent score 70
% Attrition
5.32
60 4.97 4.96 4.93 6
50 5
counts 40
30
3.80
4
3
20
 Mandatory delay between 10
0
21.6 26.9 33.2 30.4 57.1 60 2
1
retests 1 N=5954 2 N=2494 3 N=413 4 N=92 5 N=14 6 N=5
Test Count & Frequency
• 30 days between first and
second test
• 90 days between second
and third test
 No waivers on retest
intervals, so older examinees
should plan accordingly
08/29/12 16

17. ASTB Retest Rules
 Examinees cannot replace parts of their scores
• Retests are All or None
 An illegal test (wrong form/too early) counts against
an examinee’s limit even if not the examinee’s fault
 Score waiver requests should go to PERS-435
08/29/12 17

18. Test Merges
 If an examinee takes the OAR (first three subtests of the
ASTB) only, then decides s/he wants to be an aviator:
 Within 90 days, examinee can take the 3 remaining
subtests
• does not count as an extra test against examinee’s limit
• If OAR given on paper, 2nd half web-based admin requires
assistance from NOMI
 30/90 day retest clock starts on day of the 2nd half
administration
08/29/12 18

19. ASTB Scoring
 All ASTB scoring conducted by NOMI
 Mail completed tests to NOMI
• Include your e-mail address on the transmittal form so that
the scores can be returned to you as quickly as possible.
 Web-based ASTBs are scored automatically and
immediately
• Scores available for display and printing as soon as the test
is complete
08/29/12 19

20. APEX.NET – Web-Based ASTB
 APEX is a web-based platform for secure online test
administration
 Deployable to all permanent ASTB test sites
 System administrator issues user ID, user password,
and workstation ID
 APEX also available on a temporary basis to non-
permanent sites
• Successfully used OCONUS & Shipboard
08/29/12 20

21. How does APEX work?
 System requirements are minimal
 Requires a high-speed internet
connection
 Installation requires admin user
privileges
 Installs a small piece of client software
on the
local machine
 Examiner account granted upon
verification of requestor ID
 The application runs on the server
 Test content is downloaded
one item or test segment at a
time, and erased upon
completion of that item or segment
 Official score letters can be printed
immediately upon test completion
08/29/12 21

22.  Release of ASTB-E
08/29/12 22

23. Future Score Components
 NOMI delivered a major ASTB revision
• ASTB-E
 Current ASTB yields the following scores: Range:
• Academic Qualification Rating (AQR) 1-9
• Pilot Flight Aptitude Rating (PFAR) 1-9
• Flight Officer Flight Aptitude Rating (FOFAR) 1-9
• Officer Aptitude Rating (OAR) 20-80
 ASTB-E adds these new components:
• Pilot Aviation Fit (PAF) 1-9
• Flight Officer Aviation Fit (FOAF) 1-9
08/29/12 23

24. Future Structure & Content
 ASTB-E will consist of seven sections:
• (1) Math Skills Test (MST)
• (2) Reading Comprehension Test (RCT)
• 3) Mechanical Comprehension Test (MCT)
• (4) Aviation & Nautical Information Test (ANI)
New
• (5) Naval Aviation Trait Facet Inventory (NATFI) Content
• (6) Performance Based Measures (PBM)
• (7) Biographical Inventory with Response Verification (BI-RV)
08/29/12 24

25. Naval Aviation Trait Facet Inventory (NATFI)
 NOMI has identified the trait scores that lead to success in aviation
training, and is currently validating profiles of aviators mid-career,
and upon selection for command for use in PAF/FOAF scoring.
 The NATFI is a forced-choice personality assessment, consisting of 88
statement pairs:
• Some consist of two flattering statements
 I am confident in my ability to learn new skills.
 I firmly believe that I am capable of excelling
in a wide variety of situations.
• Some consist of two unflattering statements
 I am more of a follower than a leader.
 I am almost always running behind schedule.
08/29/12 25

26. What do these answers mean?
 Examinees establish a pattern of responses
regarding each trait.
• No single answer on this test tells us who the
examinee really is.
• The set of answers tells us where s/he stands on
all the traits we target.
 Training success data tells us which traits predict
success in training, and which are consistent with
success in the fleet
 Screen out candidates who have dangerously low
scores.
 Select candidates with those
traits and you’ll get lower attrition
08/29/12 and more career-level success 26

27. Performance-Based Measure (PBM)
• Presents a unique string of numbers & letters
 Measure of dexterity simultaneously in each ear
and multi-tasking • Examinee focuses on the numbers heard in the
skills designated ear
“R 8 N S M A 2 G B 7 F “Y L 3 S R 4 F Z 9 X F
L 6” 8 G”
 Tracking Tasks
 Dichotic Listening Left Right
Ear Ear
Tracking Tasks
08/29/12 27

28. Biographical Inventory
 A questionnaire of background experiences relevant to
aviation
 Self-proctored online
 BI will include Response Verification
• Will reduce faking
• Will eliminate typo errors as an explanation for incorrect
info about experiences
 Sample Item:  If you selected a - d, indicate:
 1. What was your involvement in  What year(s)? _________
high school sports?
 What school(s)? _________
 a. Captain of a team
 b. Member of a team
 c. Participant in an individual
sport
 d. Worked in a supportive role
(e.g., equipment mgr)
 e. No involvement in high school
sports
08/29/12 28

29.  ASTB-E Administration Rules
08/29/12 29

30. ASTB-E Administration
 Parts of the ASTB-E can be administered in booklet
format (for when computers are unavailable)
 The final two sections must be administered online
(1) Math Skills Test (MST) top
(2) Reading Comprehension Test (RCT)
OAR
(3) Mechanical Comprehension Test (MCT)
APEX eb-enabled
(4) Aviation & Nautical Information Test (ANI) Paper or
(5) Naval Aviation Trait Facet Inventory (NATFI)
Only
(6) Performance Based Measures (PBM) APEX
(7) Biographical Inventory with Response Verification
(BI-RV)
08/29/12 30

31. ASTB-E Administration Rules
 Lifetime two-attempt limit at ASTB-E
• Previous attempts at Forms 3, 4, & 5 do not
count toward this limit
• Forms 3, 4, & 5 will be deactivated on the day
that ASTB-E goes operational
• Form 3, 4, & 5 scores generated before ASTB-E
release will remain valid for a lifetime
• Form 3, 4, & 5 scores generated on or after ASTB-
E release date will not be valid
08/29/12 31

32. ASTB-E Administration Rules
 180 day delay required before ASTB-E retest
 OAR Merges are still permissible within 90 days of
valid OAR administration
 Paper-to-Web Test Resumes are also legal within
90 days of valid paper exam date
 Paper booklets will be issued in two forms: Forms 6
&7
• Web-based ASTB-E content has no form numbers
• Subtests are administered in adaptive format.
• Each examinee gets questions tailored to his/her
ability level.
08/29/12 32

33. BI-RV Administration
 Administration time for MST, MCT, RCT, ANI, NATFI,
& PBM is approximately 2:45
 BI-RV may take examinees an additional :45 to 2:00
 BI-RV will be self-proctored
• During registration, system will generate a letter
for the examinee with a username & password for
accessing the BI-RV
• Examinee has 90 days from pw issue to
complete the BI-RV on any computer
 Complete ASTB-E scores will not be generated until
the BI-RV is completed
08/29/12 33

34. ASTB-E Merge Scenario 1
• (1) Math Skills Test (MST)
• (2) Reading Comprehension Test John Smith
OAR
(RCT) takes OAR on
day 0
• (3) Mechanical Comprehension Test
(MCT) Day 90, decides he
wants to be an aviator
• (4) Aviation & Nautical Information - He must complete
Test (ANI) ANI, NATFI, & PBM
• (5) Naval Aviation Trait Facet that day
- Issued a BI-RV pw,
Inventory (NATFI) and has 90 more days
• (6) Performance Based Measures (i.e., until day 180) to
(PBM) complete it
• (7) Biographical Inventory with
Response Verification (BI-RV)
08/29/12 34

35. ASTB-E Merge Scenario 2
Joe Sixpack takes
(1) Math Skills Test (MST)
OAR on day 0
(2) Reading Comprehension Test
OAR
(RCT)
If on Day 22, he
(3) Mechanical Comprehension Test decides he wants to be
(MCT) an aviator, how many
(4) Aviation & Nautical Information days does he have to
Test (ANI) complete the ANI,
(5) Naval Aviation Trait Facet NATFI, & PBM?
Inventory (NATFI)
(6) Performance Based Measures If he takes ANI, NATFI,
(PBM) & PBM on Day 45,
how many days does
(7) Biographical Inventory with
he have to complete
Response Verification (BI-RV)
the BI-RV?
08/29/12 35

36. ASTB-E Retest/Merge Scenario 3
Jake Scully takes Full
(1) Math Skills Test (MST)
ASTB-E on Day 0
OAR
(2) Reading Comprehension Test (RCT)
(3) Mechanical Comprehension Test He retakes OAR on
(MCT) Day 181. Is this legal?
(4) Aviation & Nautical Information Day 268, decides he
Test (ANI) wants to be an aviator
(5) Naval Aviation Trait Facet Inventory after all
(NATFI) - By what day must he
(6) Performance Based Measures (PBM) complete ANI, NATFI,
& PBM ?
(7) Biographical Inventory with
If he takes ANI, NATFI,
Response Verification (BI-RV)
& PBM on Day 269
- By what day must he
complete the BI-RV?
08/29/12 36

37. ASTB-E Resume Scenario 4
(1) Math Skills Test (MST)
Jane Goodall wants to be an
(2) Reading Comprehension Test
aviator, but has no access to
(RCT)
OAR
APEX.
(3) Mechanical Comprehension Test Her examiner gives her the
(MCT) ASTB-E booklet Form 6
(4) Aviation & Nautical Information (MST, RCT, MCT, ANI,
Test (ANI) NATFI) on Day 0.
(5) Naval Aviation Trait Facet
Inventory (NATFI) Her scantron is received by
NOMI & scored on Day 17.
(6) Performance Based Measures
(PBM) By what day does she have
(7) Biographical Inventory with to complete the PBM?
Response Verification (BI-RV) If she completes the PBM on
Day 78, how long does she
have to complete the BI-RV?
08/29/12 37

38. ASTB-E Retest Scenario 5
Bob Dooley takes the first six
(1) Math Skills Test (MST) ASTB-E subtests online on Day
OAR
0, and is issued a BI-RV pw.
(2) Reading Comprehension Test
(RCT) He completes the BI-RV on Day
(3) Mechanical Comprehension 88.
Test (MCT) This becomes his completion
(4) Aviation & Nautical date of record.
Information Test (ANI) When is he eligible to reattempt
(5) Naval Aviation Trait Facet the ASTB-E?
Inventory (NATFI) He attempts ASTB-E Booklet
(6) Performance Based Measures Form 7 on Day 193.
(PBM) Upon receipt by NOMI, this is
(7) Biographical Inventory with recorded as an illegal retest,
Response Verification (BI- and Bob is eligible for no more
RV) attempts. His Day 88 score
remains his ASTB-E score of
08/29/12 record. 38

39. The Gouge
 If this seems confusing, just use APEX for all ASTB-E
administrations.
 APEX will not allow you to give an illegal exam.
 APEX will allow you to look up an examinee’s
complete test history, including paper tests
attempted.
08/29/12 39

40. Computer-Adaptive Tests
Computer Adaptive Tests
 Computer adaptive tests (CATs) tailor items given to an
examinee to that examinee’s ability level
• CAT provides more accurate measurement using
fewer questions
 Four existing subtests will be
administered in CAT format
in the revised ASTB
 CAT also provides improved test
ICC Plots for 3-PL For m 3
1.0
security – no two test forms are
0.9
0.8
alike 0.7
P(U=1|THETA)
0.6
0.5
0.4
0.3
0.2
0.1
0.0
-3 -2.5 -2 -1.5 -1 -0.5 0 0.5 1 1.5 2 2.5 3
08/29/12 THETA 40

41. Will the ASTB-E Improve Diversity?
 Existing ASTB subtests: similar to the SAT,
ACT, MCAT, etc.
• Cognitive ability tests have Compensatory Scoring
historically been the best predictors
of job/task performance
• Have been used because they are
easy to measure
 Title VII protected groups score lower on
these cognitive ability tests
 Title VII protected groups DO NOT score
as low on personality & psychomotor tests
• These are also good predictors of
job/task performance
• These have historically been
difficult to measure
 Adding these measures to the ASTB
(not previously possible) is expected
to improve minority pass rates
without reducing predictive power
08/29/12 41

42. Fake-Resistant Engine
 The engine is software that delivers adaptive forced-
choice personality tests
• The statements you see later depend on what you
Personality Traits
said earlier
• You see two statements at a time, and must choose
the one that describes you better
• The statements are always equally “desirable”
 Faking answers on this engine is as hard as counting into
a seven-deck shoe
 The next 2 slides illustrate what’s so new about this
08/29/12 42

43. Examinees will lie if they can.
 Historically, the biggest problem with personality
measurements is that they can be faked:
 These Likert-scale types of items frequently have
obviously “correct” answers.
 Historically, the biggest problem with personality
measurements is that they can be faked:
Personality Traits
Aggressivenes Adaptability
s
 These Likert-scale types of items frequently
have obviously “correct” answers.
08/29/12 43

44.  The ASTB-E engine uses a new capability: forced-choice items where each
statement is equally “desirable”.
• Not previously possible due to math limitations of existing models
Work Motivation
Personality Traits
Confidence
Unrestraint
Warmth
08/29/12 44

45. How do new ASTB-E measures improve
prediction?
 Cognitive ability can predict a big
chunk of training performance by
itself, which is what the ASTB
already gives us
 Psychomotor ability also predicts a Cognitive
lot of training variability, but note Ability
the overlap with cog ability
Training
• This area represents the extra Psychomotor Performance
predictive power we get from Ability
psychomotor ability – good, but not Aviation-
enough. Relevant
Traits
• An aviation trait test captures a Biographical
great deal of training performance, Experiences
with minimal overlap from other
measures – which is what you want.
08/29/12 45

46. ASTB Information Web Site
 http://www.med.navy.mil/sites/navmedmpte/nomi/nami
 Hosted on NOMI website for Internet access and linking
by CNRC, ROTC, USNA etc.
 Provides access to:
• ASTB Study Guide w/ Sample Items
• APEX Users Guide w/ Screen Shots
• ASTB & APEX FAQ list
08/29/12 46

47. Summary
Background on ASTB
Current ASTB administration rules
APEX web-based test delivery platform
Release of ASTB-E
•New content
•New administration rules
08/29/12 47

48. Questions?
Contact:
NCC Carlin
Jason.carlin@navy.mil
(901)874-9297
For copies of this Webinar Training
send email to:
Jason.carlin@navy.mil
08/29/12 48