APPENDIX A
APPENDIX A DEFINITIONS COMPENSATION - The measure of additional pilot effort and attention required to maintain a given level of performance in the face of deficient vehicle characteristics.
CONFIGURATION - The aircraft geometry as established by the actual position of movable portions and surfaces controllable by the selectors, and the state of operability of on-board systems.
Examples: Auto-throttle on, flaps at 15 °, wing sweep at 45 ° , etc.
COCKPIT INTERFACE - The means provided for the flow of information to and from the pilot. These include the display of informa- tion available to the pilot as well as the type and characteristics of the cockpit controls.
Examples : Description of cockpit instruments and layout.
Description of control system (i.e., stick, wheel, force - deflection gradients, sensi- tivities, primary, secondary controls, and selectors provided).
CONTROLS - A distinction is made between the types of controls in the cockpit according to their function. Principal con- trols are the primary and secondary controls.
Primary - Those controls used by a pilot to continuously modify the movement of the aircraft.
Examples: Pitch, roll, yaw controls, throttle, DLC.
Secondary - Those controls used by a pilot to make discrete changes in the movement or balance of the aircraft, thereby modi- fying the need for actuation of the primary controls.
Examples: Pitch, roll, and yaw trimmers, aerodynamic braking devices.
Selectors - Those cockpit controls available to the crew for changing aircraft configuration.
Examples: Flaps, slats, wing sweep, BLC.
3O FAILURE STATE- A steady-state failure characterized by the various failed systems that affect the handling qualities. The dynamic effect of a failure is called a change of state and should be noted separately.
Any failure resulting in loss of selected Examples: function. Engine failure, augmentation sys- tem, failure in stability, autothrottle, pri- mary flight control system (power boost, electric stick, servo control feel, etc.) or secondary flight control system (trim, aero- dynamic brake, etc.).
FLIGHTor SORTIE - A complete sequence of flight phases of an aircraft within one of its roles. Full or complete mission.
The composite of takeoff, climb, cruise, com- Example: bat (or other special phase), descent, approach, landing.
FLIGHTPHASE A designated portion or segment of a complete flight. A mission phase. A flight phase may be represented by one or more separate tasks.
Examples: (a) Common phases - takeoff, climb, cruise, descent, approach, and landing.
(b) Special phases required by role - formation, refueling, air-to-air or air-to- ground combat, weapondelivery, emergency conditions (i.e., 2- or 3-engine operation, emergencydescent, etc.), VTOLtransition, VTOLhover, STOLtakeoff, and STOLapproach.
FLIGHTSUBPHASE - That part of a flight phase having a single objective, and a single configuration or change in a configuration.
Air-to-air tracking, terminal area holding, Examples: glide slope capture, localizer capture, ILS tracking, wave-off.
Those qualities or characteristics of an aircraft that HANDLING QUALITIES- govern the ease and precision with which a pilot is able to perform the tasks required in support of an aircraft role.
MANEUVER - A planned and regulated movementof an aircraft for the purpose of aiding the completion of a given control task.
Examples: Bank, turn, dive, pullup, turn reversal, roll reversal, rolling pullup, steady sideslip, return from sideslip, control steps and pulses, maintenance of a steady condition.
MISSION- The composite of pilot-vehicle functions that must be performed to fulfill operational requirements. May be specified for a role, complete flight, flight phase, or flight subphase.
PERFORMANCE The precision of control with respect to aircraft move- ment that a pilot is able to achieve in performing a task. (Pilot-vehicle performance is a measure of handling performance. Pilot performance is a measure of the manner or efficiency with which a pilot moves the principal controls in performing a task.)
ROLE- The function or purpose that defines the primary use of an aircraft.
SPECIAL CONDITIONS The special circumstances pertinent to the evaluation (i.e., aircraft environment and pilot stress).
Examples: Special conditions of weather and environment, turbulence, wind shear, ceiling, visibility - night, etc. Pilot awareness, surprise, or distraction with respect to impending failure or disturbances.
STATE- The mass distribution and failure situation that deter- mine completely the behavior characteristics of the aircraft. A state without a failure is a normal state.
TASK- The actual work assigned a pilot to be performed in completion of or as representative of a designated flight segment.
Control That part of a task which requires continuing actuation of the principal controls and use of the selectors (see "CONTROLS") as required.
Examples: Movementbetween specified points, tracking part of weapondelivery, ILS or VORtracking.
AuxiI i ary That part of a task which involves the pilot in actions other than direct control of the aircraft.
Examples: Navigation, communication monitoring, and selection of systems.
WORKLOAD - The integrated physical and mental effort required to perform a specified piloting task.
Physical - The effort expendedby the pilot in moving or imposing forces on the controls during a specified piloting task.
Mental - Mental workload is at present not amenableto quantita- tive analysis by other than pilot evaluation, or indi- rect methods using physical workload (input) and the task performance measurements. An example would be the improvement associated with flight-director type dis- plays which reduce the mental compensation normally required of the pilot.
APPENDIX B
APPENDIX B BRIEFING GUIDEANDRATING INFORMATION FORHANDLING QUALITIES EXPERIMENTS PROGRAM DEFINITION Objectives General: Research D Development[-] Acceptance[--] Other[--] Aircraft role Flight segment of interest Parameter or variable of primary interest Mission description: General statement of the required operations for the flight segment of interest in context of aircraft role.
i. What is pilot-vehicle combination required to accomplish?
, What are the conditions under which these required operations are to be carried out (i.e., aircraft state, environment, and cockpit interface)?
Scope Short look (guide to further tests)[] Long look (definitive as possible)[] Task related only (minimize pilot extrapolation)E_ Mission or flight segment related (pilot extrapolation encouraged)[] Nature of task or tasks provided:[] Short term E_ Long term r_ Critical task(s) included?[] Or left for pilot extrapolation?r_ Identify: Are simulated disturbances provided or to be supplied by pilot?
Use of pilot-initiated or self-imposed tasks, disturbances, or short- term maneuvers.
Provision for familiarization: Measured performance: Is performance to be measured?
Pilot-vehicle (output)E_ Pilot workload (input)[] Other measurements?E_ Additional provisions: Are additional runs allowed for evaluation? Explain: RATING INFORMATION What is to be rated?
[]Handling qualities _]Other _]Task _]Flight segment (flight phase or subphase) []Composite of tasks (specify tasks included in composite rating) _]Composite of subphases (specify subphases) What is provided?
Test vehicle: (aircraft, spacecraft, simulator, etc.)
Aircraft state: Normal_] Emergency[_ Identify failure: Configuration: Gross weight: Mass distribution: Changes in aircraft state: Configuration changes (during task or designated phase) Transient failures (unanticipated failures to be introduced into task for pilot reaction to and correction of resulting disturbance) Cockpit interface: (Brief description of important items noting unusual or detracting or limiting characteristics in particular) Principal controls: Primary controls: Secondary controls: Selectors: Cues and disturbances provided: Motion: Visual: Instruments: Conventional D Novel[] Full panel[] Part panel[_ (Brief statement of instruments or characteristics which may affect the evaluation) External vision: not provided[] External visual display VFRprovided[] IFR only[] (Brief description of information provided) Task(s) : Control task description: Yes[] No[] Auxiliary tasks?
Aircraft environment : Day[] Night [] Visibility conditions : TurbulenceF_ Wind shear[] Crosswind [] Other weather conditions: PILOT EVALUATION DATA Form of results Pilot rating[_ Comments[] Questionnaire[] Oral debriefing[_ Other[-_ Pilot rating scale: Principal items for comment: Program assessment: (Comments and recommendationson validity, effectiveness, etc.
Confidence factor - if used)
APPENDIX B - Example i
APPENDIX B - Example i
BRIEFING GUIDEANDRATINGINFORMATION FORHANDLING QUALITIES EXPERIMENTS
PROGRAM DEFINITION
Objectives
General:
ResearchF] Development[] Acceptance[] Other[]
Aircraft role Commercial transport
Flight segment of interest Landing approach Parameter or variable of primary interest Longitudinal stability Mission description: General statement of the required operations for the flight segment of interest in context of aircraft role.
i. What is pilot-vehicle combination required to accomplish?
Conduct VFR and IFR approaches and landings, either Day or Night, with an accuracy ±50 ft from desired path and ±5 k airspeed. Ninety percent consistency is allowable if pilot can execute wave off safely or make an acceptable landing. (5 ft/sec at touchdown, within 50 ft of centerline, with side velocity less than 5ft/sec) 2. What are the conditions under which these required operations are to be carried out (i.e., aircraft state, environment, and cockpit interface)?
Both normal and emergency state with pitch SASfailed. Approach configuration , Light-Moderate turbulence, Night or Day, 0-20 k crosswind, 10 k per 100 ft windshear. Cockpit interface items must not be considered limiting or to introduce significantly objectionable characteristics to the evaluation pilots.
4O
Scope
Short look (guide to further tests)_
Long look (definitive as possible) _-_
Task related only (minimize pilot extrapolation) []
Mission or flight segmentrelated (pilot extrapolation encouraged)_
Nature of task or tasks provided:
Short term [] Long term
Critical task(s) included?_ Or left for pilot extrapolation?
Identify: Consider effect of hi_her level of turbulence on instrument
approach.
Are simulated disturbances provided or to be supplied by pilot?
Light turbulence and wind shear provided.
Use of pilot-initiated or self-imposed tasks, disturbances, or short- term maneuvers.
During. familiarization runs only.
Provision for familiarization: Five runs at be_innin_ o_ each session.
Measured performance: Yes Is performance to be measured?
Pilot-vehicle (output) [] ILS trackin_ error Control column and throttle activity Pilot workload (input) [] (reversals and work) Other measurements? _ Altitude and airspeed error Additional provisions: All but _amiliarization runs used only to veri_y learning, curve.
Are additional runs allowed for evaluation? Yes Explain: Pilot may make nonperformance evaluation runs as time allows after completion of all data runs.
RATING INFORMATION What is to be rated?
[] Other [] Handling qualities [] Task Flight segment (flight phase or subphase) Landin_ a_roach [] Composite of tasks (specify tasks included in composite rating) Composite of subphases (specify subphases) What is provided?
Test vehicle: (aircraft, spacecraft, simulator, etc.) S-16 Moving Base Simulator Aircraft state: Normal[] Emergency Identify failure: Pitch SAS failed.
Configuration: Approach configuration, gear _ , flap _ 40 °, leading edge extended, wing sweep 20 ° , etc.
Gross weight: Maximum landing weight Mass distribution: C.G. at aft limit Changes in aircraft state: Configuration changes (during task or designated phase) Flap deflection increased _rom maneuver to approach upon intercepting glide slope.
Transient failures (unanticipated failures to be introduced into task for pilot reaction to and correction of resulting disturbance) Pitch SAS failure to be introduced unexpectedly on two SAS on runs.
Cockpit interface: (Brief description of important items noting unusual or detracting or limiting characteristics in particular) Principal controls: Primary controls: Conventional wheel and yoke with 707 feel characteristics; single-throttle control for all engines.
Secondary controls: Electric trim switch on wheel for pitch and roll, yaw trim - not provided; spoiler actuation not provided in cockpit, but available on voice command.
Selectors: Cues and disturbances provided: Pitch and roll cues with turbulence in vertical motion.
Motion: Visual: Conventional _ Novel [] Instruments: Full panel _ Part panel (Brief statement of instruments or characteristics which may affect the evaluation) External vision:
External visual display VFRprovided []
not provided[]
IFR only [7
(Brief description of information provided)
Closed circuit color T.V. used to provide realistic visual cues 1500 ft to ground accurate 14 ° vertical (downward) cutoff angle provided, but lateral view restricted to 40 ° angle. Prominent horizon provided. Fairly good picture resolution enables 3 ft/sec touchdown to be made consistently, but not good enough for much less.
Task(s): Control task description: a. Visual approach from crosswind leg, 7000-ft altitude at recommended approach speed to land at 5000-ft elevation, b. IFR-ILS approach, capture and track 3 ° ILS from OM. No offset crosswind or turbulence 2000 ft RVR. c. Same as b., except with 20-k crosswind, light turbulence, moderate windshear at 100 ft above ground. 2000 ft RVR Auxiliary tasks? Yes [ No [] Aircraft environment : Day [-_ Night _--] Visibility conditions: Test variable Turbulence [ Light turbulence Wind shear[] 10 k per 100 ft (300 ft - 50 ft altitude) Crosswind [ 20 k Other weather conditions: None PILOT EVALUATION DATA Form of results Comments [] Pilot rating Questionnaire _] 0ral debriefing Other [] Pilot rating scale: Cooper-Harper Pitch Principal items for comment: Airspeed and flight-path control.
response. Pilot workload.
Program assessment: (Comments and recommendations on validity, effectiveness, etc.
Confidence factor - if used) Validity of task. Adequacy o_ display.
APPENDIX B - Example 2
APPENDIX B - Example 2
BRIEFING GUIDEANDRATINGINFORMATION FORHANDLING QUALITIESEXPERIMENTS
PROGRAM DEFINITION
Objectives
General:
Research [] Development[] Acceptance _ Other
Aircraft role gong-ran_e attack bomber
Flight segment of interest In-flight refuelin_ Parameter or variable of primary interest Lateral control Mission description: General statement of the required operations for the flight segment of interest in context of aircraft role.
i. What is pilot-vehicle combination required to accomplish?
BH visual references_ attain and maintain position relative to tanker within presented bounds for period of 10 min.
2. What are the conditions under which these required operations are to be carried out (i.e., aircraft state, environment, and cockpit interface)?
V = 290 KIAS_ h = 30_000 ft_ W = initial and refueled. Daytime, smooth air and light turbulence. Straight flight and turn entries.
Scope
Short look (guide to further tests) []
Long look (definitive as possible)
Task related only (minimize pilot extrapolation)
Mission or flight segment related (pilot extrapolation encouraged)
Nature of task or tasks provided:
Short term _ Long term
Critical task(s) included?_ Or left for pilot extrapolation?
Identify: Success or failure to establish and maintain position with
respect to tanker with light turbulence and occassional disturbance of the tanker.
Are simulated disturbances provided or to be supplied by pilot?
Provided Use of pilot-initiated or self-imposed tasks, disturbances, or short- term maneuvers.
Onl H during, familiarization or subsequent to notification of test director.
Provision for familiarization: As desired by pilot.
Measured performance: Is performance to be measured? Yes Pilot-vehicle (output) _ Pilot workload (input) [] Other measurements? [] Additional provisions: Are additional runs allowed for evaluation? Yes Explain: RATING INFORMATION What is to be rated?
[] Handling qualities Other Adequacy of simulation.
[] Task [] Flight segment (flight phase or subphase) Special phase - refueling.
Composite of tasks (specify tasks included in composite rating) Composite of subphases (specify subphases) What is provided?
Simulator Test vehicle: (aircraft, spacecraft, simulator, etc.)
Aircraft state: Normal [] Emergency [] Identify failure: Configuration: Refueling Gross weight: 300,000 and 400,000 lb Mass distribution: Appropriate Changes in aircraft state: None Configuration changes (during task or designated phase)
Transient failures (unanticipated failures to be introduced into task
for pilot reaction to and correction of resulting disturbance)
Yaw damper Cockpit interface: (Brief description of important items noting unusual or detracting or limiting characteristics in particular) Principal controls: Primary controls: Control stick with light control forces, good centering and low friction. Conventional rudder pedals having light forces but objectionably poor centering. Requires pilot adaptation and special consideration.
Secondary controls: Trim not provided.
Selectors: Not provided - configuration unchanged.
Cues and disturbances provided: Motion: Pitch, roll, and yaw (±45°). Accelerations attenuated by limited translation (±5 ft vertically, ±10 ft laterally; ±10 ° fore and aft).
Visual: Conventional [] Novel [_ Instruments: Full panel [_ Part panel [] (Brief statement of instruments or characteristics which may affect the evaluation) Considered primarily a visual task. Only primary flight instruments - airspeed, altitude, and rate of climb provided.
External vision:
External visual display VFRprovided [] not provided []
IFR only []
(Brief description of information provided)
Closed circuit T.V., enabling visual formation flying with stationary model of tanker aircraft.
Task(s): Control task description: (1) Close on tanker, establish contact, maintain hookup for duration of refueling operation without turbulence. (2) Same as (1), except for simulated light turbulence and occasional abrupt displacement of tanker to simulate disconnect.
Auxiliary tasks? Yes [] No [] Aircraft environment :
Day[] Night []
Visibility conditions: Unobstructed - except for accurate windshield and visibility representation.
Turbulence_ Light Wind shear_ Crosswind [] Other weather conditions: 5O PILOT EVALUATION DATA Form of results Pilot rating _ Comments _ Questionnaire _ Oral debriefing Other _ Questionnaire will be made available after completion of test.
Pilot rating scale: Cooper-Harper Principal items for comment: Pilot workload. Influence of control system characteristics, if any.
Program assessment: (Comments and recommendations on validity, effectiveness, etc.
Confidence factor - if used) Realism o_ task. Adequacy of simulated motion.
REFERENCES • Harper, Robert P., Jr.; and Cooper, George E.: A Revised Pilot Rating Scale for the Evaluation of Handling Qualities. AGARD C.P. 17, Compila- tion of papers presented to AGARD Flight Mechanics Panel Specialists' Meeting, Sept. 20-23, 1966.
.
Harper, Robert P., Jr.; and Cooper, George E.: A Revised Pilot Rating Scale for the Evaluation of Handling Qualities. Rep. No. 153, Cornell Aeronautical Lab., Inc., Sept. 1966.
.
Anon: Aircraft handling - general requirements. Note Technique 5/67, Service Technique Aeronautique Section Etudes Generales, 4, Avenue de la Porte d'Issy, Paris 15 ° France.
.
McDonnell, John D.: Pilot Rating Techniques for the Estimation and Evalu- ation of Handling Qualities. AFFDL TR-68-76, Systems Technology, Inc., Dec. 1968.
° Bird, Daniel: Flight Control Studies in the Small Stick Deflection Area.
Presented to AIAA Simulation for Aerospace Flight Conference, Aug. 26-28, 1963.
) Gaul, John W.: Application of Pilot-Controller Integration Techniques to a Representative V/STOL Aircraft. Final Rep. AFFDL-TR-65-200, Bell Aerosystems Co., Oct. 1965.
.
Anon.: Simulator Investigation of Supersonic Transport Operating Margins, Instrument Procedures, Handling Qualities, and Longitudinal Stability Requirements• FA-SS-66-2, March 1967. Boeing-North American Joint Venture, Supersonic Transport Research Program Sponsored by the FAA, Contract AF33/657/I1461.
) Cooper, George E.: Understanding and Interpreting Pilot Opinion. Aeron.
Eng. Rev., vol. 16, no. 3, Mar. 1957, pp. 47-51, 56.
• Cooper, George E.: The Use of Piloted Flight Simulators in Take-Off and Landing Research. AGARD Rep. No. 430, Jan. 1963.
52 NASA-Langley, ,969 -- 2 A-2413 917SOG'9"(3 'u°_,6u!Hs'_ NOIIV_IISINIWCIV :lgVdS (3NV S311nVNO_i3V "iVNOIIVN NOISIAIC] NOI.LV_O:INI 1VglNH931 (3NV 31:111N313S :tuoH peu/ejqo aq Aem'suoueo/Iqnd esaql lO Al/I/qel/eAe eqi uo Sl/eieQ 'o_pol±aOU_I _ugs!xo ol uo!lnq!Jauo9 "s,_a,xang S_OlOUqgOL puc auelaodcu_ ue poaop!suo9 pue aurar? ao agvnuo._ 's01o N pu_ suoda_I uo!aVZ!l]_[1 ,LqOlOUtl,_k VSVN e _apun po_v_ouo_ uog_tuaoju ! le_!uq._m 'sja?a_[ q_aL apnpu! suo!l_C_!lqn d suo!_v_!idd_ put ._99ua!._S :S.IAIOdR_t _O.IOV/ILNOD _)3t)dSOJ0_-UOU J0t[lO pul_ [U}gJO[t]LU03 U! ]S.')J;)_UI aeln._gJed jo oq ,(era ]etla gggN Xq pasn "SUC)SI'a.I .1OtllO ao 'uou ,NOlOUtpO_ uo uo!aecuaoju I :gNOI.LVDI'I_tfld -_39!ssv p .{aun3as 'm_p l_eu!m!load jo asne._aq NOLLVZI'I LLII AOO'IONHD_tl uoianq!J_s!p po_!tu![ 8u!a!a_az uo!leuuoju 1 :SI_IflCINV_IOI_J}_[ "IVDINHD:3_L "so!tldua_o!Iq! q iepods puu 's_tooqa91nos 's)iooqpum t 'suop_I!dtuo9 mtrp 'sqdua_ouotu oSpolaXOU> 1 8ugs!xo m uo!mq!Jmo._ 's_u!paa_oad a_uoaajuo_ apnpu! suoge3!Iqn d se a._uvlaodm! jo SSalaqaaoaou anq odors m •so!:!a!age VgVN ol anita jo ao mosj pal!alp pt'oaq ssa! u()!avtuJoju I :SJ.I.ON "IVDINHDJ_L u°!aecuaojuI :gNOLLVDI'I_tFId "IglD_tdg "o8poI_om I •qs!lffU R u! uo!mq!ns!p VSVN luatu ol _ugs!xo m uo!mq!nuo) _ugsv I e pue 'maldcuo_ paaop!suo_ a_enffuv, l u_!aaoj e u! paqs!lqnd 'lummdus! poaop!suo_ uog_uuoju ! i_!utpoa u°!_euu°JuI :SNOLLV'ISNV_I.L "IVDINHD:I1 puu _!mopS :S.LIIOdR_I "IVDINHDR_L
SNIOIIVDFI tfld IVDINHDRi ONV DI ILLNt IIDS VSVN
Hg6[ ._o ,t')V RDVd_ (INV S:)LL_IVNOHR V "IVNOLLV N -- ,,'/oa._eq_ _qn_a._ ,)ql pt#' 5#fl[,t.llaV yl[ _'utux_ouo._ t_O/lVm,.goju._/o uo!;pu!m#,r!p OlUSClO.tdctt, t_tt_ alq_aflatu d e__pf,n ,)ql ao] aFi,_o._4 tl_q, ttO.tlt'.lCrItltZtqV V aq. L "aavdr run aaaqclromlv aql Ztl mtamottaqd ]o aNpa -l,_ouq uv_a.,tq ]o ttOl. yUvdx3 oql ol " " " al/lqt.quo_ Ol yt, oy pa_anyuo_ aq ll_,qr _olmy pa_!uo aCll /o ra!/!,V_a_, oat, dr Fur lpO!;m,uo._ov aq,L, usnla'R lo N o O (lenu_lal l_aSOd 8g I uog_oS ) alqtZaA!lapufl Jl :l:F.llgVl'q_LgOd ,\ SSRN1S.qlR 'IVlDl:IdO IlV_ SSVIO .LSI:11..-I _l_OV RDYdS 9_$0g "2)'(1 '_o_9_sv,_ "g 1VNOI,I.V N RDV_LSOd NOI£Va£SlNllaI_aV ]3VdS aNY SDLtrlVNOS_tV lVNOLtVNI