Spotlight: Meet the Technical Center Test Standards Board
By Jason McGlynn
In 2005, ATO Operations Planning (ATO-P) initiated a new Verification and Validation (V&V) Protocol of Operations. To support the reduction of latent defects in fielded systems, ATO-P is implementing V&V methodologies to improve the Test and Evaluation (T&E) products and services provided to the ATO. These methodologies focus on supporting data-driven, best-value decision-making and process improvement strategies throughout the product lifecycle. The Test Standards Board (TSB) was established as a key component of the T&E infrastructure at the Technical Center, and is the primary group responsible for developing, implementing, and administering practices and methods to ensure the quality, integrity, and accountability of the T&E products and services.
The TSB core membership is currently comprised of the Chair, four core Test Subject Matter Expert (SME) members, and a systems engineering representative. The Chair is responsible for facilitating and directing all TSB activities. The core test SME members assist the TSB Chair in establishing, maintaining, and updating the T&E practices and standards. They are also responsible for directly overseeing and providing T&E guidance to the various acquisition and maintenance test programs at the Technical Center. The TSB Chair and the core test SMEs, each highlighted in the paragraphs below, were selected to be on the TSB based on their extensive expertise in the T&E arena.
John Frederick, the TSB Chair, has 23 years of experience in T&E at the Technical Center, 15 of which were working directly for the FAA. John has extensive knowledge of V&V processes, NAS operations, and the ATO mission. He has been widely recognized in the FAA for his comprehensive knowledge, initiative, and leadership in automation T&E. Before coming to the TSB, John provided technical advice and direction in NAS automation testing as the Air Traffic Management Automation Chief Test Engineer. In his many years of experience as a Test Director and Test Program Manager, John’s knowledge of NAS ATC automation allowed him to establish sound T&E strategies, plans, and contract deliverables, as well as to provide effective test and engineering recommendations to the Program Office. John has planned and performed automation T&E on the following major ATC systems: HOST, Information Technology Support Services (ISSS), Voice Switching Communications System (VSCS), Display Channel Complex Rehost (DCCR), Display System Replacement (DSR), HOST and Oceanic System Replacement (HOCSR) , En route Communications Gateway (ECG), Initial Academy Training System (IATS), Enhanced Back-Up Surveillance System (EBUS), En Route Information Display System (ERIDS) and En Route Automation Modernization (ERAM) . He was also the integrated Capability Maturity Model (iCMM) technical lead for the Technical Center and applied T&E knowledge by developing and documenting practical processes and guidelines for testing. John was asked to provide iCMM test process training for Technical Center and FAA Headquarters personnel based on his recognized expertise as a test practitioner. As the DSR Test Director, John implemented test program activities that integrated the new DSR systems into the NAS, and planned and supported the transition of DSR into operational service. John also has extensive experience in simulation development for operational testing of NAS automation systems and performed baseline studies to measure the performance of NAS En Route systems to support air traffic control operations. Much of John’s technical hands-on expertise was acquired as an FAA contractor responsible for software development and testing on NAS En Route operational and support software.
Jeffrey Boldridge, the TSB Surveillance Systems Test Specialist, has worked for the FAA for the last 9 years. Before working for the FAA, Jeff worked for 13 years for the Department of Defense (DoD), testing major systems. His FAA test experience includes: Operational Test Lead on the Automatic Dependent Surveillance-Broadcast (ADS-B) program, Test Lead on the East Coast Broadcast Services, and Test Lead for interfaces on the Airport Surveillance Radar (ASR-11). Jeff’s test experience runs the gamut of the test process from developing initial test requirements through test planning, execution, and reporting of both Development Testing (DT) and Operational Testing (OT). He was responsible for developing and validating innovative test and analysis tools that are used across several surveillance programs. Jeff has consistently and successfully worked with stakeholders to achieve buy-in on test strategies. Beyond the customary testing of surveillance systems, which concentrated on sensor performance, he focused on developing comprehensive test strategies to reveal integrated system defects before they are fielded to the user. By working closely with his counterparts in automation, Jeff has worked to evaluate and provide optimal “system of systems” performance – a key focus area as we move toward implementation of the Next Generation Air Traffic System (NextGen).
Wanda Lopez, one of the two TSB Automation Test Specialists, has worked for the FAA for 16 years. Her vast FAA test experience includes: ERAM DT Lead and overall B-Level Test Lead, EBUS Operational Evaluation Test Lead, HOCSR Phase 3 DT Lead, HOCSR Phase 4 Test Director, User Request Evaluation Tool (URET) Core Capability Limited Deployment (CCLD) Test Lead, DSR Field Familiarization Test Lead. Wanda’s test experience ranges all areas of T&E, including requirement identification and analysis, test planning and coordination, test execution and reporting, and site deployment for both DT and OT on multiple automation programs. Her well-rounded knowledge and expertise in test processes and procedures has been applied in developing the software test process for the ERAM program, and developing and managing the T&E for the EBUS Operational Capability Demonstration (OCD) and the HOCSR Phase 4 program. She has provided technical guidance and recommendations to team members, management, and stakeholders to ensure quality testing of automation products. Moreover, Wanda demonstrated her knowledge in test processes by authoring the Non-Developmental Item and Commercial-Off-The-Shelf (NDI/COTS) Process Plan and the Procurement, Test and Evaluation of NDI/COTS Paper that was published and presented at the 42 nd Annual Air Traffic Control Association (ATCA) Convention .
Eric Lowy, the other TSB Automation Test Specialist, has worked for the FAA for the last 12 years, both as a contractor and as a federal employee. For the last six years, he served as a Common Automated Radar Terminal System (CARTS) OT Test Lead. In this role, he performed and managed in all areas of T&E, including overseeing and evaluating vendor DT; reviewing and approving new system requirements; writing and reviewing OT Test Plans and Test Procedures; planning, staffing, and managing the conduct of OT, including testbed preparation, data collection and analysis, and risk analysis; and writing and reviewing OT Test Reports. Eric has extensive knowledge and expertise in T&E processes, procedures, and system lifecycles from conception to development to operational fielding and finally to system maintenance and upgrades. He has provided expert testing, analysis, and technical recommendations to management based on his extensive use and knowledge of system specifications, operational requirements, NAS Interface Control Documents (ICDs)/Interface Requirements Documents (IRDs), and FAA Orders and Standards. Eric is extensively familiar with typical T&E issues and risks (e.g., time and budget constraints, contention for lab resources, personnel turnover, etc.) and has consistently demonstrated his abilities and talents in resolving and mitigating them.
Stephen Taht, the TSB Communications Test Specialist, has worked for the FAA for 15 years. He has been involved in the T&E of several NAS systems including analog and digital air-to-ground and ground-to-ground communications systems. As a senior test engineer for the NEXCOM group, Stephen’s team was responsible for the development and support of the RF performance sections of the Multi-Mode Digital Radio (MDR) specification, development of the MDR Operational Capability Test (OCT) testbed, conduct of OCT, conduct of the MDR OT, and technical support for the NEXCOM Rapid Preliminary Development Effort (RPDE) ground network. Stephen has also served as the DT and OT Test Lead for the Ultra High Frequency (UHF) radio acquisition. In these roles, he was responsible for the development of the fully automated air/ground communications testbed, conduct of DT and OT, and the development of the associated documentation, including test plans, test procedures and final reports. Stephen’s extensive experience and knowledge of communications test methodology has been applied in the development of new test methods of digital waveforms and IP-based networks. Throughout his career, Stephen has provided engineering support when required to such organizations as Radio Technical Commission for Aeronautics (RTCA), International Civil Aviation Organization (ICAO), DoD and the National Telecommunications and Information Administration (NTIA). He is well versed in T&E and the FAA Acquisition Management System (AMS) lifecycle and has demonstrated creativity in developing approaches to new efforts and meeting or exceeding project objectives.
For additional information, please contact Eric Lowy, at (609) 485-7318
|
