Dr Keith Joiner

Senior Lecturer in Test and Evaluation, Aircraft Systems
School of Engineering and Information Technology
+61 2 6268 8168

LOCATION

UNSW University College at Australian Defence Academy, Building 21, Room 363

  • ABOUT
  • PUBLICATIONS

Dr Keith Joiner, CSC, PhD, MSc, MMgmt, BEng(Aero), CPPD, CPEng, MAIPM, MIEAust

Dr Joiner joined the Air Force in 1985 and became an aeronautical engineer, project manager and teacher over a 30 year career before joining the University of New South Wales in 2015 as a senior lecturer in test and evaluation. From 2010 to 2014 he was the Director-General of Test and Evaluation for the Australian Defence Force where he was awarded a Conspicuous Service Cross. He was responsible for Defence-wide test and evaluation policy, ensuring all new capability submissions to Government had test plans, for conducting trials on all proposed new capabilities (prototypes and off-the-shelf), and operational field evaluations for new Army and joint capabilities. During his tenure in this role he testified to the Senate Inquiry into Defence Procurement (2012) and was tasked by the Service Chiefs with developing and implementing new reforms in test and evaluation. Dr Joiner has completed a number of post-graduate degrees including a Masters of Science in Aerospace Systems Engineering with distinction through Loughborough University in the United Kingdom, a PhD in Calculus Education and a Masters of Management. In previous roles he was a design engineer for aircraft and missiles, a project engineering manager, a chief engineer for several aircraft types, and a base commander for an airfield and domestic infrastructure. In 2009 he did wartime service as a plans officer in Baghdad for the Multi-National Force Iraq where he was awarded a United States Meritorious Service Medal for his work developing drawdown plans. He is a Certified Practising Engineer with the Institute of Engineers Australia and a Certified Practising Project Director with the Australian Institute of Project Management. In all his roles he has worked extensively with Defence scientists, sponsoring, conducting and trialling experiments and research including recent important human factors and anthropometric work for future submarines and combat vehicles.

Research Interests: Dr Joiner has been actively teaching and researching the use of new more efficient and effective test design and test analyses statistical methods in fields as diverse as explosive ordnance proofing, electronic warfare, target recognition and cyber-security. Methods used include design-of-experiments, high throughput testing (combinatorial), historical data analysis, logistics regression and ordinal regression to efficiently build probabilistic multi-factor regression models of systems, either very early in acquisition to de-risk project scoping and requirements, or towards the end of acquisition for operational characterisation to create flexible force modelling and live, virtual and constructive simulation of the "force-in-being". Dr Joiner is also teaching and conducted research on project governance frameworks especially within Defence contexts in the areas of: 1) integration, interoperability and information (I3) assurance; 2) digital transformation; 3) ICT projects; 4) preview test and evaluation (i.e., pre-contract de-risk trialling); and 5) cyber-resilience. His primary PhD is in teaching research and so he also conducts research into curriculum reform in higher education, especially into classroom environments, inclusive curricula methods, and the benefits of structured peer review in post-graduate teaching. 

New Students: Having only changed careers recently into academia, Dr Joiner is keen for higher degree by research students, especially, but not limited to, Defence or other complex systems fields involving prescribed acquisition, testing, evaluation, modelling and simulation, such as health, infrastructure, ICT or transportation. He is keen to work with new PhD students and their companies to do 'in-the-workplace' research on testing and governance frameworks; that is, with sponsored part-time PhD students. By the nature of such research, students would need to be domestic (i.e., Australian), or work mostly in Australia with an international firm that has an Australian footprint. Within Defence, transportation and mining, he is interested in teaching and researching test design methods for autonomous and robotic systems, while inside Government and critical Australian financial or civil infrastructure, he is interested in researching new test methods for cyber-resilience. In summary, he can take HDR students in engineering test design and analyses, project governance, or engineering/technology education across a broad range of applications.

 

Book Chapters

Joiner KF, 2019, 'Securing the Cyberspace Dimension of Large Events', in Dietz JE; Black DR (ed.), Large Event Security, Taylor & Francis, U.S.

Joiner KF; Efatmaneshnik M; Tutty M, 2019, 'Test and Evaluation Toolset', in Gorod A; Hallo L; Ireland V; Gunawan I (ed.), Evolving Toolbox for Complex Project Management, Auerbach Publications, pp. 339 - 370

Journal articles

Jnitova V; Efatmaneshnik M; Joiner K; Chang E, 2020, 'Modular Translation of Patterns to Increase Cognitive Effectiveness of Simulation Models and Problems’ ‘Modelability’', European Journal of Operational Research

Offner K; Sitnikova E; Joiner K; MacIntyre R, 2020, 'Towards understanding cybersecurity capability in Australian healthcare organisations: A systematic review of recent trends, threats and mitigation', Intelligence and National Security

Yesudas R; Bradley J; Castelle K; Joiner K; Efatmaneshnik M, 2020, 'Solving tensions and impacts of overlapping project management and systems engineering with the elegance of the complex systems governance approach', International Journal of System of Systems Engineering

Yaxley KJ; Joiner K; Abbass H; Bogais J, 2020, 'Life-learning of smart autonomous systems for meaningful human-autonomy teaming: New processes for developing trust in Airborne Shepherds', Ethics and Information Technology

Joiner K; Rees L; Levett B; Sitnikova E; Townsend D, 2020, 'Efficacy of structured peer critiquing in postgraduate coursework', Studies in Higher Education

Joiner K; Rees L; Levett B; Sitnikova E; Townsend D, 2020, 'Learning Environment of Distance and Partly-Distance Postgraduate Coursework Programs', Learning Environments Research

Atkinson SR; Skinner CJ; Joiner K; Caldwell NHM; Swidan A, 2020, 'Important Trends and Junctures in Warship Design', Marine Systems & Ocean Technology

Warren M; Joiner K, 2019, 'Improving Vibration Test Methods and Profile Selection for Complex Land Vehicle Payloads', Australian Journal of Multidisciplinary Engineering, vol. 15, pp. 75 - 83, http://dx.doi.org/10.1080/14488388.2019.1668202

Brennan G; Joiner K; Sitnikova E, 2019, 'Architectural Choices for Cyber Resilience', Australian Journal of Multidisciplinary Engineering, vol. 15, pp. 68 - 74, http://dx.doi.org/10.1080/14488388.2019.1664210

Efatmaneshnik M; Shoval S; Joiner KF, 2019, 'System Test Architecture Evaluation: A Probabilistic Modeling Approach', IEEE Systems Journal, http://dx.doi.org/10.1109/JSYST.2019.2899697

Ghildyal A; Chang E; Joiner K, 2018, 'A Survey of Benefit Approaches and a Human-Centred Innovation Loop embedded Benefit Realisation Framework', Archives of Business Research, vol. 6, http://dx.doi.org/10.14738/abr.610.5102

Joiner KF; Ghildyal A; Devine N; Laing A; Coull A; Sitnikova E, 2018, 'Four testing types core to informed ICT governance for cyber-resilient systems', International Journal of Advances in Security, vol. 11, pp. 313 - 327

Joiner KF; Atkinson SR; Christensen PH; Sitnikova E, 2018, 'Cybersecurity for Allied Future Submarines', World Journal of Engineering and Technology, vol. 6, pp. 696 - 712, http://dx.doi.org/10.4236/wjet.2018.64045

Joiner KF, 2018, 'International T&E: Looking towards the U.S. not outward from the U.S.', The ITEA (International Test and Evaluation Association) Journal, vol. 39, pp. 5 - 7

Joiner KF; Tutty MG, 2018, 'A tale of two Allied Defence Departments: New assurance initiatives for managing increasing system complexity, interconnectedness, and vulnerability', Australian Journal of Multidisciplinary Engineering, vol. 14, pp. 4 - 25, http://dx.doi.org/10.1080/14488388.2018.1426407

Joiner KF; Brewster AL, 2017, 'Cooking perfect cupcakes: Freeing curricula context gives student-centred pedagogy for course on experimental design', Creative Education, vol. 8, pp. 1833 - 1859, http://dx.doi.org/10.4236/ce.2017.812126

Joiner KF, 2017, 'How Australia can catch up to U.S. cyber resilience by understanding that cyber survivability test and evaluation drives defense investment', Information Security Journal: a Global Perspective, vol. 26, pp. 74 - 84, http://dx.doi.org/10.1080/19393555.2017.1293198

Fowler S; Sweetman C; Ravindran S; Joiner KF; Sitnikova E, 2017, 'Developing cyber-security policies that penetrate Australian defence acquisitions', The Australian Defence Force Journal, http://www.defence.gov.au/adc/adfj/Documents/issue_202/Sweetman_July_2017.pdf

Joiner KF; Atkinson SR, 2016, 'Australia's future submarine: shaping early adaptive designs through test and evaluation', Australian Journal of Multi-Disciplinary Engineering, pp. 1 - 24, http://dx.doi.org/10.1080/14488388.2016.1238025

Joiner KF; McAulliffe M; Kiemele M, 2016, 'Australia's First Official Use of Design of Experiments in T&E: User Trials to Select Rifle Enhancements', ITEA Journal, vol. 2016, pp. 141 - 152

Joiner KF, 2015, 'Implementing the Defence First Principles Review: Two key opportunities to achieve best practice in capability development', Strategic Insights, https://www.aspi.org.au/publications/implementing-the-defence-first-principles-review-two-key-opportunities-to-achieve-best-practice-in-capability-development

Joiner KF, 2015, 'How New Test and Evaluation Policy is Being Used to De-risk Project Approvals through Preview T&E', ITEA Journal, vol. 2015, pp. 288 - 296

Joiner KF; Malone JA; Haimes DH, 2002, 'ASSESSMENT OF CLASSROOM ENVIRONMENTS IN REFORMED CALCULUS EDUCATION', Learning Environments Research, pp. 51 - 76

Joiner KF, 1999, 'Australia's Air Strike Capability: A personal and critical perspective', Australian Defence Force Journal: journal of the Australian profession of arms, vol. 138, pp. 48 - 56, http://www.adfjournal.adc.edu.au/site/journal_index.asp?page=18

Aldis GK; Sidhu HS; Joiner K, 1999, 'Trial of Calculus and Maple with heterogeneous student groups at the Australian Defence Force Academy', International Journal of Computer Algebra in Mathematics Education, pp. 167 - 190

Conference Papers

Modini J; Van Zomeran M; Fowler S; Joiner K; Lynar T, 2020, 'Rising to the Challenge of Insider Threats for Middle Powers', Norfolk, Virginia, presented at 15th International Conference on Cyber Warfare and Security, Norfolk, Virginia, 12 March 2020 - 13 March 2020

Yesudas R; Efatmaneshnik M; Joiner K, 2019, 'Identifying Focal Points in IT Project Governance using a Synthetic and Systems Thinking Approach', Springer, Paris, presented at Complex Systems Design & Management (CSD&M) conference, Paris, 12 December 2019 - 13 December 2019

Atkinson SR; Fowler S; Bogais J; Joiner K, 2019, 'Ratcatchers, Regulators, and Zealots – A Hitchhiker’s Guide to Cyber T&E', IEAust, Canberra, presented at Systems Engineering, Test and Evaluation, Canberra, 29 April 2019 - 01 May 2019

Joiner K; Atkinson SR; Castelle K; Bradley J, 2019, 'Near-Term Asian War: Impacts and Options for Australia’s Submarine Program', Submarine Institute of Australia, Fremantle, Western Australia, presented at 5th Submarine Science, Technology and Engineering Conference (SubSTEC5), Fremantle, Western Australia, 18 November 2019 - 22 November 2019

Warren M; Joiner K, 2019, 'Improving Vibration Test Methods and Profile Selection for Land Vehicle Payloads', Institute Engineers Australia, Canberra, presented at Systems Engineering Test and Evaluation, Canberra, 29 April 2019 - 01 May 2019, https://search.informit.com.au/browsePublication;res=IELENG;isbn=9781925627312

Brennan G; Joiner K; Sitnikova E, 2019, 'Bespoke versus Open Architectures: Impacts on Cyber-Resilience of Mission-Critical Systems', Institute of Engineers Australia, Canberra, Australia, presented at SYSTEMS ENGINEERING TEST AND EVALUATION CONFERENCE 2019: Systems, Science and Engineering for a better Australia, Canberra, Australia, 29 April 2019 - 01 May 2019

Joiner KF; Zahra J; Rehman OU, 2018, 'Conceptual sizing of next supersonic passenger aircraft from regression of the limited existing designs', in MATEC Web of Conferences, MATEC Web of Conferences, WUHAN, CHINA, presented at 2018 ASIA CONFERENCE ON MECHANICAL ENGINEERING AND AEROSPACE ENGINEERING, WUHAN, CHINA, 23 June 2018 - 25 June 2018, http://dx.doi.org/10.1051/matecconf/201819805001

Sitnikova E; Saberi M; Townsend D; Joiner KF; Robertson E, 2018, 'Lessons learned: Understanding online engagement satisfaction in a large postgraduate Information Assurance Principles (IAP) course', in Proceedings, AAEE2018 Conferences, Hamilton, New Zealand, Australasian Association Engineering Education, Hamilton, New Zealand, presented at Australasian Association Engineering Education, Hamilton, New Zealand, 08 December 2018 - 12 December 2018

Joiner KF; Efatmaneshnik M; Tutty M, 2018, 'Modelling the Efficacy of Assurance Strategies for Better Integration, Interoperability and Information Assurance in Family-of-System-of-Systems Portfolios', in Advances in Intelligent Systems and Computing, Springer, Singapore, pp. 25 - 36, presented at Complex Systems Design & Management (CSD&M), Singapore, 06 December 2018 - 07 December 2018, http://dx.doi.org/10.1007/978-3-030-02886-2_3

Joiner KF, 2018, 'Six-sigma reform and education in Australian Defence: lessons learned give rigour and efficiency to ordnance, aircraft and ship testing', in Antony J; Laux C; Rodgers B (eds.), Seventh International Conference on Lean Six-Sigma, Heriot Watt University School of Social Sciences, Dubai, United Arab Emirates, pp. 82 - 93, presented at Seventh International Conference on Lean Six Sigma, Dubai, United Arab Emirates, 07 May 2018 - 08 May 2018

Grafton R; Brown G; Novakovic Z; Joiner KF, 2018, 'Developments in test design and analysis techniques for aircraft survivability assessments', in Systems Evaluation Test and Evaluation Conference 2018: Unlocking the Future Through Systems Engineering: SETE 2018, Engineers Australia, Sydney, Australia, presented at Systems Engineering, Test and Evaluation Conference, Sydney, Australia, 30 April 2018 - 02 May 2018, https://assets.entegy.com.au/documents/822246bd-e04d-414c-9e55-58bc3c29a8fb.pdf

Sisson G; Joiner KF, 2018, 'Applying new analysis techniques to calibrate use of a projectile locating system in ammunition testing', in Systems Evaluation Test and Evaluation Conference 2018: Unlocking the Future Through Systems Engineering: SETE 2018, Engineers Australia, Sydney, Australia, presented at Systems Engineering, Test and Evaluation Conference, Sydney, Australia, 30 April 2018 - 02 May 2018, https://assets.entegy.com.au/documents/6649703f-c5c1-4e39-9cb2-1c43d56ff2f1.pdf

Wernas M; Joiner KF, 2018, 'Screening the important factors in Supportability Test and Evaluation activities for Ships', in Systems Evaluation Test and Evaluation Conference 2018: Unlocking the Future Through Systems Engineering: SETE 2018, Engineers Australia, Sydney, Australia, presented at Systems Engineering, Test and Evaluation Conference, Sydney, Australia, 30 April 2018 - 02 May 2017, https://assets.entegy.com.au/documents/ecc65b53-c0c7-4601-9ddf-129129095ed3.pdf

Keating CB; Katina PF; Joiner KF; Bradley JM; Jaradat R, 2018, 'A Method for Identification, Representation, and Assessment of Complex System Pathologies in Acquisition Programs', in Proceedings of the fifteenth annual acquisition research symposium, Graduate School of Business & Public Policy at the Naval Postgraduate School, Monterey, California, pp. 500 - 524, presented at 15th Annual Acquisition Research Symposium, Monterey, California, 09 May 2018 - 10 May 2018, https://www.researchsymposium.com/conf/app/researchsymposium/unsecured/file/461/SYM-AM-18-104-AP_Keating.pdf

Hanly G; Joiner KF, 2018, 'Test and Evaluation of Factors affecting Facial Recognition Performance of Systems', in Systems Evaluation Test and Evaluation Conference 2018: Unlocking the Future Through Systems Engineering: SETE 2018, Institute of Engineers, Australia, Sydney, australia, pp. 147 - 156, presented at Systems Engineering, Test and Evaluation Conference, Sydney, australia, 30 April 2018 - 02 May 2018

Brooks M; Joiner KF, 2017, 'Small Arms Terminal Effects: Implementation of a DOE methodology in order to design small arms terminal effects tests', in Small Arms Terminal Effects: Implementation of a DOE methodology in order to design small arms terminal effects tests, University of NSW, Canberra, UNSW Canberra, presented at PARARI 2017 - Australian Explosive Ordnance Safety Symposium, UNSW Canberra, 21 November 2017 - 23 November 2017, https://www.unsw.adfa.edu.au/capability-systems-centre/sites/csc/files/uploads/41%20Brooks%20and%20Joiner%20-%20Small%20Arms%20Terminal%20Effects%20Implementation%20of%20DOE%20methodology%20in%20order

Henry R; Joiner KF, 2017, 'Improving Small Arms Ammunition Qualification with Statistical Test Techniques from U.S. Defense', in Improving Small Arms Ammunition Qualification with Statistical Test Techniques from U.S. Defense, UNSW Canberra, UNSW Canberra, presented at PARARI 2017 - Australian Explosive Ordnance Safety Symposium, UNSW Canberra, 21 November 2017 - 23 November 2017, https://www.unsw.adfa.edu.au/conferences/sites/conferences/files/uploads/Parari%20Paper%20-%20Henry%20and%20Joiner.pdf

Joiner KF; Atkinson SR; Sitnikova E, 2017, 'Cybersecurity Challenges and Processes for Australia's Future Submarine', in Skinner CJ; Morgan GA (ed.), 4th Submarine Science, Technology & Engineering Conference 2017, Submarine Institute of Australia, Adelaide, pp. 165 - 174, presented at 4th Submarine Science, Technology and Engineering Conference 2017 (SubSTEC4), Adelaide, 13 November 2017 - 16 November 2017, http://www.submarineinstitute.com/

Joiner KF; Atkinson SR; Skinner CJ; Caldwell NHM, 2017, 'Awaiting the next Revolution in Naval Affairs', in Awaiting the next Revolution in Naval Affairs, Pacific 2017 - International Maritime Conference, Sydney, presented at Pacific 2017 - International Maritime Conference, Sydney, 03 October 2017 - 05 October 2017

Joiner KF; Rehman O, 2017, 'Test Strategy to detect Industrial Control Systems' common Cyber Weaknesses and Vulnerabilities', in Test Strategy to detect Industrial Control Systems' common Cyber Weaknesses and Vulnerabilities, Wiley for INCOSE, Adelaide, Australia, pp. 796 - 810, presented at 27th Annual INCOSE International Symposium (IS 2017), Adelaide, Australia, 15 July 2017 - 20 July 2017, http://dx.doi.org/10.1002/j.2334-5837.2017.00394.x

Joiner KF; Efatmaneshnik M; Bradley JM; Keating CB, 2017, 'Evaluating Australia’s most complex system-of-systems, the future submarine: A case for using new Complex Systems Governance', in INCOSE International Symposium Proceedings, Wiley for INCOSE, Adelaide, Australia, July 15-20, 2017, pp. 187 - 199, presented at 27th Annual INCOSE International Symposium (IS 2017), Adelaide, Australia, July 15-20, 2017, 15 July 2017 - 17 July 2017, http://dx.doi.org/10.1002/j.2334-5837.2017.00353.x

Joiner KF, 2016, 'Integrating Cyber-Survivability into ADF Platform Development', in Austin G (ed.), Integrating Cyber-Survivability into ADF Platform Development, Australian Cybersecurity Centre, UNSW, Canberra UNSW, presented at Redefining R&D Needs for Australian Cyber Security, Canberra UNSW, 16 November 2015 - 16 November 2015, https://www.unsw.adfa.edu.au/australian-centre-for-cyber-security/news/cyber-survivability

Joiner KF; Sitnikova E; Tutty M, 2016, 'Structuring Defence Cyber-Survivability T&E to Research Best Practice in Cyber-Resilient Systems', in 2016 Systems Engineering Test and Evaluation Conference Proceedings, 2016 Systems Engineering Test and Evaluation Conference, Melbourne, presented at 2016 Systems Engineering Test and Evaluation Conference, Melbourne, 17 May 2016 - 19 May 2016