Dr Keith Joiner

Senior Lecturer in Test and Evaluation, Aircraft Systems
+61 2 6268 8168

LOCATION

UNSW University College at Australian Defence Academy, Building 21, Room 363

Dr Keith Joiner, CSC, PhD, MSc, MMgmt, BEng(Aero), CPPD, CPEng, MAIPM, MIEAust

Dr Joiner joined the Air Force in 1985 and became an aeronautical engineer, project manager and teacher over a 30 year career before joining the University of New South Wales in 2015 as a senior lecturer in test and evaluation. From 2010 to 2014 he was the Director-General of Test and Evaluation for the Australian Defence Force where he was awarded a Conspicuous Service Cross. He was responsible for Defence-wide test and evaluation policy, ensuring all new capability submissions to Government had test plans, for conducting trials on all proposed new capabilities (prototypes and off-the-shelf), and operational field evaluations for new Army and joint capabilities. During his tenure in this role he testified to the Senate Inquiry into Defence Procurement (2012) and was tasked by the Service Chiefs with developing and implementing new reforms in test and evaluation. Dr Joiner has completed a number of post-graduate degrees including a Masters of Science in Aerospace Systems Engineering with distinction through Loughborough University in the United Kingdom, a PhD in Calculus Education and a Masters of Management. In previous roles he was a design engineer for aircraft and missiles, a project engineering manager, a chief engineer for several aircraft types, and a base commander for an airfield and domestic infrastructure. In 2009 he did wartime service as a plans officer in Baghdad for the Multi-National Force Iraq where he was awarded a United States Meritorious Service Medal for his work developing drawdown plans. He is a Certified Practising Engineer with the Institute of Engineers Australia and a Certified Practising Project Director with the Australian Institute of Project Management. In all his roles he has worked extensively with Defence scientists, sponsoring, conducting and trialling experiments and research including recent important human factors and anthropometric work for future submarines and combat vehicles.

Research Interests: Dr Joiner has been actively teaching and researching the use of new more efficient and effective test design and test analyses statistical methods in fields as diverse as explosive ordnance proofing, electronic warfare, target recognition and cyber-security. Methods used include design-of-experiments, high throughput testing (combinatorial), historical data analysis, logistics regression and ordinal regression to efficiently build probabilistic multi-factor regression models of systems, either very early in acquisition to de-risk project scoping and requirements, or towards the end of acquisition for operational characterisation to create flexible force modelling and live, virtual and constructive simulation of the "force-in-being". Dr Joiner is also teaching and conducted research on project governance frameworks especially within Defence contexts in the areas of: 1) integration, interoperability and information (I3) assurance; 2) digital transformation; 3) ICT projects; 4) preview test and evaluation (i.e., pre-contract de-risk trialling); and 5) cyber-resilience. His primary PhD is in teaching research and so he also conducts research into curriculum reform in higher education, especially into classroom environments, inclusive curricula methods, and the benefits of structured peer review in post-graduate teaching. 

New Students: Having only changed careers recently into academia, Dr Joiner is keen for higher degree by research students, especially, but not limited to, Defence or other complex systems fields involving prescribed acquisition, testing, evaluation, modelling and simulation, such as health, infrastructure, ICT or transportation. He is keen to work with new PhD students and their companies to do 'in-the-workplace' research on testing and governance frameworks; that is, with sponsored part-time PhD students. By the nature of such research, students would need to be domestic (i.e., Australian), or work mostly in Australia with an international firm that has an Australian footprint. Within Defence, transportation and mining, he is interested in teaching and researching test design methods for autonomous and robotic systems, while inside Government and critical Australian financial or civil infrastructure, he is interested in researching new test methods for cyber-resilience. In summary, he can take HDR students in engineering test design and analyses, project governance, or engineering/technology education across a broad range of applications.

 

Book Chapters

Joiner KF; Efatmaneshnik M; Tutty M, 2019, 'Test and Evaluation Toolset', in Gorod A; Hallo L; Ireland V; Gunawan I (ed.), Evolving Toolbox for Complex Project Management, edn. First, Auerbach Publications, pp. 339 - 370

Joiner KF, 2019, 'Securing the Cyberspace Dimension of Large Events', in Dietz JE; Black DR (ed.), Large Event Security Planning and Emergency Management, Taylor & Francis, U.S.

Journal articles

Joiner K; Rees L; Levett B; Sitnikova E; Townsend D, 2020, 'Learning Environment of Distance and Partly-Distance Postgraduate Coursework Programs', Learning Environments Research

Joiner K; Rees L; Levett B; Sitnikova E; Townsend D, 2020, 'Efficacy of structured peer critiquing in postgraduate coursework', Studies in Higher Education

Yaxley KJ; Joiner K; Abbass H; Bogais J, 2020, 'Life-learning of smart autonomous systems for meaningful human-autonomy teaming: New processes for developing trust in Airborne Shepherds', Ethics and Information Technology

Yesudas R; Bradley J; Castelle K; Joiner K; Efatmaneshnik M, 2020, 'Solving tensions and impacts of overlapping project management and systems engineering with the elegance of the complex systems governance approach', International Journal of System of Systems Engineering

Jnitova V; Efatmaneshnik M; Joiner K; Chang E, 2020, 'New Translation of Patterns to Increase ‘Modelability’ and Cognitive Effectiveness of modelling and simulation', European Journal of Operational Research

Efatmaneshnik M; Shoval S; Joiner KF, 2019, 'System Test Architecture Evaluation: A Probabilistic Modeling Approach', IEEE Systems Journal, http://dx.doi.org/10.1109/JSYST.2019.2899697

Atkinson SR; Skinner CJ; Joiner K; Caldwell NHM; Swidan A, 2019, 'Important Trends and Junctures in Warship Design', Marine Systems & Ocean Technology

Brennan G; Joiner K; Sitnikova E, 2019, 'Architectural Choices for Cyber Resilience', Australian Journal of Multidisciplinary Engineering, http://dx.doi.org/10.1080/14488388.2019.1664210

Warren M; Joiner K, 2019, 'Improving Vibration Test Methods and Profile Selection for Complex Land Vehicle Payloads', Australian Journal of Multidisciplinary Engineering, http://dx.doi.org/10.1080/14488388.2019.1668202

Offner K; Sitnikova E; Joiner K; MacIntyre R, 2019, 'Towards understanding cybersecurity capability in Australian healthcare organisations: A systematic review of recent trends, threats and mitigation', Intelligence and National Security

Joiner KF; Tutty MG, 2018, 'A tale of two Allied Defence Departments: New assurance initiatives for managing increasing system complexity, interconnectedness, and vulnerability', Australian Journal of Multidisciplinary Engineering, vol. 14, pp. 4 - 25, http://dx.doi.org/10.1080/14488388.2018.1426407

Joiner KF, 2018, 'International T&E: Looking towards the U.S. not outward from the U.S.', The ITEA (International Test and Evaluation Association) Journal, vol. 39, pp. 5 - 7

Joiner KF; Atkinson SR; Christensen PH; Sitnikova E, 2018, 'Cybersecurity for Allied Future Submarines', World Journal of Engineering and Technology, vol. 6, pp. 696 - 712, http://dx.doi.org/10.4236/wjet.2018.64045

Joiner KF; Ghildyal A; Devine N; Laing A; Coull A; Sitnikova E, 2018, 'Four testing types core to informed ICT governance for cyber-resilient systems', International Journal of Advances in Security, vol. 11, pp. 313 - 327, http://www.iariajournals.org/security/sec_v11_n34_2018_paged.pdf

Ghildyal A; Chang E; Joiner K, 2018, 'A Survey of Benefit Approaches and a Human-Centred Innovation Loop embedded Benefit Realisation Framework', Archives of Business Research, vol. 6, http://dx.doi.org/10.14738/abr.610.5102

Fowler S; Sweetman C; Ravindran S; Joiner KF; Sitnikova E, 2017, 'Developing cyber-security policies that penetrate Australian defence acquisitions', The Australian Defence Force Journal, http://www.defence.gov.au/adc/adfj/Documents/issue_202/Sweetman_July_2017.pdf

Joiner KF, 2017, 'How Australia can catch up to U.S. cyber resilience by understanding that cyber survivability test and evaluation drives defense investment', Information Security Journal, vol. 26, pp. 74 - 84, http://dx.doi.org/10.1080/19393555.2017.1293198

Joiner KF; Brewster AL, 2017, 'Cooking perfect cupcakes: Freeing curricula context gives student-centred pedagogy for course on experimental design', Creative Education, vol. 8, pp. 1833 - 1859, http://dx.doi.org/10.4236/ce.2017.812126

Joiner KF; McAulliffe M; Kiemele M, 2016, 'Australia's First Official Use of Design of Experiments in T&E: User Trials to Select Rifle Enhancements', ITEA Journal, vol. 2016, pp. 141 - 152

Joiner KF; Atkinson SR, 2016, 'Australia's future submarine: shaping early adaptive designs through test and evaluation', Australian Journal of Multi-Disciplinary Engineering, pp. 1 - 24, http://dx.doi.org/10.1080/14488388.2016.1238025

Joiner KF, 2015, 'How New Test and Evaluation Policy is Being Used to De-risk Project Approvals through Preview T&E', ITEA Journal, vol. 2015, pp. 288 - 296

Joiner KF, 2015, 'Implementing the Defence First Principles Review: Two key opportunities to achieve best practice in capability development', Strategic Insights, http://dx.doi.org/https://www.aspi.org.au/publications/implementing-the-defence-first-principles-review-two-key-opportunities-to-achieve-best-practice-in-capability-development

Joiner KF; Malone JA; Haimes DH, 2002, 'ASSESSMENT OF CLASSROOM ENVIRONMENTS IN REFORMED CALCULUS EDUCATION', Learning Environments Research, pp. 51 - 76

Aldis GK; Sidhu HS; Joiner K, 1999, 'Trial of Calculus and Maple with heterogeneous student groups at the Australian Defence Force Academy', International Journal of Computer Algebra in Mathematics Education, pp. 167 - 190

Joiner KF, 1999, 'Australia's Air Strike Capability: A personal and critical perspective', Australian Defence Force Journal: journal of the Australian profession of arms, vol. 138, pp. 48 - 56, http://www.adfjournal.adc.edu.au/site/journal_index.asp?page=18

Conference Papers

Brennan G; Joiner K; Sitnikova E, 2019, 'Bespoke versus Open Architectures: Impacts on Cyber-Resilience of Mission-Critical Systems', in , Institute of Engineers Australia, Canberra, Australia, presented at SYSTEMS ENGINEERING TEST AND EVALUATION CONFERENCE 2019: Systems, Science and Engineering for a better Australia, Canberra, Australia, 29 April - 01 May 2019, http://dx.doi.org/https://search.informit.com.au/browsePublication;res=IELENG;isbn=9781925627312

Joiner K; Efatmaneshnik M; Tutty M, 2019, 'Modelling the efficacy of assurance strategies for better integration, interoperability and information assurance in family-of-system-of-systems portfolios', in Advances in Intelligent Systems and Computing, pp. 25 - 36, presented at , http://dx.doi.org/10.1007/978-3-030-02886-2_3

Warren M; Joiner K, 2019, 'Improving Vibration Test Methods and Profile Selection for Land Vehicle Payloads', in , Institute Engineers Australia, Canberra, presented at Systems Engineering Test and Evaluation, Canberra, 29 April - 01 May 2019, http://dx.doi.org/https://search.informit.com.au/browsePublication;res=IELENG;isbn=9781925627312

Joiner K; Atkinson SR; Castelle K; Bradley J, 2019, 'Near-Term Asian War: Impacts and Options for Australia’s Submarine Program', in , Submarine Institute of Australia, Fremantle, Western Australia, presented at 5th Submarine Science, Technology and Engineering Conference (SubSTEC5), Fremantle, Western Australia, 18 - 22 November 2019

Atkinson SR; Fowler S; Bogais J; Joiner K, 2019, 'Ratcatchers, Regulators, and Zealots – A Hitchhiker’s Guide to Cyber T&E', in , IEAust, Canberra, presented at Systems Engineering, Test and Evaluation, Canberra, 29 April - 01 May 2019, http://dx.doi.org/https://search.informit.com.au/browsePublication;res=IELENG;isbn=9781925627312

Yesudas R; Efatmaneshnik M; Joiner K, 2019, 'Identifying Focal Points in IT Project Governance using a Synthetic and Systems Thinking Approach', in , Springer, Paris, presented at Complex Systems Design & Management (CSD&M) conference, Paris, 12 - 13 December 2019, http://dx.doi.org/https://www.2019.csdm.fr/

Hanly G; Joiner KF, 2018, 'Test and Evaluation of Factors affecting Facial Recognition Performance of Systems', in Systems Evaluation Test and Evaluation Conference 2018: Unlocking the Future Through Systems Engineering: SETE 2018, Institute of Engineers, Australia, Sydney, australia, pp. 147 - 156, presented at Systems Engineering, Test and Evaluation Conference, Sydney, australia, 30 April - 02 May 2018, http://dx.doi.org/https://search.informit.com.au/documentSummary;dn=631128760493213;res=IELENG

Keating CB; Katina PF; Joiner KF; Bradley JM; Jaradat R, 2018, 'A Method for Identification, Representation, and Assessment of Complex System Pathologies in Acquisition Programs', in Proceedings of the fifteenth annual acquisition research symposium, Graduate School of Business & Public Policy at the Naval Postgraduate School, Monterey, California, pp. 500 - 524, presented at 15th Annual Acquisition Research Symposium, Monterey, California, 09 - 10 May 2018, http://dx.doi.org/https://www.researchsymposium.com/conf/app/researchsymposium/unsecured/file/461/SYM-AM-18-104-AP_Keating.pdf

Wernas M; Joiner KF, 2018, 'Screening the important factors in Supportability Test and Evaluation activities for Ships', in Systems Evaluation Test and Evaluation Conference 2018: Unlocking the Future Through Systems Engineering: SETE 2018, Engineers Australia, Sydney, Australia, presented at Systems Engineering, Test and Evaluation Conference, Sydney, Australia, 30 April - 02 May 2018, http://dx.doi.org/https://assets.entegy.com.au/documents/ecc65b53-c0c7-4601-9ddf-129129095ed3.pdf

Sisson G; Joiner KF, 2018, 'Applying new analysis techniques to calibrate use of a projectile locating system in ammunition testing', in Systems Evaluation Test and Evaluation Conference 2018: Unlocking the Future Through Systems Engineering: SETE 2018, Engineers Australia, Sydney, Australia, presented at Systems Engineering, Test and Evaluation Conference, Sydney, Australia, 30 April - 02 May 2018, http://dx.doi.org/https://assets.entegy.com.au/documents/6649703f-c5c1-4e39-9cb2-1c43d56ff2f1.pdf

Grafton R; Brown G; Novakovic Z; Joiner KF, 2018, 'Developments in test design and analysis techniques for aircraft survivability assessments', in Systems Evaluation Test and Evaluation Conference 2018: Unlocking the Future Through Systems Engineering: SETE 2018, Engineers Australia, Sydney, Australia, presented at Systems Engineering, Test and Evaluation Conference, Sydney, Australia, 30 April - 02 May 2018, http://dx.doi.org/https://assets.entegy.com.au/documents/822246bd-e04d-414c-9e55-58bc3c29a8fb.pdf

Joiner KF, (eds.), 2018, 'Six-sigma reform and education in Australian Defence: lessons learned give rigour and efficiency to ordnance, aircraft and ship testing', in Seventh International Conference on Lean Six-Sigma, Heriot Watt University School of Social Sciences, Dubai, United Arab Emirates, pp. 82 - 93, presented at Seventh International Conference on Lean Six Sigma, Dubai, United Arab Emirates, 07 - 08 May 2018

Sitnikova E; Saberi M; Townsend D; Joiner KF; Robertson E, 2018, 'Lessons learned: Understanding online engagement satisfaction in a large postgraduate Information Assurance Principles (IAP) course', in Proceedings, AAEE2018 Conferences, Hamilton, New Zealand, Australasian Association Engineering Education, Hamilton, New Zealand, presented at Australasian Association Engineering Education, Hamilton, New Zealand, 08 - 12 December 2018, http://dx.doi.org/https://s3-us-west-2.amazonaws.com/18aaee/proceedings/AAEE18_Sitnikova_68.pdf

Joiner KF; Zahra J; Rehman O, 2018, 'Conceptual sizing of next supersonic passenger aircraft from regression of the limited existing designs', in MATEC Web of Conferences, presented at , http://dx.doi.org/10.1051/matecconf/201819805001

Joiner KF; Efatmaneshnik M; Bradley JM; Keating CB, 2017, 'Evaluating Australia’s most complex system-of-systems, the future submarine: A case for using new Complex Systems Governance', in INCOSE International Symposium Proceedings, Wiley for INCOSE, Adelaide, Australia, July 15-20, 2017, pp. 187 - 199, presented at 27th Annual INCOSE International Symposium (IS 2017), Adelaide, Australia, July 15-20, 2017, 15 - 17 July 2017, http://dx.doi.org/10.1002/j.2334-5837.2017.00353.x

Joiner KF; Rehman O, 2017, 'Test Strategy to detect Industrial Control Systems' common Cyber Weaknesses and Vulnerabilities', in , Wiley for INCOSE, Adelaide, Australia, pp. 796 - 810, presented at 27th Annual INCOSE International Symposium (IS 2017), Adelaide, Australia, 15 - 20 July 2017, http://dx.doi.org/10.1002/j.2334-5837.2017.00394.x

Joiner KF; Atkinson SR; Sitnikova E, (eds.), 2017, 'Cybersecurity Challenges and Processes for Australia's Future Submarine', in 4th Submarine Science, Technology & Engineering Conference 2017, Submarine Institute of Australia, Adelaide, pp. 165 - 174, presented at 4th Submarine Science, Technology and Engineering Conference 2017 (SubSTEC4), Adelaide, 13 - 16 November 2017, http://www.submarineinstitute.com/

Henry R; Joiner KF, 2017, 'Improving Small Arms Ammunition Qualification with Statistical Test Techniques from U.S. Defense', in , UNSW Canberra, UNSW Canberra, presented at PARARI 2017 - Australian Explosive Ordnance Safety Symposium, UNSW Canberra, 21 - 23 November 2017, http://dx.doi.org/https://www.unsw.adfa.edu.au/conferences/sites/conferences/files/uploads/Parari%20Paper%20-%20Henry%20and%20Joiner.pdf

Brooks M; Joiner KF, 2017, 'Small Arms Terminal Effects: Implementation of a DOE methodology in order to design small arms terminal effects tests', in , University of NSW, Canberra, UNSW Canberra, presented at PARARI 2017 - Australian Explosive Ordnance Safety Symposium, UNSW Canberra, 21 - 23 November 2017, http://dx.doi.org/https://www.unsw.adfa.edu.au/capability-systems-centre/sites/csc/files/uploads/41%20Brooks%20and%20Joiner%20-%20Small%20Arms%20Terminal%20Effects%20Implementation%20of%20DOE%20methodology%20in%20order%20to%20design%20small%20arms%20terminal%20effects%20tests.pdf

Atkinson SR; Skinner CJ; Joiner KF; Caldwell NHM, 2017, 'Awaiting the next revolution in naval affairs', in RINA, Royal Institution of Naval Architects - PACIFIC 2017 International Maritime Conference, presented at

Joiner KF; Sitnikova E; Tutty M, 2016, 'Structuring Defence Cyber-Survivability T&E to Research Best Practice in Cyber-Resilient Systems', in 2016 Systems Engineering Test and Evaluation Conference Proceedings, 2016 Systems Engineering Test and Evaluation Conference, Melbourne, presented at 2016 Systems Engineering Test and Evaluation Conference, Melbourne, 17 - 19 May 2016

Joiner KF, (ed.), 2016, 'Integrating Cyber-Survivability into ADF Platform Development', in , Australian Cybersecurity Centre, UNSW, Canberra UNSW, presented at Redefining R&D Needs for Australian Cyber Security, Canberra UNSW, 16 - 16 November 2015, http://dx.doi.org/https://www.unsw.adfa.edu.au/australian-centre-for-cyber-security/news/cyber-survivability

Joiner KF; Hockley D, 2013, 'New Defence T&E Policy: Compliance Options', in SETE 2013 Conference Proceedings, Systems Engineering Society of Australia, Canberra, Australia, presented at Annual Systems Engineering, Test and Evaluation Conference, Canberra, Australia, 30 April - 01 May 2013

Aldis GK; Sidhu HS; Joiner K, 1998, 'Calculus & Maple teaching trial', in 3rd Biennial Engineering Mathematics and Applications Conference: EMAC 1998, 3rd Biennial Engineering Mathematics and Applications Conference: EMAC`98, Adelaide, Sth Aust, presented at 3rd Biennial Engineering Mathematics and Applications Conference: EMAC`98, Adelaide, Sth Aust, 13 - 16 July 1998

Joiner K; Aldis GK; Sidhu HS, 1998, 'Calculus & Maple Teaching Trial', in 3rd Biennial Engineering Mathematics and Applications Conference: EMAC 1998, 3rd Biennial Engineering Mathematics and Applications Conference: EMAC`98, Adelaide, Sth Aust, presented at 3rd Biennial Engineering Mathematics and Applications Conference: EMAC`98, Adelaide, Sth Aust, 13 - 16 July 1998

Conference Proceedings (Editor of)

Joiner KF, (ed.), 2017, 'Project Governance and Controls Symposium 2017: Academic Papers and Presentations', in , Project Governance and Controls Symposium 2017, University of NSW, Canberra, presented at Project Governance and Controls Symposium 2017, University of NSW, Canberra, 02 - 04 May 2017

Reports

Joiner KF, 2018, Study into Integration and C4ISR Design Assurance Activities, Department of Defence

Joiner KF, 2016, AUSTRALIA’S TEST AND EVALUATION STRATEGY FOR THE F-35 JOINT STRIKE FIGHTER, Australian Parliamentary House, Canberra, 5, http://www.aph.gov.au/Parliamentary_Business/Committees/Senate/Foreign_Affairs_Defence_and_Trade/Joint_fighter/Submissions

Joiner KF; Ryan MJ, 2016, STUDY INTO LAND TEST AND EVALUATION FOR THE AUSTRALIAN ARMY, Australian Army

Other

Joiner KF, Testimony as expert witness on test and evaluation to the Australian Senate Inquiry into F35 Aircraft Acquisition

Conference Presentations

Joiner K; Yesudas R, 2019, 'Solving tensions of overlapping project management and systems engineering with the elegance of the complex systems governance approach', in , Project Governance and Controls Symposium, Canberra, presented at Project Governance and Controls Symposium, Canberra, 20 - 21 August 2019, http://dx.doi.org/https://www.pgcs.org.au/library/2019/

Joiner K, 2019, 'Understanding Developing South-East Asian Tensions and Options for Australia's Submarine Program', in , Projectchat 2019: Project Management beyond 2020 – Tactical or Strategic?, presented at Projectchat 2019: Project Management beyond 2020 – Tactical or Strategic?, 16 - 18 September 2019, http://dx.doi.org/https://www.projectchat.com.au/

Joiner KF; Efatmaneshnik M; Tutty M, 2018, 'Keynote Presentation: Comparing Australian and U.S. DoD strategies for testing integration, interoperability and information (I3) assurance', in , International Test and Evaluation Association, Oxnard, California, presented at 35th International Test and Evaluation Symposium: Global T&E Environment in 2025 and Beyond, Oxnard, California, 11 - 14 December 2018, http://dx.doi.org/https://www.itea.org/event/35th-international-test-and-evaluation-symposium/

Joiner KF; Tutty MG, 2018, 'Unlocking the future: decision-making in complex systems', in , Systems Engineering, Test and Evaluation Conference, Sydney, Australia, presented at Systems Engineering, Test and Evaluation Conference, Sydney, Australia, 30 April - 02 May 2018

Joiner KF, 2018, 'Chair of Special Track: Critical Test Capabilities for Informed ICT Governance of Cyber-Resilient Systems', in , The Third International Conference on Cyber-Technologies and Cyber-Systems CYBER 2018, Athens, Greece, presented at The Third International Conference on Cyber-Technologies and Cyber-Systems CYBER 2018, Athens, Greece, 18 - 22 November 2018, http://dx.doi.org/https://www.iaria.org/conferences2018/CYBER18.html

Joiner KF, 2018, 'Case Studies in new Project Governance Quantitative Techniques', in , Project Governance and Controls Symposium, Canberra, Australia, presented at Project Governance and Controls Symposium, Canberra, Australia, 14 - 16 August 2018, http://dx.doi.org/https://www.pgcsymposium.org.au/program.html

Joiner K, 2018, 'Panel 4: T&E of Emerging Threats in Complex Environments. 13 December 2018. "Submarine Design Test & Evaluation: Challenging Cyber-Provenance & Cyber Sidecars"', in , 35th ITEA Annual Test and Evaluation Symposium Global T&E Environment in 2025 and Beyond, Oxnard, California, presented at 35th ITEA Annual Test and Evaluation Symposium Global T&E Environment in 2025 and Beyond, Oxnard, California, 10 - 13 December 2018

Joiner KF, 2017, 'The Art of Planning Preview T&E: Australian Techniques for Early Test Strategies for Technical Maturation and Risk Reduction', in , 34th International T&E Symposium: T&E in a Time of Risk and Change, Reston, Virginia, United States, presented at 34th International T&E Symposium: T&E in a Time of Risk and Change, Reston, Virginia, United States, 02 - 05 October 2017

Joiner KF, 2017, 'Difficulties in Educating Australian Project Management Teams in techniques for Evaluating Project Realisation', in , Project CHAT 2017: The PMO in 2020, Sydney, Australia, presented at Project CHAT 2017: The PMO in 2020, Sydney, Australia, 16 - 18 May 2017

Joiner KF; Atkinson SR, 2016, 'Shaping early adaptive submarine designs through test & evaluation', in , Submarine Institute of Australia Annual Conference, Shine Dome, Canberra Australia, presented at Submarine Institute of Australia Annual Conference, Shine Dome, Canberra Australia, 14 - 16 November 2016

Rehman OU; Joiner KF, 2016, 'Non-traditional threat testing of Industrial Control Systems using Design of Experiments techniques', in , Counter Non-Traditional Threats, UNSW Canberra, presented at Counter Non-Traditional Threats, UNSW Canberra, 10 - 11 November 2016

Joiner KF, 2015, 'How New Test and Evaluation Policy is being used to De-risk Project Approvals through Preview T&E', in , 32nd Annual Conference of the International Test and Evaluation Association, Crystal City, Washington, United States, presented at 32nd Annual Conference of the International Test and Evaluation Association, Crystal City, Washington, United States, 19 - 21 August 2015, http://itea.org/share/workshops/35-share/conferences/355-32nd-annual-international-test-and-evaluation-symposium-proceedings-2015.html

Joiner KF, 2015, 'Australia's First Official use of U.S. Design of Experiments (DOE): User Trials to Determine Best Enhanced Steyr Rifle Configuration', in , 32nd Annual Conference of the International Test and Evaluation Conference, Crystal City, Washington, United States, presented at 32nd Annual Conference of the International Test and Evaluation Conference, Crystal City, Washington, United States, 19 - 21 August 2015, http://itea.org/share/workshops/35-share/conferences/355-32nd-annual-international-test-and-evaluation-symposium-proceedings-2015.html

Joiner KF, 2015, 'International Panel: Australian T&E Collaboration Areas', in , 32nd Annual Conference of the International Test and Evaluation Association, Crystal City, Washington, United States, presented at 32nd Annual Conference of the International Test and Evaluation Association, Crystal City, Washington, United States, 19 - 21 August 2015, http://itea.org/share/workshops/35-share/conferences/355-32nd-annual-international-test-and-evaluation-symposium-proceedings-2015.html

Joiner KF, 2015, 'Best Practices in Capability Delivery - Test and Evaluation', in , Project Governance and Controls Symposium, Canberra, UNSW, presented at Project Governance and Controls Symposium, Canberra, UNSW, 06 - 07 May 2015, http://www.pgcs.org.au/library/2015-archive/

Joiner KF, 2015, 'Defence Capability Realisation: How New Preview T&E is De-risking New Project Approvals', in , 2015 Annual Systems Engineering, Test and Evaluation Conference, Canberra, Australia, presented at 2015 Annual Systems Engineering, Test and Evaluation Conference, Canberra, Australia, 28 - 29 April 2015

Joiner KF, 2015, 'Australia's First Official use of U.S. STAT: User Trials to Determine Best Enhanced Steyr Rifle Configuration', in , Annual Systems Engineering, Test and Evaluation Conference, Canberra, Australia, presented at Annual Systems Engineering, Test and Evaluation Conference, Canberra, Australia, 28 - 29 April 2015

Joiner KF, 2015, 'Incorporating Cyber Survivability into Future ADF Platform Design and Acceptance', in , International Conference on Redefining R&D Needs for Australian Cyber Security, Canberra, UNSW, presented at International Conference on Redefining R&D Needs for Australian Cyber Security, Canberra, UNSW, 16 - 16 November 2015, http://dx.doi.org/https://www.unsw.adfa.edu.au/australian-centre-for-cyber-security/cyber-r-d

Working Papers

joiner KF, 2017, Academy learning experience differences for students of each Service: potential concerns for minority females and mature-age students, UNSW Canberra, UNSW Canberra

Conference Abstracts

Yaxley K; Joiner K, Life-long protocol influence and shaping of smart autonomous systems to assure meaningful human-autonomy teaming: A New Australian Research Program