zation of these methods is the most reliable and testable means of authenticating or refuting the authorship attribution of those Majestic documents that bear the name of an author.
The focus of this study, as noted, is validation or falsification of the authorship attributions of the Majestic documents. As such, the scientific methods employed for this study cannot be used to validate the content of any of the Majestic documents whose authorship proves genuine. The computational methods of the research cannot determine the truth of written content. It can only determine whether or not that content was written by the attributed author
The remainder of this paper details the application of computational linguistic methods to determine the authenticity of authorship attributions of the Majestic documents. The paper is divided into the following sections:
•Description of the Majestic documents included and excluded in the study
•Overview of the linguistic testing methods used in the study
•Explanation and interpretation of the test results
•Overview of how these same methods have held up in courts of law
•Suggestions for future linguistic research of the Majestic documents
2. Authorship Attribution Study of the Majestic Documents
2.1. Source of the Majestic Documents for Testing
The Majestic documents tested were obtained online via www….com 2.2. Selection of the Majestic Documents for Testing
For authorship attribution testing to be undertaken, the document under question must have been attributed to some author. As such, only those documents among the Majestic documents that specifically bear the name of a signatory author were considered for testing.
Any document that appeared important for validating the extraterrestrial hypothesis (ETH) as an explanation to UFOs was included in the testing. For example, a document that mentioned the retrieval or transport of wreckage from Roswell or some other event famous for its connection to the UFO question.
2.3. Overview of the Linguistic Testing Methods Used in the Study
The material in this section draws heavily upon the peer-reviewed article by Dr. Chaski. Dr. Chaski explains that, when it comes to document attribution in the legal world, methods for determining authorship “must work in conjunction with the standard investigative and forensic techniques which are currently available.” Determining authorship of a typewritten document, whether originally or subsequently put into electronic form, can be approached three ways: “. . . biometric analysis of the computer user; qualitative analysis of ‘idiosyncrasies’ in the language in questioned and known documents; and quantitative, computational stylometric analysis of the language in questioned and known documents.”
With respect to the Majestic documents, the first method is not possible—there is no way to analyze actual keystroke pattern dynamics. This method is technically non-linguistic. The second method “assesses errors and “idiosyncrasies” based on the examiner’s experience.” This method also has the disadvantage of requiring the pre-existence of a stylistic database against which to measure presumed idiosyncrasies.
The third approach, stylometry, “is quantitative and computational, focusing on readily computable and countable language features, e.g. word length, phrase length, sentence length, vocabulary frequency, distribution of words of different lengths.” Stylometric analysis also may include analysis of function word frequency and punctuation.
As one of the leaders in the field of the development of authorship attribution techniques that meet legal standards for evidence, Dr. Chaski has developed “a computational, stylometric method which has obtained 95% accuracy and has been successfully used in investigating and adjudicating several crimes involving digital evidence.”
One final word on the testing enterprise is necessary. It is acknowledged that many of the Majestic documents were not handwritten or even typed by the author to whom they are attributed. The typical practice, especially for presidents, would be to verbally dictate the content of correspondence to a secretary who would type and reproduce the content. This reality is not at odds with Dr. Chaski’s