William James

← Encyclopedia

William James (11 January 1842 – 26 August 1910) was an American philosopher and psychologist, the founder of American scientific psychology, the leading theorist of pragmatism, and the most distinguished academic investigator ever to take spiritualism and psychical research seriously on their own grounds. Two achievements define his standing here: The Varieties of Religious Experience (1902), which established the first rigorous framework for studying mystical states as empirical data, and twenty-five years of sustained engagement with the Society for Psychical Research, the medium Leonora Piper, and the question of whether anything in a human being survives death.

The household and the formation

James was born in New York City into one of the more unusual households in American intellectual history. His father, Henry James Sr. (1811–1882), was a Swedenborgian theologian who had experienced a religious vastation in Windsor, England, in 1844 and who never thereafter traveled without Emanuel Swedenborg’s works in his bag. Henry Sr.’s theology, centered on transcending selfhood as spiritual evil and on brotherly love as the principle of heaven, filled the household with religious seriousness without producing doctrinal conformity. Henry Jr. became the celebrated novelist; Alice kept the diary that gained posthumous recognition. William would write to his father on his deathbed: “All my intellectual life I derive from you.”

The early education was peripatetic — Geneva, Paris, Boulogne, then Newport, Rhode Island. In Newport he studied painting under William Morris Hunt seriously enough that he later judged his own gift insufficient and gave it up. He entered the Lawrence Scientific School at Harvard in 1861, drifted toward chemistry, joined Louis Agassiz on a collecting expedition to the Amazon in 1865, and took his Harvard MD in 1869 — a degree he never used in practice but that supplied the empirical cast of mind he carried into everything else.

The crisis of 1869–70

The years immediately following his degree were among the worst of his life: severe depression, back pain, months unable to work, and a dread of existence he later recalled as bordering on the clinical. The turning point arrived in April 1870 through his reading of the French philosopher Charles Renouvier, whose defense of free will struck James as an opening. His journal entry of that April reads: “I think that yesterday was a crisis in my life… My first act of free will shall be to believe in free will.” It was not a sudden cure but a reorientation — and it anchored the argument he would later make in The Will to Believe: that in certain forced and momentous questions, the refusal to commit is itself a commitment, and the right to believe ahead of the evidence is not credulity but a condition of engagement.

Harvard: three careers in one chair

James began teaching comparative physiology at Harvard in 1872, established the first American psychology laboratory in 1874–75, was appointed Assistant Professor of Philosophy in 1880, and retired as a full professor in 1907 — three decades during which his primary affiliation shifted from physiology through psychology to philosophy, tracking his sense that the questions he cared about could not be contained within any single field.

The Principles of Psychology (1890), twelve years in the writing, reshaped what psychology could be. The stream of consciousness — James preferred “stream of thought” — was his most enduring contribution: the psyche was not a sequence of discrete ideas linked by association but a continuous, flowing process with fringes and overtones. The chapters on habit traced its neural substrate and its ethical dimension simultaneously; the account of the self distinguished the I (knower) from the Me (known) and took seriously the social and spiritual dimensions of self-feeling. The Principles served as the intellectual frame for James’s subsequent work on hypnosis, the subliminal, and religious experience.

The psychical-research decades

James had become interested in mesmerism and mental healing in the late 1870s, and he was an early participant in the American Society for Psychical Research, attending its founding meeting in Boston on 23 September 1884. The ASPR was the American counterpart of the Society for Psychical Research founded in London in 1882 by Henry Sidgwick, F. W. H. Myers, and others.

The encounter that defined this career began in 1885, when members of James’s family sat with a Boston medium named Leonora Piper. James followed, arranged his own sittings, commissioned stenographic records, and interviewed the sitters. What Piper produced — knowledge he concluded she could not have acquired by ordinary means — held his attention for the next twenty-five years. The formulation he arrived at became one of the most quoted sentences in the history of the field: “If you wish to upset the law that all crows are black, you must not seek to show that no crows are; it is enough if you prove one single crow to be white. My own white crow is Mrs. Piper.” The logical point was precise: a single verified exception defeats a universal law, and the project of refutation cannot be completed in advance.

James served as SPR president in 1894–95, his presidential address published in Science in 1896. The Sidgwicks and Myers valued him as the most credentialed American ally their cause possessed. When Eusapia Palladino came before the SPR investigators, James followed the evidence of her documented cheating without extending it into a general foreclosure.

After the death of Richard Hodgson in December 1905, Piper began producing communications purportedly from Hodgson — a personality that held through some seventy further sittings. James published a 120-page analysis of sixty-nine of these in the Proceedings of the Society for Psychical Research in 1909. The Hodgson control failed important tests — it could not reveal Hodgson’s sealed test letter or supply reliable details of his early Australian life — yet the phenomena resisted reduction to simple fraud. James theorized that “a will of some kind” might be directing the communications, potentially accessing the sitter’s memories or “some cosmic reservoir” of information, a formulation that kept the door open without opening it very far.

“Confidences of a Psychical Researcher,” published in the American Magazine in 1909, was his final public statement on the field. After a quarter-century of investigation he remained “theoretically no further” than at the start. The phenomena he had witnessed — primarily what he took to be Piper’s supernormal cognition, and what he counted as evidence for telepathy — had not been explained, but they had not been explained away either. His final theoretical position inclined toward a “panpsychic” view of interconnected minds, and to the thesis that “a fixed belief that certain kinds of phenomenon are impossible” was for science a source of error as dangerous as fraud. James was, as he had been in 1870, committed to the question’s importance rather than its answer.

The Varieties of Religious Experience

The Gifford Lectures at Edinburgh in 1901–02 produced The Varieties of Religious Experience (1902). Where James’s psychical-research writings moved within the evidentiary framework of the SPR, the Varieties took the widest possible sample of reported religious experience and asked what it was as human data, bracketing both orthodox theology and scientific dismissal. That methodological move — treating the experience as primary fact, not the institution around it — gave the book its lasting influence on religious studies and comparative mysticism.

The architecturally central distinction in the Varieties is between the healthy-minded and the sick soul. The healthy-minded temperament — Whitman, the Transcendentalists, New Thought’s buoyant affirmations — simply does not register evil as a structural feature of experience. The sick soul knows that evil is not a surface impurity but a depth condition, and cannot be argued out of it. James, drawing on his own years of depression, judged the sick-soul position philosophically superior: not more pleasant, but more comprehensive. The twice-born are those who pass through the sick soul’s despair and arrive at a second integration. The typology was James’s argument that religious experience could not be reduced to a single cognitive or emotional form.

The chapter on mysticism remains the most consulted. James proposed four marks that could identify a mystical experience across traditions: ineffability (the experience resists description and must be had, not merely understood at a distance); the noetic quality (it presents itself as a form of knowledge, not mere feeling, revealing truths that the ordinary discursive mind cannot reach); transiency (it does not last); and passivity (the subject cannot command or prolong it). These four marks served as the first rigorous typological account of mystical experience as a natural-kind category, and they structured comparative- mysticism scholarship for decades. James’s own position was carefully hedged: he thought mystical states were “genuine perceptions” of some reality, but he did not claim to have demonstrated what that reality was; they might constitute “windows through which the mind looks out upon a more extensive and inclusive world.”

James’s theologically substantive move was his account of the subconscious as the conduit through which something larger might reach the individual self. Drawing directly on F. W. H. Myers’s concept of the subliminal self — which James described as potentially “psychology’s greatest problem” — he proposed that the subconscious served as the doorway through which what he called “the More” entered human experience. “The More” was the higher reality religious experience points toward; the subliminal was the natural mechanism, requiring no supernatural bypass. His personal overbelief — the interpretive hypothesis one adds to the bare experiential datum — was that the experience genuinely connected the person to a transcendent reality, not merely a projection of the individual mind.

The nitrous oxide experiments of 1882 bore on the same question. What James described as “a tremendously exciting sense of an intense metaphysical illumination” seemed to confirm the mystical claim that ordinary consciousness was enclosed. He wrote about these states in a philosophical register — as data bearing on the Hegelian idea that contradictions resolve at a higher level —

The Will to Believe, pragmatism, and radical empiricism

The Will to Believe (1897) gathered James’s defenses of the right to hold religious and moral commitments that evidence alone could not compel. The central argument turned on the “genuine option” — a choice simultaneously live, forced, and momentous. Where those conditions obtained, James argued that “our passional nature not only lawfully may, but must, decide” — that the evidentiary standard appropriate to scientific questions did not govern questions of ultimate orientation, and that refusing to commit was itself a commitment with consequences. The argument was continuous with the Renouvier resolution of 1870.

Pragmatism, systematized in Pragmatism (1907), extended the same logic to theory of truth. Truth was not a static correspondence between propositions and facts but a process of verification in experience; ideas were true insofar as they “worked,” which James was careful to mean in a cognitive and evidential sense, not merely a practically convenient one.

Radical empiricism, developed in Essays in Radical Empiricism (1912, posthumous), argued that relations between things are themselves directly experienced, not merely inferred. Out of this he developed a “pure experience” ontology: the fundamental stuff of the world was neither purely mental nor physical but “pure experience,” which could function as either. The relevance to his broader project was direct: if mind is not encapsulated in individual skulls, the transmission hypothesis — that the brain filters rather than produces consciousness — could not be ruled out on metaphysical grounds. James held radical empiricism and psychical research to be of a piece.

Death and the question

James died at Chocorua, New Hampshire, on 26 August 1910, of heart failure, aged sixty-eight. His last years produced A Pluralistic Universe (1909), a championship of radical pluralism against absolute idealism — his conviction that the universe was genuinely open, still in the making.

The personal wager he had maintained for forty years was unresolved at his death — as he would have been the first to say it must be. He had not found a white crow beyond Piper, and Piper admitted of more than one explanation. His refusal to let either premature religious settlement or premature scientific closure foreclose the investigation was itself a considered philosophical position, and it was the one he held.

Sources and scholarship

Robert D. Richardson’s William James: In the Maelstrom of American Modernism (Houghton Mifflin, 2006) is the standard modern biography, drawing on James’s correspondence and notebooks. Ralph Barton Perry’s The Thought and Character of William James (Little, Brown, 1935) remains indispensable as a primary-source compilation — the April 1870 diary entry and psychical-research correspondence are both drawn from it. Deborah Blum’s Ghost Hunters (Penguin, 2006) reconstructs the SPR circle’s investigations in narrative form, centering James and the Piper sittings. Ann Taves’s Fits, Trances, and Visions (Princeton, 1999) situates the Varieties within the longer Protestant tradition of religious experience, and is the essential academic context for understanding what James transformed. The SPR Psi Encyclopedia carries a detailed survey at https://psi-encyclopedia.spr.ac.uk/articles/william-james, covering the ASPR founding, Piper, the Hodgson-control analysis, and the presidential address. The Stanford Encyclopedia of Philosophy provides the fullest philosophical overview at https://plato.stanford.edu/entries/james/. The Wikipedia article at https://en.wikipedia.org/wiki/William_James is a useful reference point for biographical chronology and includes the April 1870 diary entry verbatim. The Wikipedia article on Leonora Piper at https://en.wikipedia.org/wiki/Leonora_Piper covers the Hodgson-control failures in useful detail. The Varieties itself is available in full on Project Gutenberg at https://www.gutenberg.org/ebooks/621.

→ Related: F W H Myers · Henry Sidgwick · Eleanor Sidgwick · William Crookes · Eusapia Palladino · Victorian Psychical Research Spr · Spiritualism · Hypnosis · Free Will · Mesmerism Animal Magnetism · Immortality · Soul · Transpersonal Psychology · Telepathy · Comparative Mysticism · Emmanuel Swedenborg · Empiricism