Author deTraci Regula relates her experiences with the house: "Over the years, while dining across the street at the Old Town Mexican Cafe, I became accustomed to noticing that the shutters of the second-story windows [of the Whaley House] would sometimes open while we ate dinner, long after the house was closed for the day. On a recent visit, I could feel the energy in several spots in the house, particularly in the courtroom, where I also smelled the faint scent of a cigar, supposedly Whaley's calling-card. In the hallway, I smelled perfume, initially attributing that to the young woman acting as docent, but some later surreptitious sniffing in her direction as I talked to her about the house revealed her to be scent-free."
Some of the other ghostly encounters include:
- The spirit of a young girl who was accidentally hanged on the property.
- The ghost of Yankee Jim Robinson, a thief who was clubbed to death and who can be heard on the house's stairway where he died, and has sometimes been seen during tours of the old house.
- The red-haired daughter of the Whaley's sometimes appears in such a realistic form; she is sometimes mistaken for a live child.
Famed psychic Sybil Leek claimed to have sensed several spirits there, and renowned ghost hunter Hanz Holzer considered the Whaley to be one of the most reliably haunted structures in the United States.