There is renewed interest in psychedelics, such as psilocybin, as therapies for multiple difficult-to-treat psychiatric disorders. Even though psychedelics can induce highly pleasant or aversive experiences, depending on multiple personal and environmental factors, there is little research into how such experiences impact post-acute mood-altering actions. Here we aimed at offsetting this gap. First, we tested whether acute psilocybin effects differed between sexes. Adult male and female C57BL/6J mice received saline or psilocybin (5 mg/kg; i.p.), and head-twitch response (HTR) frequency was quantified. Notably, while psilocybin increased HTR frequency in both sexes, the effect was greater in females. We then tested if stress exposure during acute drug effects impacted post-acute psilocybin actions. Following drug treatment, mice were returned to their homecage or restrained for 1 h. Anxiety- and depression-like behaviors were assessed starting 24 h following drug administration, using the marble burying, novelty-suppressed feeding, and splash tests. Psilocybin induced anxiolytic-, but not antidepressant-like, which were fully blocked by stress in males, but only partially so in females. Lastly, we assessed the acute stress-psilocybin interaction on plasma corticosterone levels in a separate cohort of mice, treated as above. Both stress and psilocybin independently increased corticosterone levels, without additive or interactive effects being observed for either sex. Our data reveals the role of sex and peri-acute negative experiences in the acute and post-acute actions of psilocybin. These findings underline the importance of non-pharmacological factors, such as the quality of the psychedelic experience, in the mood-altering effects of psychedelics, holding significant for both their therapeutic and recreational use.