Another quote from Russo’s book:
Starting in early 1963, Williams, Barker, and Hunt would hold dozens of meetings in Washington and New York. Attempting to unite the various exile factions at Hunt’s direction, Harry Williams told Miami Cubans of an impending invasion, with initial infiltrations set to commence in December, 1963. Williams’ recruitment efforts were reported in the Associated Press: A new all-out drive to unify Cuban refugees into a single, powerful organization to topple the Fidel Castro regime was disclosed today by exile sources. The plan calls for formation of a junta in exile to mount a three-pronged thrust consisting of sabotage, infiltration and ultimate invasion. . . Seeking to put together the junta was Enrique [Harry] Ruiz-Williams, a Bay of Pigs invasion veteran, and friend of US. Attorney General Robert F. Kennedy. Cuban leaders said intensive sabotage and guerrilla activities inside Cuba might start in a month to spark a possible uprising. Hundreds of exiles, reported itching for action and resentful of U.S. imposed curbs against the anti-Castro raids, will be recruited to infiltrate Cuba, the sources added.38
(38 - Associated Press dispatch 10 May 1963)
So...
Shortly after LHO arrived in New Orleans, on the first day of work for the coffee company, this news came out and was most likely read by him. No wonder he decided to mess with the Cuban exiles... And the reported friendship with RFK probably caught his attention too...