>> In 1964 at Chinatown, Lee had a controversial private match with Wong Jack Man

In Oakland, California in 1964 at Chinatown, Lee had a controversial private match with Wong Jack Man, a direct student of Ma Kin Fung known for his mastery of Xingyiquan, Northern Shaolin, and T'ai chi ch'uan. According to Lee, the Chinese community issued an ultimatum to him to stop teaching non-Chinese. When he refused to comply, he was challenged to a combat match with Wong. The arrangement was that if Lee lost, he would have to shut down his school; while if he won, then Lee would be free to teach Caucasians or anyone else. Wong denied this, stating that he requested to fight Lee after Lee boasted during one of his demonstrations at a Chinatown theatre that he could beat anyone in San Francisco, and that Wong himself did not discriminate against Caucasians or other non-Chinese. Lee commented, "That paper had all the names of the sifu from Chinatown, but they don't scare me". 

Individuals known to have witnessed the match include Cadwell, James Lee (Bruce Lee's associate, no relation), and William Chen, a teacher of T'ai chi ch'uan. Wong and William Chen stated that the fight lasted an unusually long 20–25 minutes. Wong claims that he had originally expected a serious but polite bout; however Lee had attacked him very aggressively with intent to kill, straight from the beginning of the bout when he had replied to Wong's traditional handshake offer by "pretending to extend a friendly hand only to suddenly transform the hand into a four-pronged spear aimed at Wong's eyes". 

Forced to defend his life, he had nonetheless refrained from striking Lee with killing force when the opportunity presented itself because it could earn him a prison sentence. The fight ended due to Lee's "unusually winded" condition, as opposed to a decisive blow by either fighter. According to Bruce Lee, Linda Lee Cadwell, and James Yimm Lee however, the fight lasted a mere 3 minutes with a decisive victory for Lee. In Cadwell's account, "The fight ensued, it was a no-holds-barred fight, it took three minutes. Bruce got this guy down to the ground and said 'do you give up?' and the man said he gave up". 

A couple of weeks after the bout, Lee gave an interview claiming that he had defeated an unnamed challenger, which Wong says was an obvious reference to him. In response, Wong published his own account of the fight in the Chinese Pacific Weekly, a Chinese-language newspaper in San Francisco, with an invitation to a public rematch if Lee was not satisfied with the account. Lee did not respond to the invitation "despite his reputation for responding with fists of fury to the slightest provocation", and there were no further public announcements by either, though Lee continued to teach Caucasians.
(source)