Baseball and softball were dropped Friday from the program for the 2012 Olympics in London, the first sports cut from the Summer Games in 69 years.
The International Olympic Committee then rejected the five sports wanting to get in.
Each of the 28 existing sports was put to a secret vote by the IOC, and baseball and softball failed to receive a majority required to stay on the program.
With two slots open on the program, the IOC then voted from a waiting list of five sports: golf, rugby, squash, karate and roller sports.
Squash and karate were nominated as the two for inclusion, but were rejected overwhelmingly in final confirmation votes.
With a two-thirds margin required for inclusion on the program, members voted 63-39 against squash and 63-38 against karate.
IOC president Jacques Rogge proposed a show of hands for approval of the two sports, but was forced to stick with a secret vote.