A panel of prominent medical school deans from across the country convened in New York City to discuss the future of annual medical school rankings issued by U.S. News & World Report.

The U.S News & World Report Summit,”The Impact and Future of Medical School Rankings,” was co-sponsored by the magazine, Mount Sinai School of Medicine and Mount Sinai Medical Center.

The purpose of the summit was to discuss the usefulness of the U.S. News rankings, their flaws and how the ranking system can be improved.

The consensus among the nine deans, associate deans and academic representatives was that the rankings are deeply flawed. Several pointed out those defects include a response rate of between 17 and 19 percent to the reputational survey sent to residency program directors – a measure that accounts for one-fifth of the overall ranking score.

Jules L. Dienstag, dean for medical education at Harvard Medical School, rejected the meaning and utility of the rankings despite the fact that Harvard is currently ranked number one.

The deans cited other flaws, including a heavy weighting of high MCAT scores. While it’s widely accepted that many students with lower MCAT scores prove to be excellent medical school students, physicians and physician-scientists, admitting students with lower scores negatively impacts a school’s ranking and likely discourages diversity goals.

Allen M. Spiegel, M.D., the Marilyn and Stanley M. Katz Dean at Albert Einstein College of Medicine of Yeshiva University stressed the need for more ethnically and racially diverse physicians given the demographics of the U.S. “Having doctors that you can relate to improves care,” he said. Dr. Spiegel highlighted the high incidence of health disparities in the U.S. as a key driver for the lower average life expectancy in the U.S. as compared with countries in Western Europe which spend far less per person on health care than the U.S.

The deans and the audience for the panel discussion – which included many medical students and prospective students – agreed that the U.S. News ratings do little to reflect the educational quality of each medical school or its commitment to community service.

The summit was moderated by Brian Kelly, editor of U.S. News & World Report, and included Robert Morse, director of data research at U.S. News, who has led the rankings project for years. They both agreed to consider all feedback on the rankings methodology and potentially collaborate more with the Association of American Medical Colleges (AAMC), which collects data that may better inform the U.S. News rankings.