Multimodal and Multiscale Deep Neural Networks for the Early Diagnosis of Alzheimer’s Disease using structural MR and FDG-PET images

Donghuan Lu(Simon Fraser University), Karteek Popuri(Simon Fraser University), Gavin Weiguang Ding(Simon Fraser University), Rakesh Balachandar(Simon Fraser University), Mirza Faisal Beg(Simon Fraser University), Alzheimer’s Disease Neuroimaging Initiative(San Francisco VA Medical Center), Michael D. Weiner(University of California San Diego), Paul Aisen(WinnMed), Ronald C. Petersen(Mayo Clinic in Florida), Cliford Jack(University of California, Berkeley), William J. Jagust(California University of Pennsylvania), John Q. Trojanowki(University of Southern California), Arthur W. Toga(University of California, Davis), Laurel Beckett(Brigham and Women's Hospital), Robert C. Green(Indiana University), Andrew J. Saykin(Washington University in St. Louis), John C. Morris(Washington University in St. Louis), Leslie M. Shaw(Oregon Health & Science University), Jefrey Kaye(Oregon Health & Science University), Joseph Quinn(Oregon Health & Science University), Lisa C. Silbert(Oregon Health & Science University), Betty Lind(Oregon Health & Science University), Raina Carter(Oregon Health & Science University), Sara Dolen(University of Southern California), Lon S. Schneider(University of Southern California), Sonia Pawluczyk(University of Southern California), Mauricio Beccera(University of Southern California), Liberty Teodoro(University of Southern California), Bryan Spann(University of California San Diego), James Brewer(University of California San Diego), Helen Vanderswag(University of California San Diego), Adam Fleisher(University of Michigan), Judith L. Heidebrink(University of Michigan), Joanne Lord(Mayo Clinic in Florida), Sara S. Mason(Mayo Clinic in Florida), Colleen S. Albers(Mayo Clinic in Florida), David S. Knopman(Mayo Clinic in Florida), Kris Johnson(Baylor College of Medicine), Rachelle S. Doody(Baylor College of Medicine), Javier Villanueva‐Meyer(Baylor College of Medicine), Munir Chowdhury(Baylor College of Medicine), Susan Rountree(Baylor College of Medicine), Mimi Dang(Columbia University Irving Medical Center), Yaakov Stern(Columbia University Irving Medical Center), Lawrence S. Honig(Columbia University Irving Medical Center), Karen L. Bell(Washington University in St. Louis), Beau M. Ances(Washington University in St. Louis), Maria Carroll(San Francisco VA Medical Center), Mary L. Creech(Washington University in St. Louis), Erin Franklin(Washington University in St. Louis), Mark A. Mintun(Washington University in St. Louis), Stacy Schneider(Washington University in St. Louis), Angela Oliver(University of Alabama at Birmingham), Daniel Marson(University of Alabama at Birmingham), Randall Grifth(University of Alabama at Birmingham), David Clark(University of Alabama at Birmingham), David Geldmacher(University of Alabama at Birmingham), John Brockington(University of Alabama at Birmingham), Erik D. Roberson(University of Alabama at Birmingham), Marissa Natelson Love(Icahn School of Medicine at Mount Sinai), Hillel Grossman(Icahn School of Medicine at Mount Sinai), Efe Mitsis(Rush University Medical Center), Raj C. Shah(Rush University Medical Center), Leyla deToledo‐Morrell, Ranjan Duara, Daniel Varón, Maria T. Greig, Peggy Roberts(Johns Hopkins University), Marilyn Albert(Johns Hopkins University), Chiadi U. Onyike(Johns Hopkins University), Daniel D’Agostino(Johns Hopkins University), Stephanie Kielb(New York University), James E. Galvin(New York University), Brittany Cerbone(New York University), Christina A. Michel(New York University), Dana M. Pogorelec(New York University), Henry Rusinek(New York University), Mony J. de Leon(New York University), Lidia Glodzik(New York University), Susan De Santi(Duke Medical Center), P. Murali Doraiswamy(Duke Medical Center), Jefrey Petrella(Duke Medical Center), Salvador Borges‐Neto(Duke Medical Center), Terence Z. Wong(Duke Medical Center), Edward Coleman(University of Kentucky), Charles Smith(University of Kentucky), Gregory A. Jicha(University of Kentucky), Peter Hardy(University of Kentucky), Partha Sinha(University of Kentucky), Elizabeth Oates(University of Kentucky), Gary Conrad(University of Rochester Medical Center), Anton P. Porsteinsson(University of Rochester Medical Center), Bonnie S. Goldstein(University of Rochester Medical Center), Kim Martin(University of Rochester Medical Center), Kelly M. Makino(University of Rochester Medical Center), M. Saleem Ismail(University of Rochester Medical Center), Connie Brand(University of California, Irvine), Ruth A. Mulnard(University of California, Irvine), Gaby Thai(University of California, Irvine), Catherine Mc-Adams-Ortiz(The University of Texas Southwestern Medical Center), Kyle Womack(The University of Texas Southwestern Medical Center), Dana Mathews(The University of Texas Southwestern Medical Center), Mary Quiceno(Emory University), Allan I. Levey(Emory University), James J. Lah(Emory University), Janet Cellar(University of Kansas Medical Center), Jefrey Burns(University of Kansas Medical Center), Russell H. Swerdlow(University of Kansas Medical Center), William M. Brooks(University of California, Los Angeles), Liana G. Apostolova(University of California, Los Angeles), Kathleen Tingus(University of California, Los Angeles), Ellen Woo(University of California, Los Angeles), Daniel Silverman(University of California, Los Angeles), Po H. Lu(University of California, Los Angeles), George Bartzokis(Jacksonville College), Neill Graf-Radford(Jacksonville College), Francine Parftt(Jacksonville College), Tracy Kendall(Jacksonville College), Heather Johnson(Indiana University), Martin R. Farlow(Indiana University), Ann Marie Hake(Indiana University), Brandy R. Matthews(Indiana University), Jared R. Brosch(Indiana University), Scott Herring(Indiana University), Cynthia Hunt(Yale University), Christopher H. van Dyck(Yale University), Richard E. Carson(Yale University), Martha G. MacAvoy(Yale University), Pradeep Varma(Jewish General Hospital), Howard Chertkow(Jewish General Hospital), Howard Bergman(Jewish General Hospital), Chris Hosein, Sandra Black, Bojana Stefanovic, Curtis Caldwell, Ging‐Yuek Robin Hsiung, Howard Feldman, Benita Mudge, Michele Assaly, Elizabeth Finger, Stephen Pasternack, Irina Rachisky, Dick Trost, Andrew Kertesz(Cleveland Clinic), Charles Bernick(Cleveland Clinic), Donna Munic(Northwestern University), Marek-Marsel Mesulam(Northwestern University), Kristine Lipowski(Northwestern University), Sandra Weıntraub(Northwestern University), Borna Bonakdarpour(Northwestern University), Diana Kerwin(Northwestern University), Chuang‐Kuo Wu(Northwestern University), Nancy Johnson(Palm Beach Neurology), Carl Sadowsky(Palm Beach Neurology), Teresa Villena(Georgetown University), Raymond Scott Turner(Georgetown University), Kathleen Johnson(Georgetown University), Brigid Reynolds(Brigham and Women's Hospital), Reisa Sperling(Brigham and Women's Hospital), Keith A. Johnson(Brigham and Women's Hospital), Gad A. Marshall(Stanford University), Jerome A. Yesavage(Stanford University), Joy L. Taylor(Stanford University), Barton Lane(Stanford University), Allyson Rosen(Stanford University), Jared Tinklenberg(Banner Sun Health Research Institute), Marwan N. Sabbagh(Banner Sun Health Research Institute), Christine M. Belden(Banner Sun Health Research Institute), Sandra A. Jacobson(Banner Sun Health Research Institute), Sherye A. Sirrel(Boston University), Neil W. Kowall(Boston University), Ronald Killiany(Boston University), Andrew E. Budson(Boston University), Alexander Norbash(Boston University), Patricia Lynn Johnson(Howard University), Thomas O. Obisesan(Howard University), Saba Wolday(Howard University), Joanne Allard(Case Western Reserve University), Alan J. Lerner(Case Western Reserve University), Paula Ogrocki(Case Western Reserve University), Curtis Tatsuoka(Case Western Reserve University), Parianne Fatica(University of California, Davis), Evan Fletcher(University of California, Davis), Pauline Maillard(University of California, Davis), John Olichney(University of California, Davis), Charles DeCarli(University of California, Davis), Owen Carmichael(Neurological Surgery), Smita Kittur, Michael Borrie, T.-Y. Lee, Robert Bartha, Sterling C. Johnson, Sanjay Asthana, Cynthia M. Carlsson(University of California, Irvine), Steven Potkin(University of California, Irvine), Adrian Preda(University of California, Irvine), Dana Nguyen(Alzheimer's Association), Pierre N. Tariot(Alzheimer's Association), Anna Burke(Alzheimer's Association), Nadira Trncic(Alzheimer's Association), Stephanie Reeder(Dent Neurologic Institute), Vernice Bates(Dent Neurologic Institute), Horacio Capote(Dent Neurologic Institute), Michelle Rainka(The Ohio State University), Douglas W. Scharre(The Ohio State University), Maria Kataki(The Ohio State University), Anahita Adeli(Albany Medical Center Hospital), Earl A. Zimmerman(Albany Medical Center Hospital), Dzintra Celmins(Albany Medical Center Hospital), Alice D. Brown(Hartford Hospital), Godfrey D. Pearlson(Hartford Hospital), Karen Blank(Hartford Hospital), Karen Anderson(Dartmouth–Hitchcock Medical Center), Laura A. Flashman(Dartmouth–Hitchcock Medical Center), Marc Seltzer(Dartmouth–Hitchcock Medical Center), Mary L. Hynes(Dartmouth–Hitchcock Medical Center), Robert B. Santulli(Wake Forest University), Kaycee M. Sink(Wake Forest University), Leslie Gordineer(Wake Forest University), Jef Williamson(Wake Forest University), Pradeep Garg(Wake Forest University), Franklin Watkins(Rhode Island Hospital), Brian R. Ott(Rhode Island Hospital), Henry Querfurth(Rhode Island Hospital), Geofrey Tremont(Providence College), Stephen Salloway(Providence College), Paul Malloy(Providence College), Stephen Correia(University of California, San Francisco), Howard J. Rosen(University of California, San Francisco), Bruce L. Miller(University of California, San Francisco), David C. Perry(Medical University of South Carolina), Jacobo Mintzer(Medical University of South Carolina), Kenneth Spicer(Medical University of South Carolina), David Bachman(Nathan Kline Institute for Psychiatric Research), Nunzio Pomara(Cornell University), Raymundo Hernando(Nathan Kline Institute for Psychiatric Research), Antero Sarrael(Cornell University), Norman Relkin(Cornell University), Gloria Chaing(Cornell University), Michael Lin(Cornell University), Lisa Ravdin(University of South Florida), Amanda Smith(University of South Florida), Balebail Ashok Raj(University of South Florida), Kristin Fargher
Scientific Reports
April 4, 2018
Cited by 380Open Access
Full Text

Abstract

Alzheimer's Disease (AD) is a progressive neurodegenerative disease where biomarkers for disease based on pathophysiology may be able to provide objective measures for disease diagnosis and staging. Neuroimaging scans acquired from MRI and metabolism images obtained by FDG-PET provide in-vivo measurements of structure and function (glucose metabolism) in a living brain. It is hypothesized that combining multiple different image modalities providing complementary information could help improve early diagnosis of AD. In this paper, we propose a novel deep-learning-based framework to discriminate individuals with AD utilizing a multimodal and multiscale deep neural network. Our method delivers 82.4% accuracy in identifying the individuals with mild cognitive impairment (MCI) who will convert to AD at 3 years prior to conversion (86.4% combined accuracy for conversion within 1-3 years), a 94.23% sensitivity in classifying individuals with clinical diagnosis of probable AD, and a 86.3% specificity in classifying non-demented controls improving upon results in published literature.


Related Papers

No related papers found

Powered by citation graph analysis