Kimble had 180 yards passing for the Panthers (4-2, 2-1 Ohio Valley Conference). He also ran for a 9-yard touchdown early in the first quarter. Church finished with 94 yards rushing.
After the Panthers fell behind 34-28 early in the fourth quarter, Kimble capped an 80-yard drive with a 4-yard scoring pass to Church to regain the lead, 35-34, with 9:00 remaining.
Tennessee State ate up the next 5:56 on the ensuing drive but Lane Clark missed a 46-yard field goal try with 3:00 to play and the Panthers held on to win.
Eastern Illinois scored on its first two possessions and led 21-13 at halftime.
Ronald Butler threw for 303 yards and two touchdowns and ran for another score for the Tigers (4-1, 1-1).
Jim Harbaugh taking Michigan team to South Africa in May
Jim Harbaugh is taking Michigan's football team to South Africa in May.
Ohio State 2019 spring football preview: A new era for the Buckeyes
Ryan Day takes over for Urban Meyer, with Georgia QB transfer Justin Fields getting a chance to lead the offense.
Nine simple steps to go from obscure punter to viral sensation
Living in a villa in Bali, owning a tattoo parlor and working construction in Australia. Here's how Miami's Louis Hedley became a signing-day star.
Murray: 'End of the day, I'm a football player'
Kyler Murray is excited about his decision to pursue football and the upcoming combine.
Ex-Colorado, Seahawks player T.J. Cunningham fatally shot in dispute
Former Colorado and Seahawks player Anthony "T.J." Cunningham died Monday after he was fatally shot in a dispute over a parking space.
Former Virginia Tech QB Josh Jackson transferring to Maryland
Former Virginia Tech quarterback Josh Jackson announced Monday night that he is transferring to Maryland, where he is expected to be a frontrunner in the competition for the starting quarterback job.