For voters, Hall of Fame is becoming tougher task by year