Quoted in Ryan defends no town halls, declines comment on Trump. (Argus-Press, 5/12/2017)
In other words, he prefers to select the people with whom he wishes to meet and, as much as possible, control the environment.
About those office hours...
Melissa Byrne of UltraViolet was allowed in to speak to two women who appeared to be from Ryan's staff. She asked to speak to Ryan on the phone or to set up a meeting with him, but staff members refused, she said.
Ryan's spokesman has said Ryan's office is accepting calls and mail only from 1st Congressional District residents.
Reported in About 70 protest at Rep. Ryan's Janesville office. (Janesville Gazette, 2/22/2017)
Paul Ryan raised $657,000 while avoiding his constituents during recess. (Intercept, 4/15/2017)