I grew up in Buffalo and loved the architecture there. All of it, even the dismal funerals. Here's a link to a site that shows the Castle Inn in context. The first image on this page gives a good sense what it was like.

The history of the land from the History of Buffalo website here.

Having grown up near Buffalo, there were many of these similarly-dismal old-style buildings. We absolutely hated them, referring to them as 'Funeral'.

From Buffalo's historical site:

1831 - Original house on the site: Albert H. Tracey House
1853 - Second house: John Hollister House
1858 - House purchased by Millard Fillmore
1881 - Fillmore House converted into Hotel Fillmore
1901 - Hotel Fillmore converted into Castle Inn
1919 - Castle Inn razed in to make way for Hotel Statler (in 2002, the Statler Towers)

What a superb hodge-podge of a building. So much going on, bet the drawings would be incredible. And they sure made sure you didn't walk on the grass, no sir, not on my watch.