The library was organized as the Rush Free Library Association at a public meeting called by Ingleside Club at the residence of Mr. and Mrs. N.S. Sherman. Miss Caroline Webster, library organizer from Albany, conducted the meeting. A constitution was adopted and five trustees elected. The provisional charter issued by the Board of Regents is dated March 3, 1914.

The library opened to the public February 18, 1914. The first money to operate came from annual memberships and from gifts. One hundred of the $120 received was matched with state funds. From this the first books were purchased. The following year Rush voters approved a proposition asking that $200 be appropriated annually by the town for the use of the library. During the next few years additional funds were raised through dramatic productions directed by Miss Bessie Hallock and through masquerade parties and suppers. Membership fees continued to provide revenue.

The library has had four homes. The first was the second floor of the Sherman building, 6075 E. Henrietta Road, formerly Bock’s store, presently CCO Whirlpool & Spa Service. The second location was a small building on the Aden Chaffer property at 6087 E. Henrietta Rd. The library relocated to the newly built Town Hall in 1936. In 1974 voters approved construction of a 3,300 square foot building on the north side of the Town Hall which is the library’s present site.