In 1908 and 1909 services were conducted in what is now called Taylor Community, from house-to-house.  In 1910 the Reverend Jessie Clark came to Mrs. Jane Kinser's home and held a service.  Several people received the Holy Ghost with the evidence of speaking in tongues, which created a fire in the community.  Soon to follow the Reverend Flavius J. Lee came to the community and held a revival at Hamontree's (now known as the Chestuee Baptist Church).  Hammontree’s was associated with the Cumberland Presbyterian Church at that time and they were not using the building.  When the congregation arrived for worship, the building had been padlocked.

In 1912 the Seventh Annual Assembly of the Church of God was held in Cleveland with fifty-nine delegates all coming from a good distance to attend and have a voice in the newly created Holiness Church.  The house was filled for the evening services.  It was in this year of 1912 a church was set in order in Cleveland known as the Dunn Tabernacle and The Reverend Luther Richards was appointed the pastor.  As per the time period, the church was not an elaborate building but had a dirt floor and boys would ride their horses into the building causing a great stir.  Eggs were thrown at the attendees and the building and it was during this time that the people handled snakes and fire during the services.  Because of the newness of Holiness and the fear of such actions, the church (Dunn Tabernacle) was burned, so the services were once again held from house-to-house and in a brush harbor on the Carrol Kinser farm.  Following this, services were held in a house on the H.K. (Rat) Finnell farm and was known as the Rat House.

On July 28, 1916, the Church of God called a conference meeting at Mrs. Jane Kinser's place under the Reverend W.F. Bryant's tent, for the purpose of coming to some conclusion regarding a church building for the congregation forming in the community.  The Reverend Flavius J. Lee was appointed moderator and two sites of land were discussed.  The site Jane Kinser offered was accepted.  Mr. Joe Kerr, Will Lee and the Reverend W.F. Bryant were appointed trustees for the land and a building committee was appointed.  The church was built and named Kinser Tabernacle.  Goldman Ingram (Mrs. George Rayfields father) was the first Sunday school superintendent at the Rat House and the church first began to use Church of God literature at this place.

Several times the church caught on fire and friends and members of the congregation saved it.  The water was carried by a bucket brigade from across the road, as there was no fire department to call.

The pastors of the Kinser Church of God have been:  Jessie Clark, W.F. Bryant, Luther Richards, Flavius J. Lee, Wesley Murphy, Will Black, Brother Morgan, E.J. Boehmer, A.V. Childres, H.L. Sorrow, Harry Whittington, George Lemons, T.L. McLain, George Douglas Iceam Barrett, Glover Ledford, Cordell Ellis, T.L. Phillips, Thad Richard, R.L. Beaty, Charles Clayton, R.E. Burnaham, John Baggett, Eli Cannon, B.E. Trent, Hugh Don Johnson, C.L. Scoggins, Charles Wycuff, Norman Sims, G.A. Swanson, Robert Cagle, G.L. Geren, Sammy Hughes, George Rayfield, Paul West, A.M. Swiger, O'Neil McCullough, Kelvin Page, Jerry Justice, Guinn E. Green, Richard Bane, Larry Winters, Mark Hatley, and for a second term Guinn E. Green.

At the time Rev. Cannon was pastoring, the church caught fire on Sunday morning prior to service time.  As the men worked feverishly to quench the fire, it looked as if the church would be lost.  However, the total damage required that a new roof be put on and the inside painted.  Again, during Sunday school, at the time Rev. Trent was pastoring, there was another fire, but this time it was noticed early and there was minimal damage to the building.  After this second fire, fireproof sheet rocking was installed behind the coal heating stove. 

In October 1968, under the pastorate of Rev. G.A. Swanson, the men were called together and suggestions were made that a building fund be started.  The men agreed on this and a decision was made that every first Sunday all monies received would be placed in a designated Building Fund Account.  On November 1, 1968, the first offering was received and $108.00 was the first deposit in this fund.

In 1974 Rev. G.L. Geren was appointed as pastor and growth again began at Kinser.  After prayer and discussion with French & Willie Mae Kinser land on Kinser Road near Highway 64 was donated to build a new church and relocate the congregation.  Construction began on the new building and within a few short months the church building and parsonage were sold.  In August of 1975, eight years and seven months after the building fund was created, the new facilities were completed and dedicated.  Under the direction and leadership of Rev. G. L. Geren, the church was built with funds from the sale of the old church, parsonage, savings account, donations and a loan of $10,000.00.

In February 1976 the Reverend George Rayfield was appointed pastor.  The indebtedness was $9,360.00 and on Sunday, June 12, 1978, this note was paid in full.  This was the annual homecoming.

In 1987-88 a committee was appointed to study plans for building a parsonage.  Land adjoining the church was purchased and a parsonage was built.

In 1992 the Reverend Guinn E. Green was elected pastor and stayed here for nine years.  As the church grew, property across the road from the church was purchased for Benevolence Ministries, Youth Ministries and Community Activities.  A Pavilion, The Tom Orr Pavilion, has been built for Community events and functions and the church continues to grow and reach out to the community.

In October of 2003 Pastor Green returned to the Kinser Church of God by appointment from the Overseer to complete the work begun in 1992.  His motto is “Souls are our Business, Our only business” adapted from his mentor and father in law, the Rev. G. L. Geren , former pastor and builder of the present church.