Nah, do you worship the holy scripture by revering the contents of it? Those symbols and letters represent the divine. Do you have a cross? Does your church have a cross? Is that idol worship or are you using it as symbols of the Lord and his sacrifice for all?

Holy relics are biblical.

Acts 19:11-12: “And God did extraordinary miracles by the hands of Paul, so that handkerchiefs or aprons were carried away from his body to the sick, and diseases left them and the evil spirits came out of them.” (cf. Matthew 9:20-22)