Quills and similar "pens", papyrus and other woven materials were suitable for writing on. ... and there was stone and a chisel.