Hi PD's.....Tom... you should never have to

glue an O-ring unless that is the only method of installation....if it was the case, MODIFY the installation as the glue used is that CRYNOCRY-alot stuff :sob

and would only good for gluing your thumb & fore finger to the O-ring section

:
O-rings are manufactured in ever increasing sizes [and a number of sections] and measured as the bore X the section so the outer diameter = [bore + twice the section] etc - any roller bearing store will have an extensive range available in ANSI or BS Standards.... both imperial - Nitrile 70 Duro the preferred material for dynamic/rotational applications.... O-rings will stretch, but an increase in tension = an increase in friction
You could also consider manufacturing twin O-ring pulleys = twice the transmitted power - the big killer in small O-ring drives is the need to maintain approx 1/3 circumferential wrap on the diameter of the pulley, so with a reduction ratio... a method of attaining [or exceeding] this 1/3 wrap on the smaller pulley is to use over size/length O-rings & employ a third or 'tensioning' o-ring pulley
You can access "Stock Drive Products" from our Web Links & there you will find stainless steel or and plastic roller chain & pinions down to 0.1475" or 3.75 mm pitch.....

...as Eddy notes..... certainly not inexpensive