The cohein gadol then gave the Azazel goat to the one who would take it there. Anybody could really take it there but the cohanim made a rule that only a cohein can take it. R Yosee says that a person, Arsila, who was a yisrael took it.

Yuma 6:4

They built a ramp straight from the Bais Hamikdash to outside the city because the Babylonians would otherwise pull the hair of the he-goat saying, ‘take the sins and go’.

Important people of Yerushalayim would walk with the animal until the first tent. There were 10 tents until the cliff which was 90 ris [ris = 266 amos].