Trekoro
How we check prices

Read by software, checked in the open

Every price on Trekoro is read from the operator's own page by software. No person checks prices as a routine. This page says what a reading must pass before it is shown, how often the readings turn out wrong, and what happens when a visitor tells us a price is wrong.

Where this stands today

315 prices are on the site. None of them has yet been through the automatic checks below; they were read once by our system, on the date shown next to each price, and are being read again row by row. Until every price has been through the checks and a first audit shows few enough errors, no new reading is published automatically.

What a reading must pass

  1. A fresh copy of the page. The operator's page is fetched again, at most 48 hours before the decision, and the copy is kept so we can show later what was read.
  2. The operator's own page, about this trek. The page must be on the operator's own website, not a marketplace or a front page, and must name the trek.
  3. Word for word. The price, its currency, the year it applies to and the length of the trip must each stand word for word in the page's visible text. The price must be quoted in one unbroken passage. A bare "$" is taken as US dollars only when the operator is based in the United States or in a country with no dollar of its own; an operator in Australia, New Zealand, Canada or another dollar country must name the currency on the page. That is our assumption, not something the page says, and the history of the price records it.
  4. Two readings that agree. Two automated readers read the same copy without seeing each other's answer, the published price or a visitor's report. They must agree on every figure that changes the cost. When they split, a third reads the page, and the reading passes only if the third agrees completely with one of them.
  5. Never a sale price or a crossed-out price. We show the operator's regular price. A price that only appears crossed out, or that stands next to words such as "save" or "now", is held back unless the page itself says which figure is the regular one.
  6. Plausible next to the others. The price per day must lie between 0.6 and 1.8 times the median of the other operators on the same trek, and a price that moves more than 40 percent is read again before it is shown.
  7. Not too much at once. More than 15 price changes in one night, or more than half of one operator's prices changing together, is treated as a fault on our side and held back.
  8. An honest history. When a new reading differs from the old one and the new figure already stood on the page we read before, we record it as our mistake, not as the operator changing the price. Both kinds are listed under What's new.
  9. A breaker. If the monthly audit below finds too many errors, automatic publishing switches itself off until the cause is fixed and a new audit passes.

A reading that fails any of these is held back. The price already on the site stays as it is, with the date it was read, and the page is tried again after one, three and seven days.

How often the readings are wrong

Once the checks above cover every price, on the first of each month 40 prices are drawn at random, with a seed we publish so anyone can repeat the draw. A separate automated reader reads each page again without seeing our figure. A price counts as wrong when the figure it finds already stood on the page we read, so we misread it; it counts as changed when the operator has altered the price since. This rate is measured by software, not by a person and not by the operators.

The first audit has not been run yet. Its result, the seed and the list of prices drawn will be published here.

Three or more wrong in 40, or an upper bound above 5 percent over three months, switches automatic publishing off.

When a visitor reports a price

A "Report a wrong price" link on every row is being switched on. When it is, a report on a row will put that page in line to be read again within a day. If the re-reading finds we were wrong, the price is corrected and the correction is listed below. A report is never closed only because the software reads the same figure again: when the figure in the report stands on the operator's page, a person looks at it.

No reports have been received yet.

Readings we corrected

Before you book, open the operator's page and confirm the price yourself. The full terms are on the terms page.