A relative order is another name for the pegged-to-primary order, a pegged order whose price is derived from the current market quote on the same side plus an offset set by the trader. A buy order starts from the best bid and adds the offset, and a sell order starts from the best offer and subtracts it, so the order sits at or just inside the bid-ask spread. As the quote changes, the order price is revised automatically, and an optional price cap limits how far it can follow the market.
The name relative order is used in particular by Interactive Brokers, which lists it among its order types and simulates it where an exchange does not support it natively. Exchanges more often call the native version a primary peg. In both cases the aim is to post a competitive price as a liquidity provider without having to amend a limit order by hand each time the market moves.
The less aggressive variant, which sets its price behind the best quote rather than ahead of it, is the passive relative order.