Rate limit for segment refresh

How can I avoid exceeding the rate limit (contacts.api.too_many_requests) when refreshing segments through the API GET /contacts?segment_id=