Anthropic Interview Question

Write a URL crawler, initially synchronous, later make it async, discuss tradeoffs, etc.