Hi,
I'd like to know how to go about doing bulk whois (thick) lookup 200+ million domain names in the shortest time? This will be in the background - Store the whois results in database.
I have the list of 200+ million domain names (the major extensions - .com, .net, .org, .info, etc,.). How would you (or other whois history sites) do it and without getting blocked or banned? Using proxy to whois query?
I'm thinking for thin whois (.com, .net. etc), I'll check the "updated date" before doing a thick whois, for others (.org), it would be the usual thick whois.
Ideas? Thoughts?
Thanks
I'd like to know how to go about doing bulk whois (thick) lookup 200+ million domain names in the shortest time? This will be in the background - Store the whois results in database.
I have the list of 200+ million domain names (the major extensions - .com, .net, .org, .info, etc,.). How would you (or other whois history sites) do it and without getting blocked or banned? Using proxy to whois query?
I'm thinking for thin whois (.com, .net. etc), I'll check the "updated date" before doing a thick whois, for others (.org), it would be the usual thick whois.
Ideas? Thoughts?
Thanks