Giving Back: Download all of the URLs listed in DMOZ
DMOZ, also named Open Directory Project or ODP, offers their weekly data dumps free of charge. We felt it was appropriate to offer some of the data that we extract from the dumps to users seeking this data.
The DMOZ dumps are currently just under 300 MB to download, and when uncompressed it is around 1.9 GB in size. This is an extremely large amount of data. Unfortunately, they don't offer just the URLs that are included in the directory so we must extract them from their weekly dumps.
Each week UrlTrends downloads the DMOZ dump, parses out all of the URLs and then creates the file below for you to download. Of course, we also do our own deeds with these URLs.
If you would like a copy of the URLs from DMOZ to download you can use the following link:
Note: The downloadable data provided above is a derivative work of the freely available Open Directory Project's data. Use of this data requires acceptance to the
Free Use License as written by the Open Directory Project. While you are required to comply with all parts of the Free Use License, Sections 2(a) and 2(b) are in reference to the attribution statement. You must place the appropriate attribution statement as written in these sections.
A link to UrlTrends is not required, however greatly appreciated. If you do not intend on linking to UrlTrends, then please at least enter a URL in the above (or below) text boxes to see what we do (assuming you haven't already done so).
