Regardless of whether you are a startup, a small business or a global one, our team is always ready to help you. Enterprises operating on a scale can also choose special premium support management with high priority 24/7 email and telephone responses and other professional services.
WhoisXML API has significantly improved its Newly Registered Domains (NRD) service, leading to the introduction of NRD 2.0 and phasing out of NRD 1.0 with end of service (EOS) and end of life (EOL) scheduled respectively on 1 March 2024 and 31 December 2024.
Among other enhancements, new domain activities that are monitored now not only span “added” and “dropped” domains but also “updated” and “discovered” domains. Below is an overview of NRD 2.0’s technical benefits.
WhoisXML API continues to improve its products and services as part of its commitment to a safer and more transparent Internet through the delivery of high-quality and reliable domain, IP, and DNS intelligence sources.
Among our most recent developments is the massive increase in the country-code top-level domain (ccTLD) coverage of the Newly Registered Domains V2 (NRD2) Data Feed. Specifically, we recorded a 153.95% increase in the number of domain activity for the top 10 ccTLDs in 2023 compared to 2022.
The intention of this document is to show you the basics of how to download the WhoisXML API's NRD2 data feed provided by WhoisXML API to a GCP Cloud Storage bucket by leveraging a serverless Cloud Functions. GCP Cloud Functions acts as a serverless compute service that allows you to write and execute code without provisioning or managing servers. GCP Cloud Storage is an object storage service for storing and retrieving files. This document will guide you through the process of configuring both GCP Cloud Functions and a GCP Cloud Storage bucket.
The intention of this document is to show you the basics of how to download the WhoisXML API's NRD2 data feed provided by WhoisXML API to an AWS S3 bucket by leveraging a serverless Lambda function. AWS Lambda functions act as a serverless compute service that allows you to write and execute code without provisioning or managing servers. AWS S3 is an object storage service for storing and retrieving files. This document will guide you through the process of configuring both AWS Lambda and an AWS S3 bucket.
As part of WhoisXML API’s efforts to continuously improve its products and services, the coverage and quality of the Newly Registered Domains (NRD2) Data Feed significantly improved over the past months. More precisely, the latest Q3 2023 measurements show that the data feed’s coverage increased by 89% since the last quarter of 2022.
Within the next months, we will stop supporting Newly Registered Domain (NRD) 1.0 and steadily continue user migration to NRD 2.0, an upgraded version with more comprehensive data coverage and event monitoring than ever before.
Domain names go through a life cycle that begins during their registration and ends when they expire. The minimum domain registration period usually lasts one year. After that, owners or registrants must go through the renewal process unless they opt for automatic renewal that many registrars offer. That said, many domains could still end up on just-dropped domain lists for the following reasons:
Their owners no longer need them.
Their owners forgot to renew their registration.
Regardless of the reason, monitoring them can serve various purposes. This blog post tackles these use cases and the ways to find just-dropped domains.
An early line of defense for companies that want to protect their staff or customers from bogus websites is to monitor new domain registrations. Threat actors often use variations of well-known domain names to lure unsuspecting users to fake portals to steal their private information or drop malware onto their devices.
There are a few ways users can watch out for new domain names that closely resemble their existing websites or their customers’ or suppliers’ sites. But before we dive into them, let’s review why monitoring new domain registrations is essential.
WhoisXML API’s Newly Registered & Just Expired Domains Database service has a new and improved version called “NRD 2.0.” Among other improvements, it offers better coverage and is easier to use than its predecessor. Learn more about NRD 2.0 in this guide.
In the first part of this blog, we demonstrated how to download data from WhoisXML API's daily data feeds right after their publication by using the recently introduced RSS feed as the activator of download. In particular, we showed how to download the list of domains newly registered in the .com top-level domain (TLD).
Now, to make the task a bit more interesting we demonstrate the use of our domain list with a showcase application: we calculate the list of the most frequent English words in the domain names on that day. This can be interesting in various applications. Domainers, for instance, can get information on the newest trends in domain registrations. Journalists and researchers can get a clue on a topic gaining popularity, etc.
This technical blog aims to demonstrate how to download data from WhoisXML API's daily data feeds right after their publication. Obtaining lists of newly registered domains and their WHOIS data can be critical in many applications. (We will showcase such an application in the second part of this blog.) Recently an RSS feed has been introduced for the service that informs about data publication immediately, which makes this easy. As a demonstration, we shall go through a particular task: download the list of domains newly registered in the .com top-level domain (TLD).
We will use a Linux system and its understanding requires intermediate programming and command-line skills. We will use BASH but it is also easy to modify for zsh, which is the default on Mac OS X. We assume Python, with pip and virtualenv.
It’s generally agreed that newly registered domains are potential sources of threats. After all, many of these domain registrations are made opportunistically—sometimes even in bulk, following public announcements and global events. While not all of these domains have to be avoided at all costs, they certainly deserve more scrutiny than others that have been established for years.
Imagine a world without domain names. While it is possible to live in one, the majority of people would have a hard time memorizing sets of numbers instead of names. If you want to visit google[.]com, for example, you would need to type in 172[.]217[.]11[.]14 every single time – not to mention that this IP address might change every time Google changes the way it deploys its web server network. But you get the point. People would need to memorize several series of numbers so they can shop, pay bills, and get in touch with people from across the globe online.
We dare say that without domain names, the online world would not be flourishing as it is now. The domain name industry in itself is also thriving, with thousands of domains bought and registered every day. Verisign disclosed that during the fourth quarter of 2019, it closed 362.3 million domain name registrations across all top-level domains (TLDs).
With that enormous number, how can you monitor new domain names? That is where Newly Registered & Recently Expired Domains Data Feed comes in handy. But perhaps a more pressing question is why there should be a need to monitor domain names, notably, newly registered ones? We addressed these questions in this post, starting with the practical usages of having a newly registered domain list or database.