Skip to main content

bulk-url-checker and Is there a URL validator on .Net

http://www.searchcommander.com/seo-tools/bulk-url-checker/

It you do a lot of SEO work, you’ve undoubtedly needed to check the server response on a URL before, right? We used to do it frequently, and often had a large batch of URL’s to check. We couldn’t find an online tool to check a whole batch, so I had a tool built.
When working on a website that’s been around for years, there can be all sorts of redirect going on, or even 404 pages that you don’t know about, and that can frustrate your best efforts.
Simply paste a list of URL’s here, one on each line, with no other characters, and wait. The more you paste, the longer it will take, but in the end, it will save you a lot of time and energy.


====================================================

You can use the Uri.TryCreate to validate an URL:
public bool IsValidUri(string uri)
{
    Uri validatedUri;
    return Uri.TryCreate(uri, UriKind.RelativeOrAbsolute, out validatedUri);
}
The comments suggest that TryCreate just moves the exception handling one level down. However, I checked the source code and found that this is not the case. There is no try/catch inside TryCreate, it uses a custom parser which should not throw.



Comments

  1. I read your full article. This is a very impotent topic. I’m really loving your blog.
    I have a very small blog. There I try to write something similar. Please visit my site & do you have any suggestions.

    ReplyDelete

Post a Comment

Popular posts from this blog

IPv4 header to requests when a client is using IPv6

  What is Pseudo IPv4? As a stopgap to accelerate the adoption of IPv6, Cloudflare offers Pseudo IPv4 which supports IPv6 addresses in legacy applications expecting IPv4 addresses. The goal is to provide a nearly unique IPv4 address for each IPv6 address, using Class E IPv4 address space, which is designated as experimental and would not normally see traffic. To learn more see  here . Options Add header:  Add additional Cf-Pseudo-IPv4 header only Overwrite headers:  Overwrite the existing Cf-Connecting-IP and X-Forwarded-For headers with a pseudo IPv4 address Cloudflare

bot hit - server response time and overall page loadtime increase - aws, ec2, google analytic, cloudflare, ms sql cpu usage 100%

 Dear All, I've recently facing website page load time and server response time issue,  troubleshooting -  1. IIS log via - http log browser (tool to identify the bot hit) 2. disallow in robots.txt 3. article found and feature enabled in Cloudflare   Bot Fight Mode Challenge requests matching patterns of known bots before they can access your site. Requests matching Cloudflare-identified, non-legitimate automated traffic patterns will be challenged and/or blocked by Cloudflare. And, JavaScript Detections Use lightweight, invisible JavaScript detections to improve Bot Management products. 4. AWS EC2  Add new security group for Cloudflare ips list Ref:  https://dev.to/johnmccuk/automate-aws-security-group-with-cloudflare-ips-la6 And referred follow articles: https://www.imperva.com/products/advanced-bot-protection-management/ https://blog.apnic.net/2019/11/15/how-to-hide-aws-ec2-instances-from-network-scanning-bots-using-ipv6/ https://pawelurbanek.com/ec...

IIS 7 Tip # 5 Run a command when Rapid Fail Protection is triggered

Rapid-Fail Protection disables application pools if they crash multiple times within in a specified time period. This prevents the failing application pool from getting into a continuous loop of crashing and restarting. This protects other application pools running on the server as repeated failures can consume lot of system resources. When rapid-fail protection kicks in it stops the application pool that is repeatedly crashing and your clients will start getting a 503 – Service Unavailable error. An administrator will have to manually enable the application pool again. You also have to option to configure an executable to run when ever rapid-fail protection is triggered. For example below I have configured the application pool to restart the IIS service using iisreset.exe … the /rebootonerror will reboot the whole server if iisreset.exe for some reason fails to restart the services. Refer http://blogs.msdn.com/b/vijaysk/archive/2009/03/13/iis-7-tip-5-run-a-command-when-rapid-f...